2024-09-12T12:03:23.538 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T12:03:23.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T12:03:23.669 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901711' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcPtZvMBH0a1klLUDXLXJ5icL8rxM57C/cQCQQ187ZU2AQ4rgSx9QbEkp261WlCiLWjjGYxqmR29ws4romNcCA= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoKU1W4sVlnSu0oglRr9Wa1aPYMNZCgdG0KHVt5UPD6AzozAT/eLRTC2ZSgyitMstjP4KladNnuJ/4oW+exfIw= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXkKbmgjNltDfgBKxlpHLaFgwa39AASUwBs8T4qb43K7jGeIh+9DnuXr+1EcNDQ+IPxXzlK07AqmMYOSe0d2L0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T12:03:23.669 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T12:03:23.670 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T12:03:23.670 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T12:03:23.671 INFO:teuthology.task.internal:Checking packages... 2024-09-12T12:03:23.693 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T12:03:23.693 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T12:03:23.693 INFO:teuthology.packaging:ref: None 2024-09-12T12:03:23.693 INFO:teuthology.packaging:tag: None 2024-09-12T12:03:23.693 INFO:teuthology.packaging:branch: squid 2024-09-12T12:03:23.693 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:03:23.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T12:03:23.910 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T12:03:23.911 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T12:03:23.920 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T12:03:23.920 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T12:03:24.111 INFO:teuthology.task.internal:Saving configuration 2024-09-12T12:03:24.131 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T12:03:24.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T12:03:24.231 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:58:04.006912', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcPtZvMBH0a1klLUDXLXJ5icL8rxM57C/cQCQQ187ZU2AQ4rgSx9QbEkp261WlCiLWjjGYxqmR29ws4romNcCA='} 2024-09-12T12:03:24.262 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:58:04.003330', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoKU1W4sVlnSu0oglRr9Wa1aPYMNZCgdG0KHVt5UPD6AzozAT/eLRTC2ZSgyitMstjP4KladNnuJ/4oW+exfIw='} 2024-09-12T12:03:24.289 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:58:04.005241', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXkKbmgjNltDfgBKxlpHLaFgwa39AASUwBs8T4qb43K7jGeIh+9DnuXr+1EcNDQ+IPxXzlK07AqmMYOSe0d2L0='} 2024-09-12T12:03:24.290 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T12:03:24.296 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T12:03:24.297 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T12:03:24.297 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T12:03:24.297 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T12:03:24.731 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca693e3e20>, signals=[15]) 2024-09-12T12:03:24.731 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T12:03:24.753 INFO:teuthology.task.internal:Opening connections... 2024-09-12T12:03:24.753 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-09-12T12:03:24.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:03:24.857 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-12T12:03:24.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:03:24.939 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T12:03:24.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:03:25.027 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T12:03:25.109 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-09-12T12:03:25.129 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-09-12T12:03:25.129 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-09-12T12:03:25.186 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T12:03:25.187 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T12:03:25.188 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T12:03:25.188 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-09-12T12:03:25.221 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-12T12:03:25.239 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-12T12:03:25.240 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-12T12:03:25.298 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-12T12:03:25.298 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-12T12:03:25.298 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T12:03:25.299 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T12:03:25.300 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-12T12:03:25.329 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-12T12:03:25.348 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-12T12:03:25.348 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-12T12:03:25.406 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-12T12:03:25.406 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-12T12:03:25.406 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-12T12:03:25.406 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-12T12:03:25.406 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-12T12:03:25.406 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T12:03:25.407 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T12:03:25.407 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-12T12:03:25.437 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T12:03:25.448 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T12:03:25.503 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T12:03:25.503 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-09-12T12:03:25.506 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-12T12:03:25.508 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-12T12:03:25.525 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T12:03:25.828 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T12:03:25.829 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-09-12T12:03:25.831 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-12T12:03:25.834 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-12T12:03:25.937 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T12:03:26.685 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T12:03:26.982 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T12:03:26.983 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-12T12:03:26.983 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-12T12:03:26.983 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:03:27.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:03:27.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-12T12:03:27.189 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T12:03:27.189 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T12:03:27.189 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-12T12:03:27.207 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-503.el9.x86_64 2024-09-12T12:03:27.207 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T12:03:27.208 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T12:03:27.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum upgrade -y linux-firmware 2024-09-12T12:03:29.717 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-12T12:03:35.401 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-12T12:03:40.069 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 6.5 MB 00:00 2024-09-12T12:03:41.561 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-12T12:03:42.649 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-12T12:03:48.280 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T12:03:50.422 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-12T12:03:50.423 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-12T12:03:50.424 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-12T12:03:50.520 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T12:03:50.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T12:03:50.710 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-12T12:03:50.711 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-12T12:03:50.714 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi038.front.sepia.ceph.com to complete... 2024-09-12T12:03:57.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12 12:03:57 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-12T12:03:57.046 INFO:teuthology.orchestra.run.smithi038.stderr:FINISHED --2024-09-12 12:03:57-- 2024-09-12T12:03:57.046 INFO:teuthology.orchestra.run.smithi038.stderr:Total wall clock time: 6.3s 2024-09-12T12:03:57.046 INFO:teuthology.orchestra.run.smithi038.stderr:Downloaded: 1 files, 343M in 6.0s (57.2 MB/s) 2024-09-12T12:03:57.050 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T12:03:57.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-12T12:03:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying... ######################################## 2024-09-12T12:03:59.399 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing... ######################################## 2024-09-12T12:03:59.519 INFO:teuthology.orchestra.run.smithi038.stdout:Updating / installing... 2024-09-12T12:04:07.919 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-12T12:04:48.572 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-12T12:04:48.573 DEBUG:teuthology.orchestra.run.smithi038:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-12T12:04:48.652 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.652 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.652 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.652 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.652 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-12T12:04:48.652 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-12T12:04:48.652 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-12T12:04:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T12:04:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-12T12:04:48.655 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T12:04:48.656 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-12T12:04:48.657 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T12:04:48.658 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-12T12:04:48.659 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T12:04:48.660 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T12:04:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T12:04:48.662 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T12:04:48.663 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T12:04:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T12:04:48.665 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-12T12:04:48.666 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T12:04:48.667 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T12:04:48.668 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-12T12:04:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-12T12:04:48.670 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T12:04:48.671 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T12:04:48.672 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T12:04:48.673 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T12:04:48.674 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T12:04:48.675 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T12:04:48.676 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T12:04:48.677 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T12:04:48.678 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T12:04:48.679 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T12:04:48.680 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T12:04:48.681 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T12:04:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T12:04:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T12:04:48.684 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T12:04:48.685 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T12:04:48.686 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-12T12:04:48.687 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T12:04:48.688 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T12:04:48.689 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T12:04:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T12:04:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-12T12:04:48.692 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T12:04:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T12:04:48.694 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T12:04:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T12:04:48.696 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T12:04:48.697 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T12:04:48.698 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-12T12:04:48.699 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T12:04:48.700 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-12T12:04:48.701 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T12:04:48.702 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T12:04:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T12:04:48.704 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-12T12:04:48.705 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-12T12:04:48.706 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T12:04:48.707 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T12:04:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T12:04:48.709 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T12:04:48.710 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T12:04:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-12T12:04:48.712 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T12:04:48.713 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-12T12:04:48.714 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-12T12:04:48.715 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T12:04:48.716 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T12:04:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T12:04:48.718 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T12:04:48.719 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T12:04:48.720 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-12T12:04:48.721 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T12:04:48.722 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T12:04:48.723 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T12:04:48.724 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-12T12:04:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T12:04:48.726 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T12:04:48.727 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-12T12:04:48.728 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-12T12:04:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T12:04:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-12T12:04:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T12:04:48.732 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T12:04:48.733 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T12:04:48.734 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T12:04:48.735 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T12:04:48.736 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T12:04:48.737 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T12:04:48.738 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-12T12:04:48.739 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T12:04:48.740 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T12:04:48.741 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T12:04:48.742 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-12T12:04:48.744 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T12:04:48.744 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T12:04:48.744 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T12:04:48.744 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T12:04:48.744 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T12:04:48.744 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T12:04:48.745 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T12:04:48.746 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T12:04:48.747 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T12:04:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T12:04:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T12:04:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T12:04:48.751 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-12T12:04:48.752 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T12:04:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T12:04:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T12:04:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-12T12:04:48.756 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T12:04:48.757 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-12T12:04:48.758 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-12T12:04:48.759 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T12:04:48.760 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T12:04:48.761 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T12:04:48.762 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T12:04:48.763 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T12:04:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T12:04:48.765 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T12:04:48.766 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T12:04:48.767 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T12:04:48.768 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T12:04:48.769 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T12:04:48.770 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T12:04:48.771 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T12:04:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T12:04:48.773 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T12:04:48.774 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T12:04:48.775 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T12:04:48.776 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T12:04:48.777 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T12:04:48.778 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T12:04:48.779 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T12:04:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-12T12:04:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-12T12:04:48.782 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T12:04:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T12:04:48.784 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T12:04:48.785 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T12:04:48.786 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T12:04:48.787 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T12:04:48.788 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T12:04:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T12:04:48.790 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T12:04:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T12:04:48.792 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T12:04:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-12T12:04:48.794 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T12:04:48.795 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T12:04:48.796 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T12:04:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T12:04:48.798 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-12T12:04:48.799 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T12:04:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-12T12:04:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T12:04:48.802 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T12:04:48.803 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T12:04:48.803 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-12T12:04:48.803 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T12:04:48.807 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.808 DEBUG:teuthology.orchestra.run.smithi038:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout:postinstall scriptlet (using /bin/sh): 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout:for file in vmlinuz System.map config; do 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout: fi 2024-09-12T12:04:48.833 INFO:teuthology.orchestra.run.smithi038.stdout:done 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T12:04:48.834 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.835 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-12T12:04:48.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 82.el9 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8274670 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2024-09-12T12:04:48.911 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T12:04:48.912 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T12:04:48.913 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2024-09-12T12:04:48.913 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:04:48.913 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T12:04:48.914 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T12:04:48.914 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:48.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T12:04:49.685 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-09-12T12:04:51.034 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T12:04:51.069 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-09-12T12:04:51.072 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-12T12:04:51.127 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.Vds9QdvCEd 2024-09-12T12:04:51.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Vds9QdvCEd 2024-09-12T12:04:51.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.Vds9QdvCEd 2024-09-12T12:04:51.344 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.Vds9QdvCEd is 6KB 2024-09-12T12:04:51.392 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.Vds9QdvCEd 2024-09-12T12:04:51.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T12:04:51.478 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T12:04:51.479 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T12:04:51.479 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T12:04:51.479 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-12T12:04:51.480 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:04:51.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-09-12T12:05:21.650 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T12:05:21.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-12T12:05:21.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:05:40.033 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-09-12T12:05:49.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-12T12:05:49.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:06:49.063 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T12:07:01.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-12T12:07:01.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:07:01.500 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-12T12:07:01.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-12T12:07:01.981 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T12:07:01.982 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-12T12:07:02.016 INFO:teuthology.orchestra.run.smithi038.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:07:02.016 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:07:02.016 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T12:07:02.016 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T12:07:03.017 DEBUG:teuthology.parallel:result is None 2024-09-12T12:07:03.017 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T12:07:03.024 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T12:07:03.024 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:07:03.028 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:07:03.031 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:07:03.062 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T12:07:03.413 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T12:07:03.736 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T12:07:03.736 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:07:03.741 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:07:03.743 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:07:03.879 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T12:07:03.918 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T12:07:03.918 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:07:03.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:07:03.936 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:07:03.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:07:03.953 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:07:03.958 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:07:03.978 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:07:04.015 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:07:04.034 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:07:04.048 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:07:04.050 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:07:04.066 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:07:04.080 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:07:04.083 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T12:07:04.163 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T12:07:04.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:07:04.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:07:04.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:07:04.222 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T12:07:04.386 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T12:07:04.386 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:07:04.390 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:07:04.393 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:07:04.422 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:07:04.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:07:04.605 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:07:04.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:07:04.738 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:07:04.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:07:04.794 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:07:04.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:07:04.894 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:07:04.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:07:05.020 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:07:05.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:07:05.086 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:07:05.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:07:05.184 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:07:05.273 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:07:05.313 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:07:05.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:07:05.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-09-12T12:07:05.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-12T12:07:05.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-12T12:07:05.419 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:07:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:07:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:07:05.951 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T12:07:05.959 INFO:teuthology.task.internal:Starting timer... 2024-09-12T12:07:05.960 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T12:07:06.298 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T12:07:06.619 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T12:07:06.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-09-12T12:07:06.713 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-09-12T12:07:06.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-12T12:07:06.780 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-12T12:07:06.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-12T12:07:06.850 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-12T12:07:06.852 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T12:07:06.852 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-09-12T12:07:06.903 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-09-12T12:07:06.904 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-12T12:07:06.925 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-12T12:07:06.925 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-12T12:07:06.951 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-12T12:07:06.952 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-09-12T12:07:06.952 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:07:07.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:07:07.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:07:07.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:07:07.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:07:07.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:07:07.062 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T12:07:07.062 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:07:07.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:07:07.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:07:07.198 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T12:07:07.208 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T12:07:07.212 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T12:07:07.333 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T12:07:07.344 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T12:07:07.345 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi071.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T12:11:50.673 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-12T12:11:50.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-12T12:11:50.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:11:50.823 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-12T12:11:50.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-12T12:11:50.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-12T12:11:50.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:11:51.051 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-12T12:11:51.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-12T12:11:51.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T12:11:51.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:11:51.244 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-12T12:11:51.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T12:11:51.328 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T12:11:51.642 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T12:11:51.642 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:11:51.643 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:11:51.647 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:11:51.647 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:11:51.650 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:11:51.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:11:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:11:51.684 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:11:51.697 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:11:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:11:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:11:51.725 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-12T12:11:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-12T12:11:51.735 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:11:51.738 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-12T12:11:51.739 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-12T12:11:51.754 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:11:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:11:51.769 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:11:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:11:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-09-12T12:11:51.810 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-09-12T12:11:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:11:51.831 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:11:51.831 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-12T12:11:51.831 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.831 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.831 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.831 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:11:51.836 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:11:51.836 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-12T12:11:51.836 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.836 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.836 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.836 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:11:51.868 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:11:51.974 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:11:51.980 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:11:51.980 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-12T12:11:51.980 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.980 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.981 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.981 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:11:51.982 INFO:teuthology.run_tasks:Running task install... 2024-09-12T12:11:52.155 DEBUG:teuthology.task.install:project ceph 2024-09-12T12:11:52.156 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T12:11:52.156 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T12:11:52.156 INFO:teuthology.task.install:Using flavor: default 2024-09-12T12:11:52.162 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T12:11:52.162 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T12:11:52.163 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:11:52.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:11:52.165 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:11:52.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:11:52.166 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:11:52.167 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:11:52.324 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:11:52.324 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:11:52.335 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:11:52.336 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:11:52.347 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:11:52.347 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:11:52.444 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:11:52.445 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:11:52.445 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:11:52.454 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:11:52.454 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:11:52.454 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:11:52.463 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:11:52.463 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:11:52.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:11:52.483 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:11:52.483 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:11:52.491 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:11:52.491 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:11:52.503 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:11:52.503 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:11:52.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:11:52.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:11:52.601 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:11:52.626 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:11:52.636 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:11:52.680 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:11:52.692 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-12T12:11:52.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-12T12:11:52.700 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-12T12:11:52.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-12T12:11:52.738 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-09-12T12:11:52.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-09-12T12:11:52.917 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-12T12:11:52.926 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-12T12:11:52.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:11:52.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:11:53.017 INFO:teuthology.orchestra.run.smithi038.stdout:45 files removed 2024-09-12T12:11:53.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:11:53.496 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-12T12:11:53.505 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-12T12:11:53.768 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 270 kB/s | 84 kB 00:00 2024-09-12T12:11:53.780 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T12:11:53.789 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T12:11:54.043 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-12T12:11:54.055 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T12:11:54.056 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T12:11:54.319 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T12:11:54.564 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T12:11:54.844 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T12:11:56.773 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-12T12:11:56.979 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-12T12:11:57.632 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-12T12:11:59.040 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-12T12:12:01.729 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T12:12:03.288 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-12T12:12:04.101 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T12:12:04.223 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-12T12:12:05.740 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-12T12:12:06.527 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T12:12:06.766 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.5 MB 00:03 2024-09-12T12:12:08.699 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 19 kB 00:00 2024-09-12T12:12:09.470 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T12:12:10.807 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T12:12:11.958 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T12:12:13.347 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:12:13.347 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:12:13.362 INFO:teuthology.orchestra.run.smithi038.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:12:13.363 INFO:teuthology.orchestra.run.smithi038.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:12:13.364 INFO:teuthology.orchestra.run.smithi038.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:12:13.365 INFO:teuthology.orchestra.run.smithi038.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:12:13.367 INFO:teuthology.orchestra.run.smithi038.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:12:13.370 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:12:13.371 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:12:13.442 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-12T12:12:13.456 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-09-12T12:12:13.456 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-12T12:12:13.456 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:12:13.457 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:12:13.458 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:12:13.459 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:12:13.460 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:12:13.460 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:12:13.460 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-09-12T12:12:13.460 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:12:13.460 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:12:13.460 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:12:13.460 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:12:13.461 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:12:13.462 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:12:13.463 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:12:13.464 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:12:13.465 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:12:13.466 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:12:13.467 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:12:13.468 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:12:13.469 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:12:13.470 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:12:13.471 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:12:13.472 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-12T12:12:13.472 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-09-12T12:12:13.472 INFO:teuthology.orchestra.run.smithi038.stdout:Install 148 Packages 2024-09-12T12:12:13.472 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 8 Packages 2024-09-12T12:12:13.472 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:12:13.473 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 226 M 2024-09-12T12:12:13.473 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-12T12:12:14.184 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:12:14.185 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:12:14.196 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:12:14.197 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:12:14.198 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:12:14.198 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:12:14.200 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:12:14.202 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:12:14.203 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:12:14.241 INFO:teuthology.orchestra.run.smithi038.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-12T12:12:14.265 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:12:14.283 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:12:14.284 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:12:14.285 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:12:14.286 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:12:14.287 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:12:14.288 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:12:14.289 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:12:14.290 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:12:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:12:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:12:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:12:14.294 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-12T12:12:14.295 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-12T12:12:14.296 INFO:teuthology.orchestra.run.smithi071.stdout:Install 148 Packages 2024-09-12T12:12:14.296 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 8 Packages 2024-09-12T12:12:14.296 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:12:14.296 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 226 M 2024-09-12T12:12:14.296 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-12T12:12:14.408 INFO:teuthology.orchestra.run.smithi038.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 5.3 MB/s | 897 kB 00:00 2024-09-12T12:12:14.500 INFO:teuthology.orchestra.run.smithi038.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.6 MB/s | 145 kB 00:00 2024-09-12T12:12:14.617 INFO:teuthology.orchestra.run.smithi038.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T12:12:14.718 INFO:teuthology.orchestra.run.smithi038.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-12T12:12:14.768 INFO:teuthology.orchestra.run.smithi038.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-12T12:12:14.818 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-12T12:12:15.110 INFO:teuthology.orchestra.run.smithi038.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-12T12:12:15.193 INFO:teuthology.orchestra.run.smithi071.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 32 kB/s | 6.5 kB 00:00 2024-09-12T12:12:15.368 INFO:teuthology.orchestra.run.smithi071.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 5.0 MB/s | 897 kB 00:00 2024-09-12T12:12:15.377 INFO:teuthology.orchestra.run.smithi038.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T12:12:15.418 INFO:teuthology.orchestra.run.smithi071.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-12T12:12:15.436 INFO:teuthology.orchestra.run.smithi038.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 433 kB/s | 25 kB 00:00 2024-09-12T12:12:15.610 INFO:teuthology.orchestra.run.smithi071.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 2.4 MB 00:00 2024-09-12T12:12:15.769 INFO:teuthology.orchestra.run.smithi071.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-12T12:12:15.919 INFO:teuthology.orchestra.run.smithi038.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 15 MB/s | 17 MB 00:01 2024-09-12T12:12:15.962 INFO:teuthology.orchestra.run.smithi071.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 25 MB/s | 4.7 MB 00:00 2024-09-12T12:12:16.061 INFO:teuthology.orchestra.run.smithi038.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 11 MB/s | 11 MB 00:00 2024-09-12T12:12:16.086 INFO:teuthology.orchestra.run.smithi038.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.3 MB/s | 228 kB 00:00 2024-09-12T12:12:16.128 INFO:teuthology.orchestra.run.smithi038.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 406 kB/s | 27 kB 00:00 2024-09-12T12:12:16.153 INFO:teuthology.orchestra.run.smithi038.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 476 kB/s | 32 kB 00:00 2024-09-12T12:12:16.202 INFO:teuthology.orchestra.run.smithi071.stdout:(7/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.5 MB/s | 5.4 MB 00:01 2024-09-12T12:12:16.228 INFO:teuthology.orchestra.run.smithi038.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T12:12:16.270 INFO:teuthology.orchestra.run.smithi038.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 5.2 MB/s | 752 kB 00:00 2024-09-12T12:12:16.312 INFO:teuthology.orchestra.run.smithi038.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-12T12:12:16.379 INFO:teuthology.orchestra.run.smithi038.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.6 MB/s | 506 kB 00:00 2024-09-12T12:12:16.472 INFO:teuthology.orchestra.run.smithi038.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 492 kB/s | 45 kB 00:00 2024-09-12T12:12:16.547 INFO:teuthology.orchestra.run.smithi038.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T12:12:16.622 INFO:teuthology.orchestra.run.smithi038.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 162 kB 00:00 2024-09-12T12:12:16.689 INFO:teuthology.orchestra.run.smithi038.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-12T12:12:16.703 INFO:teuthology.orchestra.run.smithi071.stdout:(8/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 23 MB/s | 17 MB 00:00 2024-09-12T12:12:16.747 INFO:teuthology.orchestra.run.smithi038.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.1 MB/s | 301 kB 00:00 2024-09-12T12:12:16.761 INFO:teuthology.orchestra.run.smithi071.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 434 kB/s | 25 kB 00:00 2024-09-12T12:12:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-12T12:12:16.856 INFO:teuthology.orchestra.run.smithi038.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 916 kB/s | 100 kB 00:00 2024-09-12T12:12:16.914 INFO:teuthology.orchestra.run.smithi038.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-12T12:12:17.015 INFO:teuthology.orchestra.run.smithi038.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-12T12:12:17.061 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:12:17.061 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:12:17.073 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:12:17.073 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:12:17.074 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:12:17.075 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:12:17.077 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:12:17.082 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:12:17.082 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:12:17.119 INFO:teuthology.orchestra.run.smithi038.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 319 kB/s | 32 kB 00:00 2024-09-12T12:12:17.141 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-12T12:12:17.161 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:12:17.162 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:12:17.163 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:12:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:12:17.165 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:12:17.165 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:12:17.165 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:12:17.168 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:12:17.168 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:12:17.168 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:12:17.169 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:12:17.170 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:12:17.171 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:12:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:12:17.173 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:12:17.174 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:12:17.175 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:12:17.176 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:12:17.176 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:12:17.176 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:12:17.176 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:12:17.176 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:12:17.176 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:12:17.176 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:12:17.177 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:12:17.177 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:12:17.177 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:12:17.177 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:12:17.177 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:12:17.177 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:12:17.177 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:12:17.178 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:12:17.179 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:12:17.180 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-12T12:12:17.181 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:12:17.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:12:17.181 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-12T12:12:17.181 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-12T12:12:17.181 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-09-12T12:12:17.181 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 8 Packages 2024-09-12T12:12:17.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:12:17.182 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 226 M 2024-09-12T12:12:17.182 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-12T12:12:17.207 INFO:teuthology.orchestra.run.smithi038.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 3.1 MB 00:00 2024-09-12T12:12:17.232 INFO:teuthology.orchestra.run.smithi038.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.2 MB/s | 146 kB 00:00 2024-09-12T12:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 8.2 MB/s | 11 MB 00:01 2024-09-12T12:12:17.566 INFO:teuthology.orchestra.run.smithi038.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.9 MB/s | 3.6 MB 00:00 2024-09-12T12:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-12T12:12:17.641 INFO:teuthology.orchestra.run.smithi038.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-12T12:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 295 kB/s | 27 kB 00:00 2024-09-12T12:12:17.717 INFO:teuthology.orchestra.run.smithi038.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 657 kB/s | 49 kB 00:00 2024-09-12T12:12:17.745 INFO:teuthology.orchestra.run.smithi071.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 381 kB/s | 32 kB 00:00 2024-09-12T12:12:17.809 INFO:teuthology.orchestra.run.smithi038.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 179 kB/s | 16 kB 00:00 2024-09-12T12:12:17.909 INFO:teuthology.orchestra.run.smithi038.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.8 MB/s | 285 kB 00:00 2024-09-12T12:12:17.920 INFO:teuthology.orchestra.run.smithi071.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.2 MB/s | 752 kB 00:00 2024-09-12T12:12:18.017 INFO:teuthology.orchestra.run.smithi038.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-12T12:12:18.029 INFO:teuthology.orchestra.run.smithi071.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.5 MB/s | 163 kB 00:00 2024-09-12T12:12:18.084 INFO:teuthology.orchestra.run.smithi038.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 274 kB/s | 18 kB 00:00 2024-09-12T12:12:18.129 INFO:teuthology.orchestra.run.smithi071.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.2 MB/s | 127 kB 00:00 2024-09-12T12:12:18.193 INFO:teuthology.orchestra.run.smithi038.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 738 kB/s | 80 kB 00:00 2024-09-12T12:12:18.230 INFO:teuthology.orchestra.run.smithi071.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.9 MB/s | 506 kB 00:00 2024-09-12T12:12:18.527 INFO:teuthology.orchestra.run.smithi038.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 5.7 MB/s | 7.4 MB 00:01 2024-09-12T12:12:18.560 INFO:teuthology.orchestra.run.smithi038.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-12T12:12:18.669 INFO:teuthology.orchestra.run.smithi038.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-12T12:12:18.753 INFO:teuthology.orchestra.run.smithi038.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 849 kB/s | 191 kB 00:00 2024-09-12T12:12:18.765 INFO:teuthology.orchestra.run.smithi154.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 11 kB/s | 6.5 kB 00:00 2024-09-12T12:12:18.811 INFO:teuthology.orchestra.run.smithi038.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T12:12:19.210 INFO:teuthology.orchestra.run.smithi154.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.0 MB/s | 897 kB 00:00 2024-09-12T12:12:19.228 INFO:teuthology.orchestra.run.smithi038.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-09-12T12:12:19.253 INFO:teuthology.orchestra.run.smithi038.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 306 kB/s | 135 kB 00:00 2024-09-12T12:12:19.255 INFO:teuthology.orchestra.run.smithi071.stdout:(18/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 20 MB/s | 49 MB 00:02 2024-09-12T12:12:19.286 INFO:teuthology.orchestra.run.smithi154.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T12:12:19.322 INFO:teuthology.orchestra.run.smithi071.stdout:(19/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 4.9 MB/s | 5.3 MB 00:01 2024-09-12T12:12:19.347 INFO:teuthology.orchestra.run.smithi071.stdout:(20/156): python3-ceph-argparse-19.1.1-298.gb53 492 kB/s | 45 kB 00:00 2024-09-12T12:12:19.369 INFO:teuthology.orchestra.run.smithi154.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.5 MB/s | 5.4 MB 00:01 2024-09-12T12:12:19.486 INFO:teuthology.orchestra.run.smithi154.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-12T12:12:19.556 INFO:teuthology.orchestra.run.smithi071.stdout:(21/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 4.6 MB/s | 21 MB 00:04 2024-09-12T12:12:19.572 INFO:teuthology.orchestra.run.smithi071.stdout:(22/156): python3-ceph-common-19.1.1-298.gb53b6 542 kB/s | 136 kB 00:00 2024-09-12T12:12:19.598 INFO:teuthology.orchestra.run.smithi071.stdout:(23/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 647 kB/s | 162 kB 00:00 2024-09-12T12:12:19.689 INFO:teuthology.orchestra.run.smithi071.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.1 MB/s | 100 kB 00:00 2024-09-12T12:12:19.715 INFO:teuthology.orchestra.run.smithi071.stdout:(25/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.0 MB/s | 321 kB 00:00 2024-09-12T12:12:19.740 INFO:teuthology.orchestra.run.smithi071.stdout:(26/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 1.8 MB/s | 301 kB 00:00 2024-09-12T12:12:19.782 INFO:teuthology.orchestra.run.smithi071.stdout:(27/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 925 kB/s | 85 kB 00:00 2024-09-12T12:12:19.824 INFO:teuthology.orchestra.run.smithi071.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T12:12:19.837 INFO:teuthology.orchestra.run.smithi038.stdout:(46/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 11 MB/s | 49 MB 00:04 2024-09-12T12:12:19.861 INFO:teuthology.orchestra.run.smithi154.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-12T12:12:19.862 INFO:teuthology.orchestra.run.smithi038.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 197 kB/s | 125 kB 00:00 2024-09-12T12:12:19.882 INFO:teuthology.orchestra.run.smithi071.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 317 kB/s | 32 kB 00:00 2024-09-12T12:12:19.887 INFO:teuthology.orchestra.run.smithi038.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 339 kB/s | 215 kB 00:00 2024-09-12T12:12:19.907 INFO:teuthology.orchestra.run.smithi071.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-12T12:12:19.945 INFO:teuthology.orchestra.run.smithi154.stdout:(7/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.6 MB/s | 2.4 MB 00:00 2024-09-12T12:12:20.030 INFO:teuthology.orchestra.run.smithi038.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 754 kB/s | 107 kB 00:00 2024-09-12T12:12:20.080 INFO:teuthology.orchestra.run.smithi038.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-12T12:12:20.121 INFO:teuthology.orchestra.run.smithi038.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 237 kB/s | 22 kB 00:00 2024-09-12T12:12:20.163 INFO:teuthology.orchestra.run.smithi038.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-12T12:12:20.189 INFO:teuthology.orchestra.run.smithi038.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-12T12:12:20.231 INFO:teuthology.orchestra.run.smithi038.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-12T12:12:20.289 INFO:teuthology.orchestra.run.smithi038.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 192 kB/s | 11 kB 00:00 2024-09-12T12:12:20.291 INFO:teuthology.orchestra.run.smithi071.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.4 MB/s | 3.1 MB 00:00 2024-09-12T12:12:20.304 INFO:teuthology.orchestra.run.smithi154.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 9.9 MB/s | 21 MB 00:02 2024-09-12T12:12:20.332 INFO:teuthology.orchestra.run.smithi038.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-12T12:12:20.367 INFO:teuthology.orchestra.run.smithi071.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-12T12:12:20.373 INFO:teuthology.orchestra.run.smithi038.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-12T12:12:20.379 INFO:teuthology.orchestra.run.smithi154.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 336 kB/s | 25 kB 00:00 2024-09-12T12:12:20.415 INFO:teuthology.orchestra.run.smithi038.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-09-12T12:12:20.450 INFO:teuthology.orchestra.run.smithi071.stdout:(33/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.3 MB/s | 3.6 MB 00:00 2024-09-12T12:12:20.476 INFO:teuthology.orchestra.run.smithi071.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 455 kB/s | 49 kB 00:00 2024-09-12T12:12:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-12T12:12:20.542 INFO:teuthology.orchestra.run.smithi071.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 179 kB/s | 16 kB 00:00 2024-09-12T12:12:20.576 INFO:teuthology.orchestra.run.smithi071.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.8 MB/s | 285 kB 00:00 2024-09-12T12:12:20.584 INFO:teuthology.orchestra.run.smithi038.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 421 kB/s | 24 kB 00:00 2024-09-12T12:12:20.616 INFO:teuthology.orchestra.run.smithi038.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-09-12T12:12:20.666 INFO:teuthology.orchestra.run.smithi038.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 569 kB/s | 47 kB 00:00 2024-09-12T12:12:20.668 INFO:teuthology.orchestra.run.smithi071.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 199 kB/s | 18 kB 00:00 2024-09-12T12:12:20.708 INFO:teuthology.orchestra.run.smithi038.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-12T12:12:20.734 INFO:teuthology.orchestra.run.smithi038.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T12:12:20.777 INFO:teuthology.orchestra.run.smithi071.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 737 kB/s | 80 kB 00:00 2024-09-12T12:12:20.784 INFO:teuthology.orchestra.run.smithi038.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-12T12:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 7.2 MB/s | 801 kB 00:00 2024-09-12T12:12:20.901 INFO:teuthology.orchestra.run.smithi038.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.1 MB/s | 3.0 MB 00:00 2024-09-12T12:12:20.927 INFO:teuthology.orchestra.run.smithi071.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T12:12:20.969 INFO:teuthology.orchestra.run.smithi071.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-12T12:12:20.997 INFO:teuthology.orchestra.run.smithi071.stdout:(42/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 1.7 MB/s | 765 kB 00:00 2024-09-12T12:12:21.095 INFO:teuthology.orchestra.run.smithi071.stdout:(43/156): ceph-mgr-diskprediction-local-19.1.1- 6.2 MB/s | 7.4 MB 00:01 2024-09-12T12:12:21.128 INFO:teuthology.orchestra.run.smithi071.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-12T12:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 3.7 MB/s | 125 kB 00:00 2024-09-12T12:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout:(46/156): python3-ply-3.11-14.el9.noarch.rpm 531 kB/s | 106 kB 00:00 2024-09-12T12:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T12:12:21.246 INFO:teuthology.orchestra.run.smithi071.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 897 kB/s | 135 kB 00:00 2024-09-12T12:12:21.271 INFO:teuthology.orchestra.run.smithi154.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 17 MB 00:01 2024-09-12T12:12:21.279 INFO:teuthology.orchestra.run.smithi071.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-09-12T12:12:21.305 INFO:teuthology.orchestra.run.smithi071.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T12:12:21.338 INFO:teuthology.orchestra.run.smithi071.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 374 kB/s | 22 kB 00:00 2024-09-12T12:12:21.343 INFO:teuthology.orchestra.run.smithi038.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.6 MB/s | 1.6 MB 00:00 2024-09-12T12:12:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:(52/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-12T12:12:21.396 INFO:teuthology.orchestra.run.smithi071.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-12T12:12:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-12T12:12:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T12:12:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T12:12:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T12:12:21.523 INFO:teuthology.orchestra.run.smithi071.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-12T12:12:21.556 INFO:teuthology.orchestra.run.smithi071.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi071.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-12T12:12:21.601 INFO:teuthology.orchestra.run.smithi038.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-12T12:12:21.615 INFO:teuthology.orchestra.run.smithi071.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-12T12:12:21.640 INFO:teuthology.orchestra.run.smithi071.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T12:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T12:12:21.677 INFO:teuthology.orchestra.run.smithi038.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-12T12:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T12:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-12T12:12:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-09-12T12:12:21.833 INFO:teuthology.orchestra.run.smithi071.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-12T12:12:21.900 INFO:teuthology.orchestra.run.smithi071.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-12T12:12:21.976 INFO:teuthology.orchestra.run.smithi071.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-12T12:12:22.009 INFO:teuthology.orchestra.run.smithi071.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-12T12:12:22.010 INFO:teuthology.orchestra.run.smithi038.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-09-12T12:12:22.035 INFO:teuthology.orchestra.run.smithi071.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-09-12T12:12:22.055 INFO:teuthology.orchestra.run.smithi154.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 291 kB/s | 228 kB 00:00 2024-09-12T12:12:22.068 INFO:teuthology.orchestra.run.smithi071.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-12T12:12:22.093 INFO:teuthology.orchestra.run.smithi071.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T12:12:22.127 INFO:teuthology.orchestra.run.smithi071.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-12T12:12:22.146 INFO:teuthology.orchestra.run.smithi154.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 295 kB/s | 27 kB 00:00 2024-09-12T12:12:22.177 INFO:teuthology.orchestra.run.smithi038.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.4 MB/s | 4.9 MB 00:01 2024-09-12T12:12:22.202 INFO:teuthology.orchestra.run.smithi071.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-12T12:12:22.227 INFO:teuthology.orchestra.run.smithi071.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T12:12:22.236 INFO:teuthology.orchestra.run.smithi038.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T12:12:22.238 INFO:teuthology.orchestra.run.smithi154.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 346 kB/s | 32 kB 00:00 2024-09-12T12:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-12T12:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-12T12:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T12:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T12:12:22.362 INFO:teuthology.orchestra.run.smithi071.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-12T12:12:22.394 INFO:teuthology.orchestra.run.smithi038.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-09-12T12:12:22.446 INFO:teuthology.orchestra.run.smithi071.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-12T12:12:22.453 INFO:teuthology.orchestra.run.smithi038.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T12:12:22.471 INFO:teuthology.orchestra.run.smithi071.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-12T12:12:22.496 INFO:teuthology.orchestra.run.smithi071.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-12T12:12:22.521 INFO:teuthology.orchestra.run.smithi071.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T12:12:22.545 INFO:teuthology.orchestra.run.smithi038.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T12:12:22.546 INFO:teuthology.orchestra.run.smithi071.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-12T12:12:22.573 INFO:teuthology.orchestra.run.smithi071.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-12T12:12:22.606 INFO:teuthology.orchestra.run.smithi154.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 2.0 MB/s | 752 kB 00:00 2024-09-12T12:12:22.606 INFO:teuthology.orchestra.run.smithi071.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-12T12:12:22.631 INFO:teuthology.orchestra.run.smithi071.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T12:12:22.637 INFO:teuthology.orchestra.run.smithi038.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-12T12:12:22.656 INFO:teuthology.orchestra.run.smithi071.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T12:12:22.681 INFO:teuthology.orchestra.run.smithi071.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T12:12:22.689 INFO:teuthology.orchestra.run.smithi154.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 163 kB 00:00 2024-09-12T12:12:22.704 INFO:teuthology.orchestra.run.smithi038.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-12T12:12:22.763 INFO:teuthology.orchestra.run.smithi038.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-12T12:12:22.765 INFO:teuthology.orchestra.run.smithi071.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T12:12:22.790 INFO:teuthology.orchestra.run.smithi071.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-12T12:12:22.815 INFO:teuthology.orchestra.run.smithi071.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-12T12:12:22.840 INFO:teuthology.orchestra.run.smithi071.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T12:12:22.847 INFO:teuthology.orchestra.run.smithi154.stdout:(16/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 3.7 MB/s | 11 MB 00:02 2024-09-12T12:12:22.855 INFO:teuthology.orchestra.run.smithi038.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-12T12:12:22.866 INFO:teuthology.orchestra.run.smithi071.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-12T12:12:22.872 INFO:teuthology.orchestra.run.smithi154.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 690 kB/s | 127 kB 00:00 2024-09-12T12:12:22.891 INFO:teuthology.orchestra.run.smithi071.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-12T12:12:22.914 INFO:teuthology.orchestra.run.smithi038.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 598 kB/s | 35 kB 00:00 2024-09-12T12:12:22.917 INFO:teuthology.orchestra.run.smithi071.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T12:12:22.931 INFO:teuthology.orchestra.run.smithi154.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-12T12:12:22.942 INFO:teuthology.orchestra.run.smithi071.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T12:12:22.967 INFO:teuthology.orchestra.run.smithi071.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T12:12:22.982 INFO:teuthology.orchestra.run.smithi154.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 906 kB/s | 45 kB 00:00 2024-09-12T12:12:22.992 INFO:teuthology.orchestra.run.smithi071.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T12:12:23.018 INFO:teuthology.orchestra.run.smithi071.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 888 kB/s | 45 kB 00:00 2024-09-12T12:12:23.040 INFO:teuthology.orchestra.run.smithi154.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-12T12:12:23.099 INFO:teuthology.orchestra.run.smithi154.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-12T12:12:23.199 INFO:teuthology.orchestra.run.smithi154.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.1 MB/s | 321 kB 00:00 2024-09-12T12:12:23.237 INFO:teuthology.orchestra.run.smithi071.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-12T12:12:23.260 INFO:teuthology.orchestra.run.smithi071.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-12T12:12:23.280 INFO:teuthology.orchestra.run.smithi038.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-09-12T12:12:23.310 INFO:teuthology.orchestra.run.smithi071.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T12:12:23.333 INFO:teuthology.orchestra.run.smithi154.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.2 MB/s | 301 kB 00:00 2024-09-12T12:12:23.344 INFO:teuthology.orchestra.run.smithi071.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 583 kB/s | 19 kB 00:00 2024-09-12T12:12:23.347 INFO:teuthology.orchestra.run.smithi038.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-12T12:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-12T12:12:23.389 INFO:teuthology.orchestra.run.smithi038.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-09-12T12:12:23.394 INFO:teuthology.orchestra.run.smithi071.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T12:12:23.417 INFO:teuthology.orchestra.run.smithi154.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 9.8 MB/s | 5.3 MB 00:00 2024-09-12T12:12:23.419 INFO:teuthology.orchestra.run.smithi071.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T12:12:23.431 INFO:teuthology.orchestra.run.smithi038.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-12T12:12:23.442 INFO:teuthology.orchestra.run.smithi154.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 918 kB/s | 100 kB 00:00 2024-09-12T12:12:23.445 INFO:teuthology.orchestra.run.smithi071.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T12:12:23.470 INFO:teuthology.orchestra.run.smithi071.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T12:12:23.492 INFO:teuthology.orchestra.run.smithi154.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T12:12:23.498 INFO:teuthology.orchestra.run.smithi038.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 638 kB/s | 42 kB 00:00 2024-09-12T12:12:23.504 INFO:teuthology.orchestra.run.smithi071.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-12T12:12:23.540 INFO:teuthology.orchestra.run.smithi038.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-12T12:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T12:12:23.563 INFO:teuthology.orchestra.run.smithi071.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.9 MB/s | 43 kB 00:00 2024-09-12T12:12:23.579 INFO:teuthology.orchestra.run.smithi071.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T12:12:23.582 INFO:teuthology.orchestra.run.smithi038.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-12T12:12:23.597 INFO:teuthology.orchestra.run.smithi071.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 855 kB/s | 14 kB 00:00 2024-09-12T12:12:23.624 INFO:teuthology.orchestra.run.smithi038.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 6.6 MB/s | 279 kB 00:00 2024-09-12T12:12:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-12T12:12:23.671 INFO:teuthology.orchestra.run.smithi071.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-12T12:12:23.682 INFO:teuthology.orchestra.run.smithi038.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-09-12T12:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T12:12:23.731 INFO:teuthology.orchestra.run.smithi071.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-12T12:12:23.741 INFO:teuthology.orchestra.run.smithi038.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 923 kB/s | 54 kB 00:00 2024-09-12T12:12:23.756 INFO:teuthology.orchestra.run.smithi071.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T12:12:23.789 INFO:teuthology.orchestra.run.smithi071.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T12:12:23.833 INFO:teuthology.orchestra.run.smithi038.stdout:(91/156): postgresql-server-13.16-1.el9.x86_64. 2.7 MB/s | 5.8 MB 00:02 2024-09-12T12:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-12T12:12:23.882 INFO:teuthology.orchestra.run.smithi071.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-12T12:12:23.892 INFO:teuthology.orchestra.run.smithi038.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 717 kB/s | 42 kB 00:00 2024-09-12T12:12:23.907 INFO:teuthology.orchestra.run.smithi071.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T12:12:23.932 INFO:teuthology.orchestra.run.smithi071.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-12T12:12:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-12T12:12:23.957 INFO:teuthology.orchestra.run.smithi071.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T12:12:23.976 INFO:teuthology.orchestra.run.smithi154.stdout:(27/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T12:12:23.984 INFO:teuthology.orchestra.run.smithi071.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T12:12:24.001 INFO:teuthology.orchestra.run.smithi154.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 336 kB/s | 171 kB 00:00 2024-09-12T12:12:24.016 INFO:teuthology.orchestra.run.smithi071.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T12:12:24.026 INFO:teuthology.orchestra.run.smithi154.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 637 kB/s | 32 kB 00:00 2024-09-12T12:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T12:12:24.052 INFO:teuthology.orchestra.run.smithi154.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T12:12:24.067 INFO:teuthology.orchestra.run.smithi071.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T12:12:24.100 INFO:teuthology.orchestra.run.smithi071.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-12T12:12:24.127 INFO:teuthology.orchestra.run.smithi154.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 4.5 MB/s | 3.1 MB 00:00 2024-09-12T12:12:24.143 INFO:teuthology.orchestra.run.smithi071.stdout:(133/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-09-12T12:12:24.168 INFO:teuthology.orchestra.run.smithi071.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-09-12T12:12:24.186 INFO:teuthology.orchestra.run.smithi154.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-12T12:12:24.193 INFO:teuthology.orchestra.run.smithi071.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T12:12:24.218 INFO:teuthology.orchestra.run.smithi038.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-12T12:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-12T12:12:24.243 INFO:teuthology.orchestra.run.smithi038.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 757 kB/s | 221 kB 00:00 2024-09-12T12:12:24.243 INFO:teuthology.orchestra.run.smithi071.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-09-12T12:12:24.244 INFO:teuthology.orchestra.run.smithi154.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 850 kB/s | 49 kB 00:00 2024-09-12T12:12:24.269 INFO:teuthology.orchestra.run.smithi071.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-12T12:12:24.294 INFO:teuthology.orchestra.run.smithi071.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T12:12:24.303 INFO:teuthology.orchestra.run.smithi154.stdout:(34/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 13 MB/s | 3.6 MB 00:00 2024-09-12T12:12:24.310 INFO:teuthology.orchestra.run.smithi038.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-09-12T12:12:24.319 INFO:teuthology.orchestra.run.smithi071.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T12:12:24.328 INFO:teuthology.orchestra.run.smithi154.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 197 kB/s | 16 kB 00:00 2024-09-12T12:12:24.352 INFO:teuthology.orchestra.run.smithi038.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-12T12:12:24.353 INFO:teuthology.orchestra.run.smithi071.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-12T12:12:24.377 INFO:teuthology.orchestra.run.smithi038.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-12T12:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T12:12:24.378 INFO:teuthology.orchestra.run.smithi154.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-12T12:12:24.405 INFO:teuthology.orchestra.run.smithi071.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T12:12:24.419 INFO:teuthology.orchestra.run.smithi038.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-12T12:12:24.429 INFO:teuthology.orchestra.run.smithi071.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-12T12:12:24.444 INFO:teuthology.orchestra.run.smithi038.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T12:12:24.454 INFO:teuthology.orchestra.run.smithi154.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 244 kB/s | 18 kB 00:00 2024-09-12T12:12:24.454 INFO:teuthology.orchestra.run.smithi071.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-12T12:12:24.479 INFO:teuthology.orchestra.run.smithi071.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T12:12:24.503 INFO:teuthology.orchestra.run.smithi038.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-09-12T12:12:24.504 INFO:teuthology.orchestra.run.smithi154.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-12T12:12:24.504 INFO:teuthology.orchestra.run.smithi071.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T12:12:24.545 INFO:teuthology.orchestra.run.smithi038.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-09-12T12:12:24.555 INFO:teuthology.orchestra.run.smithi071.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T12:12:24.621 INFO:teuthology.orchestra.run.smithi154.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-12T12:12:24.670 INFO:teuthology.orchestra.run.smithi038.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-09-12T12:12:24.705 INFO:teuthology.orchestra.run.smithi154.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T12:12:24.705 INFO:teuthology.orchestra.run.smithi071.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-09-12T12:12:24.737 INFO:teuthology.orchestra.run.smithi038.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-12T12:12:24.771 INFO:teuthology.orchestra.run.smithi038.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-12T12:12:24.772 INFO:teuthology.orchestra.run.smithi071.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-12T12:12:24.813 INFO:teuthology.orchestra.run.smithi038.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-09-12T12:12:24.814 INFO:teuthology.orchestra.run.smithi071.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 985 kB/s | 41 kB 00:00 2024-09-12T12:12:24.814 INFO:teuthology.orchestra.run.smithi154.stdout:(41/156): ceph-mgr-diskprediction-local-19.1.1- 9.7 MB/s | 7.4 MB 00:00 2024-09-12T12:12:24.839 INFO:teuthology.orchestra.run.smithi154.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-12T12:12:24.854 INFO:teuthology.orchestra.run.smithi038.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-09-12T12:12:24.856 INFO:teuthology.orchestra.run.smithi071.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-12T12:12:24.914 INFO:teuthology.orchestra.run.smithi154.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T12:12:24.915 INFO:teuthology.orchestra.run.smithi071.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-12T12:12:24.921 INFO:teuthology.orchestra.run.smithi038.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-09-12T12:12:24.948 INFO:teuthology.orchestra.run.smithi154.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.8 MB/s | 801 kB 00:00 2024-09-12T12:12:24.981 INFO:teuthology.orchestra.run.smithi071.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 36 MB/s | 2.4 MB 00:00 2024-09-12T12:12:24.989 INFO:teuthology.orchestra.run.smithi038.stdout:(109/156): python3-numpy-1.20.1-5.el9.x86_64.rp 2.5 MB/s | 5.1 MB 00:02 2024-09-12T12:12:24.990 INFO:teuthology.orchestra.run.smithi154.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-12T12:12:25.015 INFO:teuthology.orchestra.run.smithi154.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-12T12:12:25.031 INFO:teuthology.orchestra.run.smithi038.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-09-12T12:12:25.073 INFO:teuthology.orchestra.run.smithi038.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.8 MB/s | 151 kB 00:00 2024-09-12T12:12:25.073 INFO:teuthology.orchestra.run.smithi154.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T12:12:25.098 INFO:teuthology.orchestra.run.smithi038.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-09-12T12:12:25.115 INFO:teuthology.orchestra.run.smithi071.stdout:(155/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.4 MB/s | 3.4 MB 00:00 2024-09-12T12:12:25.140 INFO:teuthology.orchestra.run.smithi038.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T12:12:25.173 INFO:teuthology.orchestra.run.smithi071.stdout:(156/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 4.7 MB/s | 3.2 MB 00:00 2024-09-12T12:12:25.179 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:12:25.179 INFO:teuthology.orchestra.run.smithi071.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-12T12:12:25.191 INFO:teuthology.orchestra.run.smithi038.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 871 kB/s | 43 kB 00:00 2024-09-12T12:12:25.257 INFO:teuthology.orchestra.run.smithi038.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2024-09-12T12:12:25.265 INFO:teuthology.orchestra.run.smithi154.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.7 MB/s | 1.2 MB 00:00 2024-09-12T12:12:25.308 INFO:teuthology.orchestra.run.smithi038.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 283 kB/s | 14 kB 00:00 2024-09-12T12:12:25.350 INFO:teuthology.orchestra.run.smithi038.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.0 MB/s | 839 kB 00:00 2024-09-12T12:12:25.375 INFO:teuthology.orchestra.run.smithi038.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-12T12:12:25.442 INFO:teuthology.orchestra.run.smithi038.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-12T12:12:25.476 INFO:teuthology.orchestra.run.smithi038.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-09-12T12:12:25.501 INFO:teuthology.orchestra.run.smithi038.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-09-12T12:12:25.526 INFO:teuthology.orchestra.run.smithi038.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-12T12:12:25.568 INFO:teuthology.orchestra.run.smithi038.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-09-12T12:12:25.594 INFO:teuthology.orchestra.run.smithi038.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-12T12:12:25.635 INFO:teuthology.orchestra.run.smithi038.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 263 kB/s | 18 kB 00:00 2024-09-12T12:12:25.678 INFO:teuthology.orchestra.run.smithi038.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-09-12T12:12:25.719 INFO:teuthology.orchestra.run.smithi038.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-09-12T12:12:25.725 INFO:teuthology.orchestra.run.smithi154.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-12T12:12:25.761 INFO:teuthology.orchestra.run.smithi038.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-09-12T12:12:25.804 INFO:teuthology.orchestra.run.smithi038.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-12T12:12:25.828 INFO:teuthology.orchestra.run.smithi038.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T12:12:25.849 INFO:teuthology.orchestra.run.smithi154.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 826 kB/s | 689 kB 00:00 2024-09-12T12:12:25.870 INFO:teuthology.orchestra.run.smithi038.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-09-12T12:12:25.874 INFO:teuthology.orchestra.run.smithi154.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 144 kB/s | 22 kB 00:00 2024-09-12T12:12:25.904 INFO:teuthology.orchestra.run.smithi038.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T12:12:25.946 INFO:teuthology.orchestra.run.smithi038.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 396 kB/s | 16 kB 00:00 2024-09-12T12:12:25.971 INFO:teuthology.orchestra.run.smithi038.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T12:12:25.992 INFO:teuthology.orchestra.run.smithi154.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-12T12:12:26.013 INFO:teuthology.orchestra.run.smithi038.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 684 kB/s | 28 kB 00:00 2024-09-12T12:12:26.017 INFO:teuthology.orchestra.run.smithi154.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-12T12:12:26.050 INFO:teuthology.orchestra.run.smithi154.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-09-12T12:12:26.055 INFO:teuthology.orchestra.run.smithi038.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 739 kB/s | 31 kB 00:00 2024-09-12T12:12:26.097 INFO:teuthology.orchestra.run.smithi038.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 2.7 MB/s | 1.0 MB 00:00 2024-09-12T12:12:26.134 INFO:teuthology.orchestra.run.smithi154.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-12T12:12:26.139 INFO:teuthology.orchestra.run.smithi038.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-12T12:12:26.159 INFO:teuthology.orchestra.run.smithi154.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-12T12:12:26.189 INFO:teuthology.orchestra.run.smithi038.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 718 kB/s | 36 kB 00:00 2024-09-12T12:12:26.273 INFO:teuthology.orchestra.run.smithi038.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 867 kB/s | 188 kB 00:00 2024-09-12T12:12:26.276 INFO:teuthology.orchestra.run.smithi154.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 388 kB/s | 45 kB 00:00 2024-09-12T12:12:26.298 INFO:teuthology.orchestra.run.smithi038.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 686 kB/s | 74 kB 00:00 2024-09-12T12:12:26.323 INFO:teuthology.orchestra.run.smithi038.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T12:12:26.335 INFO:teuthology.orchestra.run.smithi154.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 799 kB/s | 160 kB 00:00 2024-09-12T12:12:26.349 INFO:teuthology.orchestra.run.smithi038.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T12:12:26.374 INFO:teuthology.orchestra.run.smithi038.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 812 kB/s | 20 kB 00:00 2024-09-12T12:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-12T12:12:26.424 INFO:teuthology.orchestra.run.smithi038.stdout:(145/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.1 MB/s | 2.0 MB 00:00 2024-09-12T12:12:26.450 INFO:teuthology.orchestra.run.smithi038.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-12T12:12:26.475 INFO:teuthology.orchestra.run.smithi038.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-12T12:12:26.493 INFO:teuthology.orchestra.run.smithi154.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-12T12:12:26.534 INFO:teuthology.orchestra.run.smithi038.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T12:12:26.549 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-12T12:12:26.549 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-12T12:12:26.610 INFO:teuthology.orchestra.run.smithi154.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-12T12:12:26.636 INFO:teuthology.orchestra.run.smithi154.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 172 kB/s | 24 kB 00:00 2024-09-12T12:12:26.677 INFO:teuthology.orchestra.run.smithi154.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 1.7 MB/s | 581 kB 00:00 2024-09-12T12:12:26.719 INFO:teuthology.orchestra.run.smithi154.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-12T12:12:26.751 INFO:teuthology.orchestra.run.smithi038.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-12T12:12:26.753 INFO:teuthology.orchestra.run.smithi154.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T12:12:26.795 INFO:teuthology.orchestra.run.smithi154.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T12:12:26.828 INFO:teuthology.orchestra.run.smithi154.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-12T12:12:26.842 INFO:teuthology.orchestra.run.smithi038.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 8.7 MB/s | 3.4 MB 00:00 2024-09-12T12:12:26.960 INFO:teuthology.orchestra.run.smithi038.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 350 kB/s | 41 kB 00:00 2024-09-12T12:12:27.010 INFO:teuthology.orchestra.run.smithi038.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.9 MB/s | 2.3 MB 00:00 2024-09-12T12:12:27.054 INFO:teuthology.orchestra.run.smithi154.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-09-12T12:12:27.093 INFO:teuthology.orchestra.run.smithi038.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-12T12:12:27.180 INFO:teuthology.orchestra.run.smithi038.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 4.2 MB/s | 1.8 MB 00:00 2024-09-12T12:12:27.187 INFO:teuthology.orchestra.run.smithi154.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-12T12:12:27.304 INFO:teuthology.orchestra.run.smithi154.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-12T12:12:27.310 INFO:teuthology.orchestra.run.smithi038.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-12T12:12:27.796 INFO:teuthology.orchestra.run.smithi154.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.7 MB/s | 4.9 MB 00:01 2024-09-12T12:12:27.819 INFO:teuthology.orchestra.run.smithi038.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-12T12:12:27.826 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:12:27.826 INFO:teuthology.orchestra.run.smithi038.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-12T12:12:28.376 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-12T12:12:28.377 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-12T12:12:28.680 INFO:teuthology.orchestra.run.smithi154.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-09-12T12:12:28.889 INFO:teuthology.orchestra.run.smithi154.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 420 kB/s | 87 kB 00:00 2024-09-12T12:12:29.397 INFO:teuthology.orchestra.run.smithi154.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 646 kB/s | 1.0 MB 00:01 2024-09-12T12:12:29.506 INFO:teuthology.orchestra.run.smithi154.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-12T12:12:29.889 INFO:teuthology.orchestra.run.smithi154.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 639 kB/s | 245 kB 00:00 2024-09-12T12:12:29.924 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-12T12:12:30.121 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-12T12:12:30.122 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-12T12:12:30.256 INFO:teuthology.orchestra.run.smithi154.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 677 kB/s | 248 kB 00:00 2024-09-12T12:12:30.365 INFO:teuthology.orchestra.run.smithi154.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-12T12:12:30.473 INFO:teuthology.orchestra.run.smithi154.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-12T12:12:30.757 INFO:teuthology.orchestra.run.smithi154.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 608 kB/s | 172 kB 00:00 2024-09-12T12:12:30.857 INFO:teuthology.orchestra.run.smithi154.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-12T12:12:32.622 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-12T12:12:32.622 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-12T12:12:33.099 INFO:teuthology.orchestra.run.smithi154.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-09-12T12:12:33.474 INFO:teuthology.orchestra.run.smithi154.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-12T12:12:33.658 INFO:teuthology.orchestra.run.smithi154.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.8 MB/s | 5.1 MB 00:02 2024-09-12T12:12:33.775 INFO:teuthology.orchestra.run.smithi154.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-09-12T12:12:33.858 INFO:teuthology.orchestra.run.smithi154.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 579 kB/s | 222 kB 00:00 2024-09-12T12:12:33.883 INFO:teuthology.orchestra.run.smithi154.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-09-12T12:12:34.000 INFO:teuthology.orchestra.run.smithi154.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-12T12:12:34.126 INFO:teuthology.orchestra.run.smithi154.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-12T12:12:34.242 INFO:teuthology.orchestra.run.smithi154.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 437 kB/s | 51 kB 00:00 2024-09-12T12:12:34.326 INFO:teuthology.orchestra.run.smithi154.stdout:(90/156): python3-protobuf-3.14.0-13.el9.noarch 576 kB/s | 269 kB 00:00 2024-09-12T12:12:34.351 INFO:teuthology.orchestra.run.smithi154.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 494 kB/s | 54 kB 00:00 2024-09-12T12:12:34.460 INFO:teuthology.orchestra.run.smithi154.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-12T12:12:34.569 INFO:teuthology.orchestra.run.smithi154.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-12T12:12:34.661 INFO:teuthology.orchestra.run.smithi154.stdout:(94/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.0 MB/s | 6.0 MB 00:05 2024-09-12T12:12:34.686 INFO:teuthology.orchestra.run.smithi154.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-12T12:12:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-12T12:12:34.770 INFO:teuthology.orchestra.run.smithi154.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-12T12:12:34.803 INFO:teuthology.orchestra.run.smithi154.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-12T12:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:12:34.887 INFO:teuthology.orchestra.run.smithi154.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-12T12:12:34.920 INFO:teuthology.orchestra.run.smithi154.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-12T12:12:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:12:35.013 INFO:teuthology.orchestra.run.smithi154.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 763 kB/s | 96 kB 00:00 2024-09-12T12:12:35.038 INFO:teuthology.orchestra.run.smithi154.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 544 kB/s | 64 kB 00:00 2024-09-12T12:12:35.093 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:12:35.122 INFO:teuthology.orchestra.run.smithi154.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-12T12:12:35.127 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:12:35.146 INFO:teuthology.orchestra.run.smithi154.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-12T12:12:35.152 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:12:35.195 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:12:35.205 INFO:teuthology.orchestra.run.smithi154.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T12:12:35.230 INFO:teuthology.orchestra.run.smithi154.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-12T12:12:35.256 INFO:teuthology.orchestra.run.smithi154.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-12T12:12:35.373 INFO:teuthology.orchestra.run.smithi154.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T12:12:35.398 INFO:teuthology.orchestra.run.smithi154.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T12:12:35.423 INFO:teuthology.orchestra.run.smithi154.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T12:12:35.457 INFO:teuthology.orchestra.run.smithi154.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-12T12:12:35.490 INFO:teuthology.orchestra.run.smithi154.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-12T12:12:35.524 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:12:35.533 INFO:teuthology.orchestra.run.smithi154.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 21 MB/s | 839 kB 00:00 2024-09-12T12:12:35.566 INFO:teuthology.orchestra.run.smithi154.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-12T12:12:35.592 INFO:teuthology.orchestra.run.smithi154.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T12:12:35.616 INFO:teuthology.orchestra.run.smithi154.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T12:12:35.642 INFO:teuthology.orchestra.run.smithi154.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-12T12:12:35.644 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:12:35.675 INFO:teuthology.orchestra.run.smithi154.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-12T12:12:35.701 INFO:teuthology.orchestra.run.smithi154.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T12:12:35.734 INFO:teuthology.orchestra.run.smithi154.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T12:12:35.760 INFO:teuthology.orchestra.run.smithi154.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T12:12:35.766 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:12:35.793 INFO:teuthology.orchestra.run.smithi154.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T12:12:35.795 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:12:35.819 INFO:teuthology.orchestra.run.smithi154.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T12:12:35.836 INFO:teuthology.orchestra.run.smithi154.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 644 kB/s | 11 kB 00:00 2024-09-12T12:12:35.861 INFO:teuthology.orchestra.run.smithi154.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-12T12:12:35.869 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:12:35.886 INFO:teuthology.orchestra.run.smithi154.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-12T12:12:35.900 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:12:35.911 INFO:teuthology.orchestra.run.smithi154.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-12T12:12:35.945 INFO:teuthology.orchestra.run.smithi154.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 591 kB/s | 20 kB 00:00 2024-09-12T12:12:36.003 INFO:teuthology.orchestra.run.smithi154.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-12T12:12:36.029 INFO:teuthology.orchestra.run.smithi154.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T12:12:36.045 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:12:36.054 INFO:teuthology.orchestra.run.smithi154.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.0 MB/s | 79 kB 00:00 2024-09-12T12:12:36.080 INFO:teuthology.orchestra.run.smithi154.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T12:12:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:12:36.113 INFO:teuthology.orchestra.run.smithi154.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-12T12:12:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:12:36.139 INFO:teuthology.orchestra.run.smithi154.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T12:12:36.164 INFO:teuthology.orchestra.run.smithi154.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T12:12:36.189 INFO:teuthology.orchestra.run.smithi154.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T12:12:36.214 INFO:teuthology.orchestra.run.smithi154.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-12T12:12:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:12:36.240 INFO:teuthology.orchestra.run.smithi154.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-12T12:12:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:12:36.265 INFO:teuthology.orchestra.run.smithi154.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T12:12:36.290 INFO:teuthology.orchestra.run.smithi154.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T12:12:36.305 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:12:36.307 INFO:teuthology.orchestra.run.smithi154.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 851 kB/s | 36 kB 00:00 2024-09-12T12:12:36.327 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:12:36.332 INFO:teuthology.orchestra.run.smithi154.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-12T12:12:36.346 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:12:36.358 INFO:teuthology.orchestra.run.smithi154.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T12:12:36.383 INFO:teuthology.orchestra.run.smithi154.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T12:12:36.400 INFO:teuthology.orchestra.run.smithi154.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T12:12:36.425 INFO:teuthology.orchestra.run.smithi154.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-09-12T12:12:36.450 INFO:teuthology.orchestra.run.smithi154.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T12:12:36.501 INFO:teuthology.orchestra.run.smithi154.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T12:12:36.536 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:12:36.674 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:12:36.783 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:12:36.793 INFO:teuthology.orchestra.run.smithi154.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-12T12:12:36.886 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:36.910 INFO:teuthology.orchestra.run.smithi154.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 7.5 MB/s | 3.4 MB 00:00 2024-09-12T12:12:36.951 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:37.218 INFO:teuthology.orchestra.run.smithi154.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 5.5 MB/s | 2.3 MB 00:00 2024-09-12T12:12:37.277 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:12:37.285 INFO:teuthology.orchestra.run.smithi154.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 4.8 MB/s | 1.8 MB 00:00 2024-09-12T12:12:37.311 INFO:teuthology.orchestra.run.smithi154.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 444 kB/s | 41 kB 00:00 2024-09-12T12:12:37.344 INFO:teuthology.orchestra.run.smithi154.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-12T12:12:37.371 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:12:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:12:37.441 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:12:37.487 INFO:teuthology.orchestra.run.smithi154.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-12T12:12:37.515 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:12:37.567 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:12:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:12:37.642 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:12:37.644 INFO:teuthology.orchestra.run.smithi154.stdout:(155/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-12T12:12:37.675 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:12:37.694 INFO:teuthology.orchestra.run.smithi154.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.8 MB/s | 2.4 MB 00:00 2024-09-12T12:12:37.698 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:12:37.699 INFO:teuthology.orchestra.run.smithi154.stdout:Total 11 MB/s | 226 MB 00:20 2024-09-12T12:12:37.711 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:12:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:12:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:12:37.864 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:12:37.899 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:12:37.976 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:12:38.013 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:12:38.056 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:12:38.085 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:12:38.146 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:12:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:12:38.274 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:12:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:12:38.460 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:12:38.914 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-12T12:12:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:12:39.063 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:12:39.069 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-12T12:12:39.069 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-12T12:12:39.093 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:12:39.135 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:12:39.173 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:12:39.215 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:12:39.372 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:12:39.427 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:12:39.481 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:12:39.499 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-12T12:12:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:12:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:12:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:12:39.649 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:12:39.668 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:12:39.704 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:12:39.719 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:12:39.747 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:12:39.789 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:12:39.792 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:12:39.835 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:12:39.867 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:12:39.926 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:12:39.929 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:12:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:12:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:12:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:12:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:12:40.350 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:12:40.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:12:40.408 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:12:40.423 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:12:40.448 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:12:40.516 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:12:40.590 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:12:40.618 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:12:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:12:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:12:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:12:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:12:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:12:40.802 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:12:40.820 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:12:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:12:40.939 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-12T12:12:40.940 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-12T12:12:40.968 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:12:41.002 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:12:41.054 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:12:41.089 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:12:41.113 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:12:41.133 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:12:41.138 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:12:41.163 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:12:41.266 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:12:41.275 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:12:41.297 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:12:41.323 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:12:41.414 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:12:41.440 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:12:41.485 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:12:41.668 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:12:41.863 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:12:42.040 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:12:42.047 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:12:42.086 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:12:42.120 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:12:42.164 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:42.218 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:12:42.273 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:42.275 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:12:42.320 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:12:42.408 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:12:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:12:42.555 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:42.631 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:12:42.663 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:12:42.709 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:12:42.739 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:12:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:12:42.872 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:12:42.917 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:12:43.002 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:12:43.062 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:12:43.099 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:12:43.155 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:12:43.192 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:12:43.226 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:12:43.318 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:12:43.380 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:12:43.383 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:12:43.412 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:12:43.460 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:12:43.594 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:12:43.641 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:12:43.708 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:12:43.746 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:12:43.842 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:12:43.900 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:12:43.995 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:12:44.173 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:12:44.246 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:12:44.714 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:12:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:12:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:12:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:12:44.935 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:12:45.031 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:12:45.215 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:12:45.273 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:12:45.315 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:12:45.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:12:45.345 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:12:45.355 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:12:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:12:45.410 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:12:45.634 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:12:45.699 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:12:45.769 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:12:45.857 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:12:45.858 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:12:45.893 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:12:45.900 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:12:45.936 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:12:45.964 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:12:45.995 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:12:46.000 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:12:46.039 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:12:46.085 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:12:46.135 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:12:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:12:46.367 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:12:46.411 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:12:46.545 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:12:46.593 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:12:46.636 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:12:46.665 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:12:46.689 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:12:46.808 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:12:46.976 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:12:47.031 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:12:47.068 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:12:47.108 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:12:47.151 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:12:47.190 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:12:47.227 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:12:47.262 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:12:47.295 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:12:47.339 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:12:47.380 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:12:47.418 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-12T12:12:47.486 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:12:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:12:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:12:47.565 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:12:47.601 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:12:47.623 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:12:47.666 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:12:47.691 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:12:47.730 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:12:47.733 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:12:47.798 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:12:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:12:48.175 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:12:48.297 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:12:48.326 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:12:48.342 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:12:48.382 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:12:48.418 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:12:48.447 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:12:48.604 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:12:48.670 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:12:48.697 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:12:48.774 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:12:48.784 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:12:48.806 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:12:48.834 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:12:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:12:48.868 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:12:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:12:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:12:48.928 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:12:48.969 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:12:48.990 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:12:49.060 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:12:49.061 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:12:49.064 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:12:49.065 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:12:49.065 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:12:49.084 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:12:49.086 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:12:49.116 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:12:49.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:12:49.223 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:12:49.261 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:12:49.339 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:12:49.438 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:49.511 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:12:49.542 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:12:49.640 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:12:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:12:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:12:49.950 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:12:49.999 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:12:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:12:50.107 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:12:50.151 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:12:50.191 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:12:50.244 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:12:50.284 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:12:50.312 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:12:50.381 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:12:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:12:50.464 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:12:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:12:50.531 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:12:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:12:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:12:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:12:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:12:50.697 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:12:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:12:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:12:50.888 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:12:51.021 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:12:51.075 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:12:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:12:51.669 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:12:51.708 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:12:51.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:12:51.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:12:51.830 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:12:51.999 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:12:52.084 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:12:52.138 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:12:52.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:12:52.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:12:52.278 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:12:52.325 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:12:52.362 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:12:52.363 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:12:52.404 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:12:52.455 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:12:52.463 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:12:52.500 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:12:52.532 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:12:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:12:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:12:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:12:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:12:52.815 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:12:52.855 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:12:52.880 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:12:52.890 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:12:52.905 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:12:53.011 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:12:53.113 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:12:53.115 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:12:53.149 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:12:53.163 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:12:53.190 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:12:53.199 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:12:53.224 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:12:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:12:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:12:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:12:53.368 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:12:53.410 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:12:53.454 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:12:53.488 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:12:53.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:12:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:12:53.666 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:12:53.750 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:12:53.768 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:12:53.780 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:12:53.818 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:12:53.904 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:12:53.932 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:12:54.543 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:12:54.597 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:12:54.631 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:12:54.728 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:12:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:12:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:12:54.902 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:12:54.942 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:12:55.125 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:12:55.165 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:12:55.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:12:55.880 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:12:55.995 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:12:56.556 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:12:56.604 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:12:57.216 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:12:57.270 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:12:57.310 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:12:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:12:57.338 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:12:57.371 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:12:57.477 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:12:57.478 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:12:57.478 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:12:57.478 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:12:57.517 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:12:57.684 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:12:57.726 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:12:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:12:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:12:57.883 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:12:58.368 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:12:58.404 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:12:58.474 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:12:58.497 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:13:00.768 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:13:00.810 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-12T12:13:00.946 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:13:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:13:01.139 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:01.139 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:13:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:13:01.589 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:13:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:13:01.677 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:13:01.678 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:13:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:01.706 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:13:02.607 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:13:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:13:02.634 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:02.634 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:13:02.634 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:13:02.634 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:13:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:13:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:13:02.890 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:02.890 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:13:02.890 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:13:02.890 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:13:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:03.325 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:13:03.349 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:13:03.349 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:03.349 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:13:03.349 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:13:03.350 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:13:03.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:13:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:13:03.750 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:13:03.792 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:13:03.860 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:13:03.949 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:13:04.086 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:13:04.142 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:13:04.174 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:13:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:13:04.644 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:13:04.681 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:13:04.707 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:13:04.760 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:13:04.790 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:13:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:13:05.875 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:13:06.842 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:13:06.866 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:13:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:13:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:13:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:13:07.201 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:07.201 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:13:07.201 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:13:07.201 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:13:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:07.252 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:13:07.264 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:13:07.354 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:13:07.401 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:13:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:13:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:13:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:13:08.370 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:08.370 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:13:08.370 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:13:08.371 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:13:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:13:08.437 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:13:08.438 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:08.438 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:13:08.438 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:08.490 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:13:08.514 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:13:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:13:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:13:08.514 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:13:08.514 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:08.815 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:13:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:13:08.839 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:08.839 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:13:08.839 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:13:08.839 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:13:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:10.838 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:13:10.838 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-09-12T12:13:10.839 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-09-12T12:13:10.839 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-09-12T12:13:10.839 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-09-12T12:13:10.839 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-09-12T12:13:10.839 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2024-09-12T12:13:10.839 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-09-12T12:13:10.839 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:11.053 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:13:11.089 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:13:11.089 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:11.089 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:13:11.089 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:12.728 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:13:12.788 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:13:12.788 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:12.788 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:13:12.788 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:13:12.788 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:13:12.788 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:13.055 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:13:13.106 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:13:13.106 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:13.106 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:13:13.106 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:13:13.106 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:13:13.106 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:13.376 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:13:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:13:13.402 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-12T12:13:13.402 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-12T12:13:13.403 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-12T12:13:13.403 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-12T12:13:13.403 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-12T12:13:13.403 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-12T12:13:13.403 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-12T12:13:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:13.418 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:13:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:13:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:13:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:13:13.584 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:13:13.599 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:13:13.599 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:13.600 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:13:13.600 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:13.605 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:13:13.657 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:13:13.657 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:13.657 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:13:13.657 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:13:13.657 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:13:13.657 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:13:13.748 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:13:13.778 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:13:13.790 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:13:13.807 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:13:13.851 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:13:13.853 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:13:13.924 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:13:14.171 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:13:14.227 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:13:14.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:13:14.418 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:14.434 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:13:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:14.607 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:13:14.659 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:13:14.699 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:13:14.724 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:13:15.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:13:15.080 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:13:15.080 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:15.080 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:13:15.080 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:13:15.080 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:13:15.080 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:15.253 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:13:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:13:15.304 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:13:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:13:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:13:15.336 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:15.336 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:13:15.336 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:13:15.336 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:13:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:13:15.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:13:15.430 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:13:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:13:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:13:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:13:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:13:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:13:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:13:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:13:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:13:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:13:15.744 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:13:15.770 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:13:15.771 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:13:15.775 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:15.775 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:15.794 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:13:15.794 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:15.794 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:13:15.794 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:13:15.795 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:13:15.795 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:15.901 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:13:15.946 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:15.946 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:13:15.958 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:13:16.013 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:13:16.030 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:13:16.095 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:16.207 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:13:16.255 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:13:16.332 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:13:16.422 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:13:16.562 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:13:16.614 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:13:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:13:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:13:16.758 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:13:16.806 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:13:17.132 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:13:17.164 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:13:17.195 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:13:17.267 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:13:17.304 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:13:17.960 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:13:18.006 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:13:18.152 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:13:18.351 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:13:18.353 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:13:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:13:18.392 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:13:18.444 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:13:18.444 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:18.444 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:13:18.444 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:13:18.444 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:13:18.444 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:13:18.528 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:13:18.638 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:13:18.703 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:13:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:13:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:13:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:13:19.650 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:13:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:13:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:13:19.707 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:19.707 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:13:19.707 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:13:19.707 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:13:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:13:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:13:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:13:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:13:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:13:19.847 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:19.847 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:13:19.847 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:13:19.847 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:13:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:19.859 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:13:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:13:19.916 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:13:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:13:19.946 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:19.947 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:13:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:13:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:13:20.057 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:20.057 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:13:20.057 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:13:20.057 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:13:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:13:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:13:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:13:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:13:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:13:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:13:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:13:20.893 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:13:20.893 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:20.894 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:13:20.894 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:13:20.894 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:13:20.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:20.936 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:13:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:13:20.959 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:20.960 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:13:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:13:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:13:21.027 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:21.027 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:13:21.027 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:13:21.028 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:13:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:21.329 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:13:21.353 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:13:21.353 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:13:21.353 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:13:21.353 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:13:21.353 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:13:21.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:13:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:13:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:13:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:13:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:13:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:13:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:13:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:13:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:13:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:13:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:13:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:13:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:13:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:13:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:13:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:13:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:13:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:13:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:13:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:13:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:13:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:13:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:13:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:13:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:13:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:13:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:13:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:13:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:13:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:13:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:13:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:13:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:13:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:13:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:13:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:13:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:13:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:13:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:13:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:13:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:13:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:13:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:13:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:13:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:13:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:13:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:13:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:13:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:13:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:13:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:13:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:13:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:13:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:13:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:13:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:13:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:13:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:13:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:13:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:13:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:13:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:13:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:13:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:13:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:13:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:13:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:13:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:13:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:13:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:13:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:13:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:13:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:13:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:13:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:13:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:13:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:13:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:13:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:13:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:13:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:13:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:13:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:13:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:13:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:13:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:13:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:13:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:13:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:13:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:13:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:13:24.600 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-12T12:13:25.000 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:25.703 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:13:25.757 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:13:25.798 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:13:25.833 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:13:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:13:25.886 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:13:25.925 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:13:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:13:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:13:26.033 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:13:26.165 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:13:26.216 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:13:26.221 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:13:26.263 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:13:26.286 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:13:26.293 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:13:26.318 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:13:26.323 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:13:26.362 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:13:26.369 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:13:26.931 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:27.160 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:27.211 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:27.262 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:13:27.832 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:13:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:13:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:13:28.061 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:13:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:13:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:13:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:13:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:13:28.235 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:13:28.235 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:13:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:13:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:13:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:13:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:13:28.638 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:13:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:28.761 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:13:28.823 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:13:28.937 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:13:28.971 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:13:29.005 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:13:29.069 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:13:29.069 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:13:29.190 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:13:29.190 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:13:29.299 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:13:29.324 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:13:29.341 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:29.341 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:29.584 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:13:29.585 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:13:29.677 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:13:29.754 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:29.963 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:29.963 INFO:teuthology.orchestra.run.smithi038.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-12T12:13:29.963 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:34.457 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:13:34.458 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:13:34.459 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:13:34.460 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:13:34.461 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:13:34.462 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:13:34.463 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:13:34.464 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:13:34.465 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:13:34.466 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:13:34.467 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:13:34.468 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:13:34.469 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:13:34.470 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:13:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:13:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:13:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:13:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:13:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:13:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:13:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:13:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:13:35.793 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:13:35.793 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:13:35.793 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:13:35.794 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:13:35.795 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:13:35.796 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:13:35.797 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:13:35.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:13:35.799 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:13:35.800 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:13:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:13:35.802 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:13:35.803 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:13:37.243 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:13:37.244 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:13:37.244 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:13:37.244 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:13:37.246 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:13:37.247 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:13:37.248 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:13:37.249 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:13:37.250 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:13:37.251 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:13:37.251 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:13:37.251 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-12T12:13:37.677 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:38.045 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:13:38.045 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:38.046 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.047 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.048 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:13:38.049 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.050 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:13:38.051 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.053 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:13:38.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:13:38.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:13:38.056 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.057 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:13:38.058 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:13:38.059 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:13:38.060 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:13:38.060 INFO:teuthology.orchestra.run.smithi038.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:13:38.060 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:13:38.060 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:13:38.060 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:13:38.061 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:13:38.061 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-12T12:13:38.658 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:38.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:38.809 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:13:38.857 INFO:teuthology.orchestra.run.smithi038.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:13:38.858 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:13:38.858 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:13:38.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:39.003 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:13:39.029 INFO:teuthology.orchestra.run.smithi071.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:13:39.029 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:13:39.030 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:13:39.031 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:39.179 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:13:39.205 INFO:teuthology.orchestra.run.smithi154.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:13:39.205 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:13:39.205 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:13:39.207 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T12:13:39.207 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:13:39.207 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:13:39.265 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:13:39.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:13:39.301 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:13:39.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:13:39.332 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T12:13:39.333 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:13:39.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:13:39.391 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:13:39.493 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:13:39.494 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:13:39.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:13:39.592 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:13:39.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:13:39.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:13:39.692 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T12:13:39.692 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:13:39.692 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:13:39.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:13:39.851 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:13:39.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:13:39.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:13:39.940 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:13:39.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:13:39.970 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:13:40.040 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T12:13:40.040 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:13:40.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:13:40.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:13:40.201 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:13:40.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:13:40.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:13:40.291 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:13:40.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:13:40.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:13:40.390 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T12:13:40.487 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T12:13:40.487 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:40.487 INFO:tasks.cephadm:Cluster fsid is 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:13:40.488 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T12:13:40.488 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.38', 'mon.b': '172.21.15.71', 'mon.c': '172.21.15.154'} 2024-09-12T12:13:40.488 INFO:tasks.cephadm:First mon is mon.a on smithi038 2024-09-12T12:13:40.488 INFO:tasks.cephadm:First mgr is x 2024-09-12T12:13:40.488 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T12:13:40.488 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname $(hostname -s) 2024-09-12T12:13:40.556 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-09-12T12:13:40.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-09-12T12:13:40.612 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T12:13:40.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:40.760 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T12:13:40.910 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:40.912 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T12:13:40.912 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T12:13:40.912 DEBUG:teuthology.orchestra.run.smithi038:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:41.366 INFO:teuthology.orchestra.run.smithi038.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:13 /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:41.366 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:41.832 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:13 /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:41.832 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:42.865 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:13 /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:42.866 DEBUG:teuthology.orchestra.run.smithi038:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:42.908 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:42.928 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:13:42.967 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T12:13:42.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:13:42.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:13:42.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:13:44.562 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:13:44.602 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:13:44.863 INFO:teuthology.orchestra.run.smithi038.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:14:11.657 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-12T12:14:11.657 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:14:11.658 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:14:11.658 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-09-12T12:14:11.658 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:14:11.658 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-12T12:14:11.658 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-12T12:14:14.457 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T12:14:14.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:14:14.458 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:14:14.458 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-09-12T12:14:14.458 INFO:teuthology.orchestra.run.smithi071.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:14:14.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-12T12:14:14.458 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T12:14:17.823 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:14:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:14:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:14:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "repo_digests": [ 2024-09-12T12:14:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:14:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:14:17.823 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:14:17.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph 2024-09-12T12:14:17.915 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-09-12T12:14:17.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-09-12T12:14:17.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /etc/ceph 2024-09-12T12:14:18.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-09-12T12:14:18.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-09-12T12:14:18.099 INFO:tasks.cephadm:Writing seed config... 2024-09-12T12:14:18.101 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T12:14:18.102 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T12:14:18.102 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T12:14:18.102 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T12:14:18.102 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T12:14:18.102 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T12:14:18.102 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T12:14:18.103 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T12:14:18.103 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T12:14:18.103 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T12:14:18.103 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T12:14:18.103 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T12:14:18.103 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T12:14:18.104 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T12:14:18.104 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T12:14:18.104 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T12:14:18.104 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T12:14:18.104 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T12:14:18.104 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T12:14:18.105 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T12:14:18.105 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T12:14:18.105 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T12:14:18.105 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T12:14:18.105 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T12:14:18.105 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T12:14:18.106 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T12:14:18.106 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T12:14:18.106 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T12:14:18.106 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T12:14:18.106 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T12:14:18.107 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T12:14:18.107 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T12:14:18.107 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T12:14:18.107 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T12:14:18.107 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T12:14:18.107 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T12:14:18.108 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T12:14:18.108 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T12:14:18.108 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T12:14:18.108 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T12:14:18.108 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T12:14:18.108 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T12:14:18.109 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T12:14:18.109 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T12:14:18.109 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-12T12:14:18.110 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:14:18.110 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T12:14:18.146 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 726420ce-7100-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T12:14:18.146 DEBUG:teuthology.orchestra.run.smithi038:mon.a> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T12:14:18.191 DEBUG:teuthology.orchestra.run.smithi038:mgr.x> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T12:14:18.236 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T12:14:18.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 726420ce-7100-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.38 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:14:18.498 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:14:18.498 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '726420ce-7100-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.38', '--skip-admin-label'] 2024-09-12T12:14:18.499 INFO:teuthology.orchestra.run.smithi038.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T12:14:18.499 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying podman|docker is present... 2024-09-12T12:14:18.543 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 5.2.2 2024-09-12T12:14:18.543 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying lvm2 is present... 2024-09-12T12:14:18.543 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying time synchronization is in place... 2024-09-12T12:14:18.557 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T12:14:18.557 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T12:14:18.569 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T12:14:18.570 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-12T12:14:18.583 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2024-09-12T12:14:18.595 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2024-09-12T12:14:18.595 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2024-09-12T12:14:18.595 INFO:teuthology.orchestra.run.smithi038.stdout:Repeating the final host check... 2024-09-12T12:14:18.638 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 5.2.2 2024-09-12T12:14:18.639 INFO:teuthology.orchestra.run.smithi038.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T12:14:18.639 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl is present 2024-09-12T12:14:18.639 INFO:teuthology.orchestra.run.smithi038.stdout:lvcreate is present 2024-09-12T12:14:18.651 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T12:14:18.652 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T12:14:18.664 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T12:14:18.664 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-12T12:14:18.677 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2024-09-12T12:14:18.691 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2024-09-12T12:14:18.691 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2024-09-12T12:14:18.691 INFO:teuthology.orchestra.run.smithi038.stdout:Host looks OK 2024-09-12T12:14:18.691 INFO:teuthology.orchestra.run.smithi038.stdout:Cluster fsid: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:18.692 INFO:teuthology.orchestra.run.smithi038.stdout:Acquiring lock 140522041041920 on /run/cephadm/726420ce-7100-11ef-bcea-c7b262605968.lock 2024-09-12T12:14:18.692 INFO:teuthology.orchestra.run.smithi038.stdout:Lock 140522041041920 acquired on /run/cephadm/726420ce-7100-11ef-bcea-c7b262605968.lock 2024-09-12T12:14:18.692 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 3300 ... 2024-09-12T12:14:18.693 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 6789 ... 2024-09-12T12:14:18.693 INFO:teuthology.orchestra.run.smithi038.stdout:Base mon IP(s) is [172.21.15.38:3300, 172.21.15.38:6789], mon addrv is [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-12T12:14:18.698 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.38 metric 100 2024-09-12T12:14:18.699 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.38 metric 100 2024-09-12T12:14:18.705 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T12:14:18.705 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-12T12:14:18.705 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-09-12T12:14:18.711 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T12:14:18.711 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T12:14:18.712 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T12:14:18.712 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-12T12:14:18.712 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-09-12T12:14:18.712 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T12:14:18.712 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2024-09-12T12:14:18.713 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2024-09-12T12:14:18.713 INFO:teuthology.orchestra.run.smithi038.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T12:14:18.714 INFO:teuthology.orchestra.run.smithi038.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T12:14:18.714 INFO:teuthology.orchestra.run.smithi038.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:14:19.212 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T12:14:19.212 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:14:19.212 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T12:14:19.212 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T12:14:19.212 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T12:14:19.212 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T12:14:19.212 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T12:14:20.347 INFO:teuthology.orchestra.run.smithi038.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T12:14:20.347 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T12:14:20.347 INFO:teuthology.orchestra.run.smithi038.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T12:14:21.354 INFO:teuthology.orchestra.run.smithi038.stdout:stat: stdout 167 167 2024-09-12T12:14:21.354 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial keys... 2024-09-12T12:14:33.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQAd2+JmKzNlLhAAbiYprgX/1Hwlf8ePgfy9Ug== 2024-09-12T12:14:34.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQAp2+Jm+ELSLxAAZpcIIQI00z/yaDn7vsohMw== 2024-09-12T12:14:35.679 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQAq2+JmXcwKMhAAINF5yH7ROxbeysWHHJrkbw== 2024-09-12T12:14:35.680 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial monmap... 2024-09-12T12:14:36.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool for a [v2:172.21.15.38:3300,v1:172.21.15.38:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = quincy 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: set fsid to 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:14:36.686 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mon... 2024-09-12T12:14:37.773 INFO:teuthology.orchestra.run.smithi038.stdout:create mon.a on 2024-09-12T12:14:38.156 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T12:14:38.383 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T12:14:38.693 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-726420ce-7100-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-726420ce-7100-11ef-bcea-c7b262605968.target. 2024-09-12T12:14:38.694 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-726420ce-7100-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-726420ce-7100-11ef-bcea-c7b262605968.target. 2024-09-12T12:14:39.013 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a 2024-09-12T12:14:39.013 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T12:14:39.273 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-726420ce-7100-11ef-bcea-c7b262605968.target.wants/ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-726420ce-7100-11ef-bcea-c7b262605968@.service. 2024-09-12T12:14:39.918 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:39 smithi038 podman[30433]: 2024-09-12 12:14:39.846037354 +0000 UTC m=+0.348254940 container start 3d39365a4e56715655180d22262b70d48b55e417b3d02b0c92aba505e1bfa31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T12:14:39.949 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:14:39.949 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-12T12:14:39.962 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:14:39.962 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-12T12:14:39.962 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-12T12:14:39.962 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T12:14:39.963 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon to start... 2024-09-12T12:14:39.963 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon... 2024-09-12T12:14:40.216 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:39 smithi038 ceph-mon[30452]: mkfs 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:40.216 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:39 smithi038 ceph-mon[30452]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T12:14:40.216 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:39 smithi038 bash[30433]: 3d39365a4e56715655180d22262b70d48b55e417b3d02b0c92aba505e1bfa31a 2024-09-12T12:14:40.216 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:39 smithi038 systemd[1]: Started Ceph mon.a for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:14:41.162 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T12:14:41.162 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: monmap epoch 1 2024-09-12T12:14:41.162 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:41.163 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: last_changed 2024-09-12T12:14:36.052123+0000 2024-09-12T12:14:41.163 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:14:41.163 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: min_mon_release 19 (squid) 2024-09-12T12:14:41.163 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: election_strategy: 1 2024-09-12T12:14:41.163 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:14:41.163 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: fsmap 2024-09-12T12:14:41.164 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T12:14:41.164 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: mgrmap e1: no daemons active 2024-09-12T12:14:41.164 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:40 smithi038 ceph-mon[30452]: from='client.? 172.21.15.38:0/110699650' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout id: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout services: 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.654288s) 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T12:14:41.178 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout data: 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.485+0000 7f9947200640 1 Processor -- start 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.485+0000 7f9947200640 1 -- start start 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.485+0000 7f9947200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994007c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.485+0000 7f9947200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f994007c7f0 con 0x7f994007de00 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.486+0000 7f993fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994007c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.486+0000 7f993fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994007c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39694/0 (socket says 172.21.15.38:39694) 2024-09-12T12:14:41.179 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.486+0000 7f993fe00640 1 -- 172.21.15.38:0/360518773 learned_addr learned my addr 172.21.15.38:0/360518773 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.487+0000 7f993fe00640 1 -- 172.21.15.38:0/360518773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994007c970 con 0x7f994007de00 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.489+0000 7f993fe00640 1 --2- 172.21.15.38:0/360518773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994007c2b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9930009820 tx=0x7f993002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4e5bd173a37e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.489+0000 7f993f400640 1 -- 172.21.15.38:0/360518773 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9930037070 con 0x7f994007de00 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.489+0000 7f993f400640 1 -- 172.21.15.38:0/360518773 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9930032440 con 0x7f994007de00 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.489+0000 7f993f400640 1 -- 172.21.15.38:0/360518773 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9930032740 con 0x7f994007de00 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.490+0000 7f9947200640 1 -- 172.21.15.38:0/360518773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 msgr2=0x7f994007c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.490+0000 7f9947200640 1 --2- 172.21.15.38:0/360518773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994007c2b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9930009820 tx=0x7f993002a270 comp rx=0 tx=0).stop 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.490+0000 7f9947200640 1 -- 172.21.15.38:0/360518773 shutdown_connections 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.490+0000 7f9947200640 1 --2- 172.21.15.38:0/360518773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994007c2b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.490+0000 7f9947200640 1 -- 172.21.15.38:0/360518773 >> 172.21.15.38:0/360518773 conn(0x7f9940102ce0 msgr2=0x7f9940105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.490+0000 7f9947200640 1 -- 172.21.15.38:0/360518773 shutdown_connections 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.490+0000 7f9947200640 1 -- 172.21.15.38:0/360518773 wait complete. 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.491+0000 7f9947200640 1 Processor -- start 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.491+0000 7f9947200640 1 -- start start 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.492+0000 7f9947200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.492+0000 7f9947200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f994007cf10 con 0x7f994007de00 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.492+0000 7f993fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.492+0000 7f993fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39700/0 (socket says 172.21.15.38:39700) 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.492+0000 7f993fe00640 1 -- 172.21.15.38:0/110699650 learned_addr learned my addr 172.21.15.38:0/110699650 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.493+0000 7f993fe00640 1 -- 172.21.15.38:0/110699650 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994019d3d0 con 0x7f994007de00 2024-09-12T12:14:41.181 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.493+0000 7f993fe00640 1 --2- 172.21.15.38:0/110699650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994019ce90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f99300090b0 tx=0x7f99300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.493+0000 7f993d600640 1 -- 172.21.15.38:0/110699650 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9930041070 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.493+0000 7f993d600640 1 -- 172.21.15.38:0/110699650 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993003c7a0 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.493+0000 7f993d600640 1 -- 172.21.15.38:0/110699650 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9930037040 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.493+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994019d660 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.493+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401a0350 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.494+0000 7f993d600640 1 -- 172.21.15.38:0/110699650 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9930044070 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.494+0000 7f993d600640 1 -- 172.21.15.38:0/110699650 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f993003d3f0 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.495+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994007c330 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.498+0000 7f993d600640 1 -- 172.21.15.38:0/110699650 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9930046450 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.563+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f994002d940 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.564+0000 7f993d600640 1 -- 172.21.15.38:0/110699650 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f9930046630 con 0x7f994007de00 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.564+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 msgr2=0x7f994019ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:41.182 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.564+0000 7f9947200640 1 --2- 172.21.15.38:0/110699650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994019ce90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f99300090b0 tx=0x7f99300046c0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.565+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 shutdown_connections 2024-09-12T12:14:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.565+0000 7f9947200640 1 --2- 172.21.15.38:0/110699650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f994007de00 0x7f994019ce90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.565+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 >> 172.21.15.38:0/110699650 conn(0x7f9940102ce0 msgr2=0x7f9940103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.565+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 shutdown_connections 2024-09-12T12:14:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:40.565+0000 7f9947200640 1 -- 172.21.15.38:0/110699650 wait complete. 2024-09-12T12:14:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:mon is available 2024-09-12T12:14:41.183 INFO:teuthology.orchestra.run.smithi038.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T12:14:42.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:41 smithi038 ceph-mon[30452]: from='client.? 172.21.15.38:0/2666924773' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T12:14:42.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:41 smithi038 ceph-mon[30452]: from='client.? 172.21.15.38:0/2666924773' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T12:14:42.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.664+0000 7f3586600640 1 Processor -- start 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.664+0000 7f3586600640 1 -- start start 2024-09-12T12:14:42.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.665+0000 7f3586600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f3580107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.665+0000 7f3586600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3580107ee0 con 0x7f3580107510 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.665+0000 7f357f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f3580107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.665+0000 7f357f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f3580107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39712/0 (socket says 172.21.15.38:39712) 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.665+0000 7f357f400640 1 -- 172.21.15.38:0/3801340724 learned_addr learned my addr 172.21.15.38:0/3801340724 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.665+0000 7f357f400640 1 -- 172.21.15.38:0/3801340724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35801086c0 con 0x7f3580107510 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.666+0000 7f357f400640 1 --2- 172.21.15.38:0/3801340724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f3580107910 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3570009820 tx=0x7f357002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399552bc0e80dcb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f357ea00640 1 -- 172.21.15.38:0/3801340724 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570037070 con 0x7f3580107510 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f357ea00640 1 -- 172.21.15.38:0/3801340724 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3570032440 con 0x7f3580107510 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f357ea00640 1 -- 172.21.15.38:0/3801340724 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570032740 con 0x7f3580107510 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f3586600640 1 -- 172.21.15.38:0/3801340724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 msgr2=0x7f3580107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f3586600640 1 --2- 172.21.15.38:0/3801340724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f3580107910 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3570009820 tx=0x7f357002a270 comp rx=0 tx=0).stop 2024-09-12T12:14:42.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f3586600640 1 -- 172.21.15.38:0/3801340724 shutdown_connections 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f3586600640 1 --2- 172.21.15.38:0/3801340724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f3580107910 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f3586600640 1 -- 172.21.15.38:0/3801340724 >> 172.21.15.38:0/3801340724 conn(0x7f3580102ce0 msgr2=0x7f3580105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f3586600640 1 -- 172.21.15.38:0/3801340724 shutdown_connections 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.667+0000 7f3586600640 1 -- 172.21.15.38:0/3801340724 wait complete. 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.668+0000 7f3586600640 1 Processor -- start 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.668+0000 7f3586600640 1 -- start start 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.669+0000 7f3586600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f358007db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.669+0000 7f3586600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3580108c60 con 0x7f3580107510 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.669+0000 7f357f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f358007db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.669+0000 7f357f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f358007db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39724/0 (socket says 172.21.15.38:39724) 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.669+0000 7f357f400640 1 -- 172.21.15.38:0/2666924773 learned_addr learned my addr 172.21.15.38:0/2666924773 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.669+0000 7f357f400640 1 -- 172.21.15.38:0/2666924773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358007e080 con 0x7f3580107510 2024-09-12T12:14:42.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.670+0000 7f357f400640 1 --2- 172.21.15.38:0/2666924773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f358007db40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f35700090b0 tx=0x7f35700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.670+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570041070 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.670+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f357003c7a0 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.670+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570037040 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.670+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358007c270 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.670+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358007c7b0 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.670+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3570044070 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.671+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f357003d3f0 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.671+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35801092b0 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.674+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3570046450 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.738+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3580193f30 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.742+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f3570046630 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.743+0000 7f357cc00640 1 -- 172.21.15.38:0/2666924773 <== mon.0 v2:172.21.15.38:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35700584b0 con 0x7f3580107510 2024-09-12T12:14:42.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.744+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 msgr2=0x7f358007db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:42.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.744+0000 7f3586600640 1 --2- 172.21.15.38:0/2666924773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f358007db40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f35700090b0 tx=0x7f35700046c0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.744+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 shutdown_connections 2024-09-12T12:14:42.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.744+0000 7f3586600640 1 --2- 172.21.15.38:0/2666924773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3580107510 0x7f358007db40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.744+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 >> 172.21.15.38:0/2666924773 conn(0x7f3580102ce0 msgr2=0x7f358018ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:42.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.744+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 shutdown_connections 2024-09-12T12:14:42.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:41.744+0000 7f3586600640 1 -- 172.21.15.38:0/2666924773 wait complete. 2024-09-12T12:14:42.327 INFO:teuthology.orchestra.run.smithi038.stdout:Generating new minimal ceph.conf... 2024-09-12T12:14:43.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:42 smithi038 ceph-mon[30452]: from='client.? 172.21.15.38:0/2714305422' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.786+0000 7f90ed400640 1 Processor -- start 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.787+0000 7f90ed400640 1 -- start start 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.787+0000 7f90ed400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.787+0000 7f90ed400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f90e810a260 con 0x7f90e8109890 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.787+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.787+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e8109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39738/0 (socket says 172.21.15.38:39738) 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.787+0000 7f90e7e00640 1 -- 172.21.15.38:0/3640934740 learned_addr learned my addr 172.21.15.38:0/3640934740 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.788+0000 7f90e7e00640 1 -- 172.21.15.38:0/3640934740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e810a6f0 con 0x7f90e8109890 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.789+0000 7f90e7e00640 1 --2- 172.21.15.38:0/3640934740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e8109c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009820 tx=0x7f90d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b625fe9a1b01b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.789+0000 7f90e7400640 1 -- 172.21.15.38:0/3640934740 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90d8037070 con 0x7f90e8109890 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.789+0000 7f90e7400640 1 -- 172.21.15.38:0/3640934740 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90d8032900 con 0x7f90e8109890 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.789+0000 7f90e7400640 1 -- 172.21.15.38:0/3640934740 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90d8030850 con 0x7f90e8109890 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.790+0000 7f90ed400640 1 -- 172.21.15.38:0/3640934740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 msgr2=0x7f90e8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.790+0000 7f90ed400640 1 --2- 172.21.15.38:0/3640934740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e8109c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009820 tx=0x7f90d802a270 comp rx=0 tx=0).stop 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.790+0000 7f90ed400640 1 -- 172.21.15.38:0/3640934740 shutdown_connections 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.790+0000 7f90ed400640 1 --2- 172.21.15.38:0/3640934740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e8109c90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.790+0000 7f90ed400640 1 -- 172.21.15.38:0/3640934740 >> 172.21.15.38:0/3640934740 conn(0x7f90e807cb10 msgr2=0x7f90e807cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.790+0000 7f90ed400640 1 -- 172.21.15.38:0/3640934740 shutdown_connections 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.790+0000 7f90ed400640 1 -- 172.21.15.38:0/3640934740 wait complete. 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.791+0000 7f90ed400640 1 Processor -- start 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.791+0000 7f90ed400640 1 -- start start 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.791+0000 7f90ed400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e819d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.791+0000 7f90ed400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f90e810daa0 con 0x7f90e8109890 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.792+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e819d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.792+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e819d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39750/0 (socket says 172.21.15.38:39750) 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.792+0000 7f90e7e00640 1 -- 172.21.15.38:0/2714305422 learned_addr learned my addr 172.21.15.38:0/2714305422 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.792+0000 7f90e7e00640 1 -- 172.21.15.38:0/2714305422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e819daa0 con 0x7f90e8109890 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.792+0000 7f90e7e00640 1 --2- 172.21.15.38:0/2714305422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e819d560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097f0 tx=0x7f90d8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.793+0000 7f90e5600640 1 -- 172.21.15.38:0/2714305422 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90d8042070 con 0x7f90e8109890 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.793+0000 7f90e5600640 1 -- 172.21.15.38:0/2714305422 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90d8032ca0 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.793+0000 7f90e5600640 1 -- 172.21.15.38:0/2714305422 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90d8037040 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.793+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e819dd30 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.793+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e81a0a20 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.793+0000 7f90e5600640 1 -- 172.21.15.38:0/2714305422 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90d8045070 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.793+0000 7f90e5600640 1 -- 172.21.15.38:0/2714305422 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f90d80463b0 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.794+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e810dc20 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.797+0000 7f90e5600640 1 -- 172.21.15.38:0/2714305422 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f90d8047440 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.860+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f90e81a0f00 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.860+0000 7f90e5600640 1 -- 172.21.15.38:0/2714305422 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f90d803da60 con 0x7f90e8109890 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.862+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 msgr2=0x7f90e819d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.862+0000 7f90ed400640 1 --2- 172.21.15.38:0/2714305422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e819d560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097f0 tx=0x7f90d8030ec0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.862+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 shutdown_connections 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.862+0000 7f90ed400640 1 --2- 172.21.15.38:0/2714305422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90e8109890 0x7f90e819d560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.862+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 >> 172.21.15.38:0/2714305422 conn(0x7f90e807cb10 msgr2=0x7f90e81075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.862+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 shutdown_connections 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:42.862+0000 7f90ed400640 1 -- 172.21.15.38:0/2714305422 wait complete. 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi038.stdout:Restarting the monitor... 2024-09-12T12:14:43.949 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:43 smithi038 systemd[1]: Stopping Ceph mon.a for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:14:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:43 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a[30448]: 2024-09-12T12:14:43.947+0000 7f66e4e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:14:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:43 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a[30448]: 2024-09-12T12:14:43.947+0000 7f66e4e00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T12:14:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 podman[30692]: 2024-09-12 12:14:44.092554324 +0000 UTC m=+0.249827801 container died 3d39365a4e56715655180d22262b70d48b55e417b3d02b0c92aba505e1bfa31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:14:44.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 podman[30692]: 2024-09-12 12:14:44.477330387 +0000 UTC m=+0.634603864 container cleanup 3d39365a4e56715655180d22262b70d48b55e417b3d02b0c92aba505e1bfa31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:14:44.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 bash[30692]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a 2024-09-12T12:14:45.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 podman[30705]: 2024-09-12 12:14:44.728394941 +0000 UTC m=+0.628777900 container remove 3d39365a4e56715655180d22262b70d48b55e417b3d02b0c92aba505e1bfa31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T12:14:45.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T12:14:45.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 systemd[1]: Stopped Ceph mon.a for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:14:45.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.226s CPU time. 2024-09-12T12:14:45.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:44 smithi038 systemd[1]: Starting Ceph mon.a for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:14:45.456 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 podman[30792]: 2024-09-12 12:14:45.110581666 +0000 UTC m=+0.027593838 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:14:45.456 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 podman[30792]: 2024-09-12 12:14:45.254278139 +0000 UTC m=+0.171290296 container create 5a06de85b7ac31045059fda72290fd6f85a199d6f44610a80df98a0a99d879f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T12:14:45.456 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 podman[30792]: 2024-09-12 12:14:45.456679906 +0000 UTC m=+0.373692064 container init 5a06de85b7ac31045059fda72290fd6f85a199d6f44610a80df98a0a99d879f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T12:14:45.547 INFO:teuthology.orchestra.run.smithi038.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T12:14:45.707 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 podman[30792]: 2024-09-12 12:14:45.463449803 +0000 UTC m=+0.380461962 container start 5a06de85b7ac31045059fda72290fd6f85a199d6f44610a80df98a0a99d879f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T12:14:45.707 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T12:14:45.707 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T12:14:45.707 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: pidfile_write: ignore empty --pid-file 2024-09-12T12:14:45.707 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: load: jerasure load: lrc 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: RocksDB version: 7.9.2 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Git sha 0 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: DB SUMMARY 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: DB Session ID: E1BBHVBBD9MKPH0G4IFN 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: CURRENT file: CURRENT 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104238 ; 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.error_if_exists: 0 2024-09-12T12:14:45.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.create_if_missing: 0 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.paranoid_checks: 1 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.env: 0x5602217e4940 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.info_log: 0x56022be076a0 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.statistics: (nil) 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.use_fsync: 0 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_log_file_size: 0 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T12:14:45.709 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T12:14:45.710 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T12:14:45.710 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T12:14:45.710 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.allow_fallocate: 1 2024-09-12T12:14:45.712 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T12:14:45.712 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T12:14:45.712 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.use_direct_reads: 0 2024-09-12T12:14:45.712 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T12:14:45.712 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T12:14:45.712 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.db_log_dir: 2024-09-12T12:14:45.712 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.wal_dir: 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.write_buffer_manager: 0x56022be16dc0 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T12:14:45.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.unordered_write: 0 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T12:14:45.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.row_cache: None 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.wal_filter: None 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.two_write_queues: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.wal_compression: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.atomic_flush: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T12:14:45.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.log_readahead_size: 0 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_background_jobs: 2 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_background_compactions: -1 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_subcompactions: 1 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T12:14:45.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_open_files: -1 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_background_flushes: -1 2024-09-12T12:14:45.717 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Compression algorithms supported: 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kZSTD supported: 0 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kXpressCompression supported: 0 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kBZip2Compression supported: 0 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kLZ4Compression supported: 1 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kZlibCompression supported: 1 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: kSnappyCompression supported: 1 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T12:14:45.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.merge_operator: 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_filter: None 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56022be07300) 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: cache_index_and_filter_blocks: 1 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: pin_top_level_index_and_filter: 1 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: index_type: 0 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: data_block_index_type: 0 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: index_shortening: 1 2024-09-12T12:14:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: checksum: 4 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: no_block_cache: 0 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache: 0x56022bdfb1f0 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache_name: BinnedLRUCache 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache_options: 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: capacity : 536870912 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: num_shard_bits : 4 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: strict_capacity_limit : 0 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: high_pri_pool_ratio: 0.000 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache_compressed: (nil) 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: persistent_cache: (nil) 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_size: 4096 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_size_deviation: 10 2024-09-12T12:14:45.720 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_restart_interval: 16 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: index_block_restart_interval: 1 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: metadata_block_size: 4096 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: partition_filters: 0 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: use_delta_encoding: 1 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: filter_policy: bloomfilter 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: whole_key_filtering: 1 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: verify_compression: 0 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: read_amp_bytes_per_bit: 0 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: format_version: 5 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: enable_index_compression: 1 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_align: 0 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: max_auto_readahead_size: 262144 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: prepopulate_block_cache: 0 2024-09-12T12:14:45.721 INFO:journalctl@ceph.mon.a.smithi038.stdout: initial_auto_readahead_size: 8192 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression: NoCompression 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.num_levels: 7 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T12:14:45.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:14:45.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T12:14:45.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T12:14:45.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.inplace_update_support: 0 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T12:14:45.726 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.bloom_locality: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.max_successive_merges: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.ttl: 2592000 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.enable_blob_files: false 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.min_blob_size: 0 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T12:14:45.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cb779ec3-d64d-426a-a20e-f798e17cc03c 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143285505174, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143285506944, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99463, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97357, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14048, "raw_average_key_size": 49, "raw_value_size": 89685, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726143285, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cb779ec3-d64d-426a-a20e-f798e17cc03c", "db_session_id": "E1BBHVBBD9MKPH0G4IFN", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143285507168, "job": 1, "event": "recovery_finished"} 2024-09-12T12:14:45.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56022be2ae00 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: DB pointer 0x56022bf26000 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** DB Stats ** 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:14:45.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: L0 2/0 98.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: Sum 2/0 98.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-12T12:14:45.730 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 95.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T12:14:45.731 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative compaction: 0.00 GB write, 11.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval compaction: 0.00 GB write, 11.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: Block cache BinnedLRUCache@0x56022bdfb1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-12T12:14:45.732 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: starting mon.a rank 0 at public addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] at bind addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???) e1 preinit fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???).mds e1 new map 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???).mds e1 print_map 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout: e1 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout: btime 2024-09-12T12:14:39:913230+0000 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout: legacy client fscid: -1 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout: No filesystems configured 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:14:45.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 bash[30792]: 5a06de85b7ac31045059fda72290fd6f85a199d6f44610a80df98a0a99d879f9 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 systemd[1]: Started Ceph mon.a for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: monmap epoch 1 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: last_changed 2024-09-12T12:14:36.052123+0000 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: min_mon_release 19 (squid) 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: election_strategy: 1 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: fsmap 2024-09-12T12:14:45.734 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T12:14:45.735 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:45 smithi038 ceph-mon[30810]: mgrmap e1: no daemons active 2024-09-12T12:14:46.768 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.089+0000 7f6151a00640 1 Processor -- start 2024-09-12T12:14:46.772 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.089+0000 7f6151a00640 1 -- start start 2024-09-12T12:14:46.772 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.089+0000 7f6151a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:46.772 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.089+0000 7f6151a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f614c07c810 con 0x7f614c07de20 2024-09-12T12:14:46.772 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.090+0000 7f614aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.090+0000 7f614aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c07c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40374/0 (socket says 172.21.15.38:40374) 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.090+0000 7f614aa00640 1 -- 172.21.15.38:0/1710735544 learned_addr learned my addr 172.21.15.38:0/1710735544 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.090+0000 7f614aa00640 1 -- 172.21.15.38:0/1710735544 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c07c990 con 0x7f614c07de20 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.093+0000 7f614aa00640 1 --2- 172.21.15.38:0/1710735544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c07c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f613c009820 tx=0x7f613c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb15871b785fe3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.093+0000 7f614a000640 1 -- 172.21.15.38:0/1710735544 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f613c037070 con 0x7f614c07de20 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.093+0000 7f614a000640 1 -- 172.21.15.38:0/1710735544 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f613c032900 con 0x7f614c07de20 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.093+0000 7f614a000640 1 -- 172.21.15.38:0/1710735544 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f613c0308e0 con 0x7f614c07de20 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.094+0000 7f6151a00640 1 -- 172.21.15.38:0/1710735544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 msgr2=0x7f614c07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.094+0000 7f6151a00640 1 --2- 172.21.15.38:0/1710735544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c07c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f613c009820 tx=0x7f613c02a300 comp rx=0 tx=0).stop 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.094+0000 7f6151a00640 1 -- 172.21.15.38:0/1710735544 shutdown_connections 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.094+0000 7f6151a00640 1 --2- 172.21.15.38:0/1710735544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c07c2d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.094+0000 7f6151a00640 1 -- 172.21.15.38:0/1710735544 >> 172.21.15.38:0/1710735544 conn(0x7f614c102ce0 msgr2=0x7f614c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:46.773 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.094+0000 7f6151a00640 1 -- 172.21.15.38:0/1710735544 shutdown_connections 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.094+0000 7f6151a00640 1 -- 172.21.15.38:0/1710735544 wait complete. 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.095+0000 7f6151a00640 1 Processor -- start 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.095+0000 7f6151a00640 1 -- start start 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.095+0000 7f6151a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.095+0000 7f6151a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f614c10db20 con 0x7f614c07de20 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.096+0000 7f614aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.096+0000 7f614aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40382/0 (socket says 172.21.15.38:40382) 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.096+0000 7f614aa00640 1 -- 172.21.15.38:0/2965639516 learned_addr learned my addr 172.21.15.38:0/2965639516 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.096+0000 7f614aa00640 1 -- 172.21.15.38:0/2965639516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c19dc00 con 0x7f614c07de20 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.096+0000 7f614aa00640 1 --2- 172.21.15.38:0/2965639516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c19d6c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f613c02a820 tx=0x7f613c030900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.097+0000 7f6143e00640 1 -- 172.21.15.38:0/2965639516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f613c037040 con 0x7f614c07de20 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.097+0000 7f6143e00640 1 -- 172.21.15.38:0/2965639516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f613c040070 con 0x7f614c07de20 2024-09-12T12:14:46.774 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.097+0000 7f6143e00640 1 -- 172.21.15.38:0/2965639516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f613c03a390 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.097+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c19de90 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.097+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c1a0b80 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.097+0000 7f6143e00640 1 -- 172.21.15.38:0/2965639516 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f613c03a600 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.097+0000 7f6143e00640 1 -- 172.21.15.38:0/2965639516 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f613c045810 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.098+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c07c350 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.101+0000 7f6143e00640 1 -- 172.21.15.38:0/2965639516 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f613c03b430 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.163+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f614c1a1160 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.166+0000 7f6143e00640 1 -- 172.21.15.38:0/2965639516 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f613c03b6a0 con 0x7f614c07de20 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.166+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 msgr2=0x7f614c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.166+0000 7f6151a00640 1 --2- 172.21.15.38:0/2965639516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c19d6c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f613c02a820 tx=0x7f613c030900 comp rx=0 tx=0).stop 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.167+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 shutdown_connections 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.167+0000 7f6151a00640 1 --2- 172.21.15.38:0/2965639516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f614c07de20 0x7f614c19d6c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.167+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 >> 172.21.15.38:0/2965639516 conn(0x7f614c102ce0 msgr2=0x7f614c103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:46.775 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.167+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 shutdown_connections 2024-09-12T12:14:46.776 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:46.167+0000 7f6151a00640 1 -- 172.21.15.38:0/2965639516 wait complete. 2024-09-12T12:14:46.776 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T12:14:46.804 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:14:46.804 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mgr... 2024-09-12T12:14:46.804 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T12:14:46.805 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T12:14:47.164 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.x 2024-09-12T12:14:47.164 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T12:14:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-726420ce-7100-11ef-bcea-c7b262605968.target.wants/ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-726420ce-7100-11ef-bcea-c7b262605968@.service. 2024-09-12T12:14:47.442 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:47 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2965639516' entity='client.admin' 2024-09-12T12:14:47.720 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:47 smithi038 systemd[1]: Starting Ceph mgr.x for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:14:48.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:47 smithi038 podman[31019]: 2024-09-12 12:14:47.659011557 +0000 UTC m=+0.027570416 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:14:48.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:47 smithi038 podman[31019]: 2024-09-12 12:14:47.765293889 +0000 UTC m=+0.133852747 container create ee7af3f1505d85eb5ac061c9dee8444bf6f559019dae3780f9275e9100170eea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T12:14:48.388 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:14:48.388 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-12T12:14:48.402 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:14:48.402 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-12T12:14:48.402 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-12T12:14:48.402 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T12:14:48.420 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:14:48.420 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-12T12:14:48.434 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:14:48.434 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-12T12:14:48.434 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-12T12:14:48.434 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T12:14:48.434 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr to start... 2024-09-12T12:14:48.434 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr... 2024-09-12T12:14:48.543 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 podman[31019]: 2024-09-12 12:14:48.268719851 +0000 UTC m=+0.637278709 container init ee7af3f1505d85eb5ac061c9dee8444bf6f559019dae3780f9275e9100170eea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T12:14:48.543 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 podman[31019]: 2024-09-12 12:14:48.276159493 +0000 UTC m=+0.644718365 container start ee7af3f1505d85eb5ac061c9dee8444bf6f559019dae3780f9275e9100170eea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:14:48.543 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 bash[31019]: ee7af3f1505d85eb5ac061c9dee8444bf6f559019dae3780f9275e9100170eea 2024-09-12T12:14:48.543 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 systemd[1]: Started Ceph mgr.x for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:14:48.544 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:48.459+0000 7f82d7609040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:14:48.544 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:48.542+0000 7f82d7609040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:14:48.827 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:48.743+0000 7f82d7609040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:14:48.827 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:48.826+0000 7f82d7609040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:14:49.101 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:49.012+0000 7f82d7609040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:14:49.421 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:49 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1336189177' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:14:49.422 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:49.199+0000 7f82d7609040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:14:49.690 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:49.592+0000 7f82d7609040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:14:49.691 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:49.666+0000 7f82d7609040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:14:49.697 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:49.708 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:14:49.708 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:14:49.708 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:49.709 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:14:49.710 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:14:49.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:14:39:913230+0000", 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:49.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:14:39.915642+0000", 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.968+0000 7f64e7800640 1 Processor -- start 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.968+0000 7f64e7800640 1 -- start start 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.968+0000 7f64e7800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.968+0000 7f64e7800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f64e010a260 con 0x7f64e0109890 2024-09-12T12:14:49.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.969+0000 7f64e4e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.969+0000 7f64e4e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e0109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40408/0 (socket says 172.21.15.38:40408) 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.969+0000 7f64e4e00640 1 -- 172.21.15.38:0/3761812741 learned_addr learned my addr 172.21.15.38:0/3761812741 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.969+0000 7f64e4e00640 1 -- 172.21.15.38:0/3761812741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e010a890 con 0x7f64e0109890 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.970+0000 7f64e4e00640 1 --2- 172.21.15.38:0/3761812741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e0109c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009820 tx=0x7f64d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f47ae7218ff2177 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.971+0000 7f64df400640 1 -- 172.21.15.38:0/3761812741 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64d4037070 con 0x7f64e0109890 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.971+0000 7f64df400640 1 -- 172.21.15.38:0/3761812741 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64d4032900 con 0x7f64e0109890 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.971+0000 7f64df400640 1 -- 172.21.15.38:0/3761812741 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64d4030850 con 0x7f64e0109890 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.972+0000 7f64e7800640 1 -- 172.21.15.38:0/3761812741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 msgr2=0x7f64e0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.972+0000 7f64e7800640 1 --2- 172.21.15.38:0/3761812741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e0109c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009820 tx=0x7f64d402a270 comp rx=0 tx=0).stop 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.972+0000 7f64e7800640 1 -- 172.21.15.38:0/3761812741 shutdown_connections 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.972+0000 7f64e7800640 1 --2- 172.21.15.38:0/3761812741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e0109c90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.972+0000 7f64e7800640 1 -- 172.21.15.38:0/3761812741 >> 172.21.15.38:0/3761812741 conn(0x7f64e007ccc0 msgr2=0x7f64e007d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:49.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.972+0000 7f64e7800640 1 -- 172.21.15.38:0/3761812741 shutdown_connections 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.972+0000 7f64e7800640 1 -- 172.21.15.38:0/3761812741 wait complete. 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.973+0000 7f64e7800640 1 Processor -- start 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.973+0000 7f64e7800640 1 -- start start 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.973+0000 7f64e7800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.973+0000 7f64e7800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f64e010dc40 con 0x7f64e0109890 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.973+0000 7f64e4e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.973+0000 7f64e4e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40412/0 (socket says 172.21.15.38:40412) 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.974+0000 7f64e4e00640 1 -- 172.21.15.38:0/1336189177 learned_addr learned my addr 172.21.15.38:0/1336189177 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.974+0000 7f64e4e00640 1 -- 172.21.15.38:0/1336189177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e019dc30 con 0x7f64e0109890 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.974+0000 7f64e4e00640 1 --2- 172.21.15.38:0/1336189177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e019d6f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097f0 tx=0x7f64d4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.975+0000 7f64dd600640 1 -- 172.21.15.38:0/1336189177 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64d4037040 con 0x7f64e0109890 2024-09-12T12:14:49.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.975+0000 7f64dd600640 1 -- 172.21.15.38:0/1336189177 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64d4040070 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.975+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e019dec0 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.975+0000 7f64dd600640 1 -- 172.21.15.38:0/1336189177 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64d403a390 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.975+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e01a0bb0 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.975+0000 7f64dd600640 1 -- 172.21.15.38:0/1336189177 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f64d403a630 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.975+0000 7f64dd600640 1 -- 172.21.15.38:0/1336189177 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f64d40459a0 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.976+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e0109c90 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:48.979+0000 7f64dd600640 1 -- 172.21.15.38:0/1336189177 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f64d4045460 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.045+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f64e01a0d80 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.045+0000 7f64dd600640 1 -- 172.21.15.38:0/1336189177 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f64d403b430 con 0x7f64e0109890 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.046+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 msgr2=0x7f64e019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.046+0000 7f64e7800640 1 --2- 172.21.15.38:0/1336189177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e019d6f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097f0 tx=0x7f64d4030d80 comp rx=0 tx=0).stop 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.046+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 shutdown_connections 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.046+0000 7f64e7800640 1 --2- 172.21.15.38:0/1336189177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e0109890 0x7f64e019d6f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:49.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.046+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 >> 172.21.15.38:0/1336189177 conn(0x7f64e007ccc0 msgr2=0x7f64e0107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:49.717 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.047+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 shutdown_connections 2024-09-12T12:14:49.717 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:49.047+0000 7f64e7800640 1 -- 172.21.15.38:0/1336189177 wait complete. 2024-09-12T12:14:49.717 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (1/15)... 2024-09-12T12:14:49.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:49.892+0000 7f82d7609040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:14:51.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:51.045+0000 7f82d7609040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:14:51.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:51.128+0000 7f82d7609040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:14:52.354 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:52.143+0000 7f82d7609040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:14:52.354 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:52.292+0000 7f82d7609040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:14:52.696 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2223205108' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:14:52.696 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:52.479+0000 7f82d7609040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:14:52.696 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:52.556+0000 7f82d7609040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:14:52.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:52.742+0000 7f82d7609040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:14:52.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:52.828+0000 7f82d7609040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:14:52.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:52.904+0000 7f82d7609040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:14:53.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:53.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:14:53.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:14:53.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:14:53.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:14:53.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:14:53.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:14:53.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:53.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:14:53.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:14:53.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:14:53.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:53.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:14:53.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:14:53.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:53.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-12T12:14:53.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:14:53.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:53.320 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:14:53.320 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:14:53.320 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:53.320 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:14:53.320 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:14:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:14:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:14:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:14:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:14:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:14:53.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:53.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:14:53.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:14:53.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:14:53.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:14:53.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:14:53.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:14:53.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:14:53.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:14:53.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:14:53.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:53.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:14:53.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:53.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:14:39:913230+0000", 2024-09-12T12:14:53.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:14:53.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:14:53.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:53.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:14:53.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T12:14:53.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:14:53.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:14:53.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:14:53.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:14:53.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:14:53.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:53.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:14:53.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:53.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:14:53.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:53.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:14:39.915642+0000", 2024-09-12T12:14:53.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:14:53.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:53.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:14:53.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:14:53.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.223+0000 7fb2f9800640 1 Processor -- start 2024-09-12T12:14:53.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.223+0000 7fb2f9800640 1 -- start start 2024-09-12T12:14:53.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.224+0000 7fb2f9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:53.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.224+0000 7fb2f9800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f410a260 con 0x7fb2f4109890 2024-09-12T12:14:53.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.224+0000 7fb2f2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:53.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.224+0000 7fb2f2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f4109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40426/0 (socket says 172.21.15.38:40426) 2024-09-12T12:14:53.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.224+0000 7fb2f2a00640 1 -- 172.21.15.38:0/4230143361 learned_addr learned my addr 172.21.15.38:0/4230143361 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:53.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.225+0000 7fb2f2a00640 1 -- 172.21.15.38:0/4230143361 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f410a890 con 0x7fb2f4109890 2024-09-12T12:14:53.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.226+0000 7fb2f2a00640 1 --2- 172.21.15.38:0/4230143361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f4109c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009820 tx=0x7fb2e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32da810883315d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:53.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.226+0000 7fb2f1600640 1 -- 172.21.15.38:0/4230143361 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4037070 con 0x7fb2f4109890 2024-09-12T12:14:53.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.226+0000 7fb2f1600640 1 -- 172.21.15.38:0/4230143361 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2e4032900 con 0x7fb2f4109890 2024-09-12T12:14:53.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.226+0000 7fb2f1600640 1 -- 172.21.15.38:0/4230143361 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4030850 con 0x7fb2f4109890 2024-09-12T12:14:53.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.227+0000 7fb2f9800640 1 -- 172.21.15.38:0/4230143361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 msgr2=0x7fb2f4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:53.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.227+0000 7fb2f9800640 1 --2- 172.21.15.38:0/4230143361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f4109c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009820 tx=0x7fb2e402a270 comp rx=0 tx=0).stop 2024-09-12T12:14:53.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.227+0000 7fb2f9800640 1 -- 172.21.15.38:0/4230143361 shutdown_connections 2024-09-12T12:14:53.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.227+0000 7fb2f9800640 1 --2- 172.21.15.38:0/4230143361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f4109c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.227+0000 7fb2f9800640 1 -- 172.21.15.38:0/4230143361 >> 172.21.15.38:0/4230143361 conn(0x7fb2f407ccc0 msgr2=0x7fb2f407d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:53.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.227+0000 7fb2f9800640 1 -- 172.21.15.38:0/4230143361 shutdown_connections 2024-09-12T12:14:53.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.227+0000 7fb2f9800640 1 -- 172.21.15.38:0/4230143361 wait complete. 2024-09-12T12:14:53.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.228+0000 7fb2f9800640 1 Processor -- start 2024-09-12T12:14:53.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.228+0000 7fb2f9800640 1 -- start start 2024-09-12T12:14:53.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.229+0000 7fb2f9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:53.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.229+0000 7fb2f9800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f410dc40 con 0x7fb2f4109890 2024-09-12T12:14:53.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.229+0000 7fb2f2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:53.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.229+0000 7fb2f2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f419d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40430/0 (socket says 172.21.15.38:40430) 2024-09-12T12:14:53.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.229+0000 7fb2f2a00640 1 -- 172.21.15.38:0/2223205108 learned_addr learned my addr 172.21.15.38:0/2223205108 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:53.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.229+0000 7fb2f2a00640 1 -- 172.21.15.38:0/2223205108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f419dc30 con 0x7fb2f4109890 2024-09-12T12:14:53.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.230+0000 7fb2f2a00640 1 --2- 172.21.15.38:0/2223205108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f419d6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009940 tx=0x7fb2e4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:53.334 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.230+0000 7fb2eb400640 1 -- 172.21.15.38:0/2223205108 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4042070 con 0x7fb2f4109890 2024-09-12T12:14:53.334 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.230+0000 7fb2eb400640 1 -- 172.21.15.38:0/2223205108 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2e40308c0 con 0x7fb2f4109890 2024-09-12T12:14:53.334 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.230+0000 7fb2eb400640 1 -- 172.21.15.38:0/2223205108 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4037040 con 0x7fb2f4109890 2024-09-12T12:14:53.334 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.230+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f419dec0 con 0x7fb2f4109890 2024-09-12T12:14:53.334 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.230+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f41a0bb0 con 0x7fb2f4109890 2024-09-12T12:14:53.335 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.230+0000 7fb2eb400640 1 -- 172.21.15.38:0/2223205108 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb2e4045070 con 0x7fb2f4109890 2024-09-12T12:14:53.335 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.231+0000 7fb2eb400640 1 -- 172.21.15.38:0/2223205108 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb2e4046d40 con 0x7fb2f4109890 2024-09-12T12:14:53.335 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.232+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f4109c90 con 0x7fb2f4109890 2024-09-12T12:14:53.335 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.236+0000 7fb2eb400640 1 -- 172.21.15.38:0/2223205108 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb2e40463b0 con 0x7fb2f4109890 2024-09-12T12:14:53.335 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.302+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb2f41a0e20 con 0x7fb2f4109890 2024-09-12T12:14:53.335 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.303+0000 7fb2eb400640 1 -- 172.21.15.38:0/2223205108 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb2e40327b0 con 0x7fb2f4109890 2024-09-12T12:14:53.336 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.304+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 msgr2=0x7fb2f419d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:53.336 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.304+0000 7fb2f9800640 1 --2- 172.21.15.38:0/2223205108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f419d6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009940 tx=0x7fb2e4032ce0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.336 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.304+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 shutdown_connections 2024-09-12T12:14:53.336 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.304+0000 7fb2f9800640 1 --2- 172.21.15.38:0/2223205108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f4109890 0x7fb2f419d6f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.336 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.304+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 >> 172.21.15.38:0/2223205108 conn(0x7fb2f407ccc0 msgr2=0x7fb2f4107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:53.337 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.304+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 shutdown_connections 2024-09-12T12:14:53.337 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:52.304+0000 7fb2f9800640 1 -- 172.21.15.38:0/2223205108 wait complete. 2024-09-12T12:14:53.337 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (2/15)... 2024-09-12T12:14:53.377 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:53.111+0000 7f82d7609040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:14:53.377 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:53.192+0000 7f82d7609040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:14:53.377 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:53.274+0000 7f82d7609040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:14:53.377 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:53.376+0000 7f82d7609040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:14:53.719 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:53.449+0000 7f82d7609040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:14:53.719 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:53.522+0000 7f82d7609040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:14:54.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:54.473+0000 7f82d7609040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:14:54.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: Activating manager daemon x 2024-09-12T12:14:54.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: mgrmap e2: x(active, starting, since 0.00931172s) 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: Manager daemon x is now available 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' 2024-09-12T12:14:54.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:54 smithi038 ceph-mon[30810]: from='mgr.14100 172.21.15.38:0/323616022' entity='mgr.x' 2024-09-12T12:14:56.663 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:56 smithi038 ceph-mon[30810]: mgrmap e3: x(active, since 1.01352s) 2024-09-12T12:14:56.663 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:56 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3007091509' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:14:56.672 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:56.672 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:14:56.673 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:14:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:14:56.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:14:56.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:14:39:913230+0000", 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:14:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:14:39.915642+0000", 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.780+0000 7f64cb400640 1 Processor -- start 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.780+0000 7f64cb400640 1 -- start start 2024-09-12T12:14:56.686 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.780+0000 7f64cb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c4107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.780+0000 7f64cb400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4107ee0 con 0x7f64c4107510 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.781+0000 7f64c8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c4107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.781+0000 7f64c8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c4107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46514/0 (socket says 172.21.15.38:46514) 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.781+0000 7f64c8a00640 1 -- 172.21.15.38:0/1688660010 learned_addr learned my addr 172.21.15.38:0/1688660010 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.781+0000 7f64c8a00640 1 -- 172.21.15.38:0/1688660010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c41086c0 con 0x7f64c4107510 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.782+0000 7f64c8a00640 1 --2- 172.21.15.38:0/1688660010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c4107910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009820 tx=0x7f64b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b29bc78b582c37e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.782+0000 7f64c3400640 1 -- 172.21.15.38:0/1688660010 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b8037070 con 0x7f64c4107510 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.782+0000 7f64c3400640 1 -- 172.21.15.38:0/1688660010 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64b8032900 con 0x7f64c4107510 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.782+0000 7f64c3400640 1 -- 172.21.15.38:0/1688660010 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b8030850 con 0x7f64c4107510 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.783+0000 7f64cb400640 1 -- 172.21.15.38:0/1688660010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 msgr2=0x7f64c4107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.783+0000 7f64cb400640 1 --2- 172.21.15.38:0/1688660010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c4107910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009820 tx=0x7f64b802a270 comp rx=0 tx=0).stop 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.783+0000 7f64cb400640 1 -- 172.21.15.38:0/1688660010 shutdown_connections 2024-09-12T12:14:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.783+0000 7f64cb400640 1 --2- 172.21.15.38:0/1688660010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c4107910 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.783+0000 7f64cb400640 1 -- 172.21.15.38:0/1688660010 >> 172.21.15.38:0/1688660010 conn(0x7f64c4102ce0 msgr2=0x7f64c4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.783+0000 7f64cb400640 1 -- 172.21.15.38:0/1688660010 shutdown_connections 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.783+0000 7f64cb400640 1 -- 172.21.15.38:0/1688660010 wait complete. 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.784+0000 7f64cb400640 1 Processor -- start 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.784+0000 7f64cb400640 1 -- start start 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.785+0000 7f64cb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.785+0000 7f64cb400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f64c410ba70 con 0x7f64c4107510 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.785+0000 7f64c8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.785+0000 7f64c8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46530/0 (socket says 172.21.15.38:46530) 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.785+0000 7f64c8a00640 1 -- 172.21.15.38:0/3007091509 learned_addr learned my addr 172.21.15.38:0/3007091509 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.785+0000 7f64c8a00640 1 -- 172.21.15.38:0/3007091509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c407e080 con 0x7f64c4107510 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.786+0000 7f64c8a00640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c407db40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009940 tx=0x7f64b8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.786+0000 7f64c1600640 1 -- 172.21.15.38:0/3007091509 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b8042070 con 0x7f64c4107510 2024-09-12T12:14:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.786+0000 7f64c1600640 1 -- 172.21.15.38:0/3007091509 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64b80308c0 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.786+0000 7f64c1600640 1 -- 172.21.15.38:0/3007091509 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b8037040 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.786+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c407c270 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.786+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c407c7b0 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.787+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c410bbf0 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.788+0000 7f64c1600640 1 -- 172.21.15.38:0/3007091509 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f64b8045070 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.788+0000 7f64c1600640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f64ac038e10 0x7f64ac03b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.788+0000 7f64c1600640 1 -- 172.21.15.38:0/3007091509 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f64b806c660 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.788+0000 7f64c3e00640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f64ac038e10 0x7f64ac03b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.789+0000 7f64c3e00640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f64ac038e10 0x7f64ac03b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64b00098c0 tx=0x7f64b0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:55.793+0000 7f64c1600640 1 -- 172.21.15.38:0/3007091509 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64b8031e70 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.045+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f64c407cb20 con 0x7f64c4107510 2024-09-12T12:14:56.689 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.046+0000 7f64c1600640 1 -- 172.21.15.38:0/3007091509 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f64b803cd90 con 0x7f64c4107510 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.048+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f64ac038e10 msgr2=0x7f64ac03b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.048+0000 7f64cb400640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f64ac038e10 0x7f64ac03b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64b00098c0 tx=0x7f64b0006db0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.048+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 msgr2=0x7f64c407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.048+0000 7f64cb400640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c407db40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009940 tx=0x7f64b8032ce0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.049+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 shutdown_connections 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.049+0000 7f64cb400640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f64ac038e10 0x7f64ac03b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.049+0000 7f64cb400640 1 --2- 172.21.15.38:0/3007091509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c4107510 0x7f64c407db40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.049+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 >> 172.21.15.38:0/3007091509 conn(0x7f64c4102ce0 msgr2=0x7f64c4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.049+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 shutdown_connections 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:56.049+0000 7f64cb400640 1 -- 172.21.15.38:0/3007091509 wait complete. 2024-09-12T12:14:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:mgr is available 2024-09-12T12:14:57.654 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:57 smithi038 ceph-mon[30810]: mgrmap e4: x(active, since 2s) 2024-09-12T12:14:57.654 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:57 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2067593496' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T12:14:57.967 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:57.967 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T12:14:57.967 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:14:57.967 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-12T12:14:57.968 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T12:14:57.968 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T12:14:57.968 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T12:14:57.968 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T12:14:57.968 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T12:14:57.969 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.133+0000 7ff676000640 1 Processor -- start 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.133+0000 7ff676000640 1 -- start start 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.133+0000 7ff676000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff670109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.133+0000 7ff676000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff67010a260 con 0x7ff670109890 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.133+0000 7ff674c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff670109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.133+0000 7ff674c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff670109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46534/0 (socket says 172.21.15.38:46534) 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.134+0000 7ff674c00640 1 -- 172.21.15.38:0/2622077144 learned_addr learned my addr 172.21.15.38:0/2622077144 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.134+0000 7ff674c00640 1 -- 172.21.15.38:0/2622077144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67010a6f0 con 0x7ff670109890 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.135+0000 7ff674c00640 1 --2- 172.21.15.38:0/2622077144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff670109c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff660009820 tx=0x7ff66002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3530cf03da0b9d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.135+0000 7ff66fe00640 1 -- 172.21.15.38:0/2622077144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff660037070 con 0x7ff670109890 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.135+0000 7ff66fe00640 1 -- 172.21.15.38:0/2622077144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff660032900 con 0x7ff670109890 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.135+0000 7ff66fe00640 1 -- 172.21.15.38:0/2622077144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff660030850 con 0x7ff670109890 2024-09-12T12:14:57.970 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.136+0000 7ff676000640 1 -- 172.21.15.38:0/2622077144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 msgr2=0x7ff670109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.136+0000 7ff676000640 1 --2- 172.21.15.38:0/2622077144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff670109c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff660009820 tx=0x7ff66002a270 comp rx=0 tx=0).stop 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.136+0000 7ff676000640 1 -- 172.21.15.38:0/2622077144 shutdown_connections 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.136+0000 7ff676000640 1 --2- 172.21.15.38:0/2622077144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff670109c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.136+0000 7ff676000640 1 -- 172.21.15.38:0/2622077144 >> 172.21.15.38:0/2622077144 conn(0x7ff67007cb10 msgr2=0x7ff67007cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.136+0000 7ff676000640 1 -- 172.21.15.38:0/2622077144 shutdown_connections 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.136+0000 7ff676000640 1 -- 172.21.15.38:0/2622077144 wait complete. 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.137+0000 7ff676000640 1 Processor -- start 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.137+0000 7ff676000640 1 -- start start 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.137+0000 7ff676000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff67019d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:57.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.137+0000 7ff676000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff67010daa0 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.137+0000 7ff674c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff67019d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff674c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff67019d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46536/0 (socket says 172.21.15.38:46536) 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff674c00640 1 -- 172.21.15.38:0/2067593496 learned_addr learned my addr 172.21.15.38:0/2067593496 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff674c00640 1 -- 172.21.15.38:0/2067593496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67019daa0 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff674c00640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff67019d560 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097f0 tx=0x7ff660030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff66e000640 1 -- 172.21.15.38:0/2067593496 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff660042070 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff66e000640 1 -- 172.21.15.38:0/2067593496 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff660032ca0 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff66e000640 1 -- 172.21.15.38:0/2067593496 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff660037040 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.138+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67019dd30 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.139+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6701a0a20 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.140+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67010dc20 con 0x7ff670109890 2024-09-12T12:14:57.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.140+0000 7ff66e000640 1 -- 172.21.15.38:0/2067593496 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ff660045070 con 0x7ff670109890 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.140+0000 7ff66e000640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7ff654038f70 0x7ff65403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.140+0000 7ff66e000640 1 -- 172.21.15.38:0/2067593496 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff66006be50 con 0x7ff670109890 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.140+0000 7ff667e00640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7ff654038f70 0x7ff65403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.141+0000 7ff667e00640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7ff654038f70 0x7ff65403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6580098c0 tx=0x7ff658006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.146+0000 7ff66e000640 1 -- 172.21.15.38:0/2067593496 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff66004b170 con 0x7ff670109890 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.332+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff670109d10 con 0x7ff670109890 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.333+0000 7ff66e000640 1 -- 172.21.15.38:0/2067593496 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7ff66006b870 con 0x7ff670109890 2024-09-12T12:14:57.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7ff654038f70 msgr2=0x7ff65403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7ff654038f70 0x7ff65403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6580098c0 tx=0x7ff658006db0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 msgr2=0x7ff67019d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff67019d560 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097f0 tx=0x7ff660030ec0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 shutdown_connections 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7ff654038f70 0x7ff65403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 --2- 172.21.15.38:0/2067593496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff670109890 0x7ff67019d560 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 >> 172.21.15.38:0/2067593496 conn(0x7ff67007cb10 msgr2=0x7ff6701075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 shutdown_connections 2024-09-12T12:14:57.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:57.336+0000 7ff676000640 1 -- 172.21.15.38:0/2067593496 wait complete. 2024-09-12T12:14:57.977 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling cephadm module... 2024-09-12T12:14:58.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:58 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/574995131' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T12:14:58.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: ignoring --setuser ceph since I am not root 2024-09-12T12:14:58.970 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: ignoring --setgroup ceph since I am not root 2024-09-12T12:14:59.249 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:58.986+0000 7f61db5d3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:14:59.249 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:59.059+0000 7f61db5d3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:14:59.249 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:59.248+0000 7f61db5d3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:14:59.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.451+0000 7fa2b5800640 1 Processor -- start 2024-09-12T12:14:59.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.451+0000 7fa2b5800640 1 -- start start 2024-09-12T12:14:59.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.451+0000 7fa2b5800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:59.393 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.451+0000 7fa2b5800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b010a260 con 0x7fa2b0109890 2024-09-12T12:14:59.393 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.451+0000 7fa2aea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:59.393 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.451+0000 7fa2aea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b0109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46552/0 (socket says 172.21.15.38:46552) 2024-09-12T12:14:59.393 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.451+0000 7fa2aea00640 1 -- 172.21.15.38:0/3521179006 learned_addr learned my addr 172.21.15.38:0/3521179006 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:59.393 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.452+0000 7fa2aea00640 1 -- 172.21.15.38:0/3521179006 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b010a890 con 0x7fa2b0109890 2024-09-12T12:14:59.393 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.453+0000 7fa2aea00640 1 --2- 172.21.15.38:0/3521179006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b0109c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009e80 tx=0x7fa2a002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682f0d55b16e4e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:59.393 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.453+0000 7fa2ae000640 1 -- 172.21.15.38:0/3521179006 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2a0036070 con 0x7fa2b0109890 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.453+0000 7fa2ae000640 1 -- 172.21.15.38:0/3521179006 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2a00318c0 con 0x7fa2b0109890 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.453+0000 7fa2ae000640 1 -- 172.21.15.38:0/3521179006 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2a0007ab0 con 0x7fa2b0109890 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.454+0000 7fa2b5800640 1 -- 172.21.15.38:0/3521179006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 msgr2=0x7fa2b0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.454+0000 7fa2b5800640 1 --2- 172.21.15.38:0/3521179006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b0109c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009e80 tx=0x7fa2a002a7a0 comp rx=0 tx=0).stop 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.454+0000 7fa2b5800640 1 -- 172.21.15.38:0/3521179006 shutdown_connections 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.454+0000 7fa2b5800640 1 --2- 172.21.15.38:0/3521179006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b0109c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.454+0000 7fa2b5800640 1 -- 172.21.15.38:0/3521179006 >> 172.21.15.38:0/3521179006 conn(0x7fa2b007ccc0 msgr2=0x7fa2b007d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.454+0000 7fa2b5800640 1 -- 172.21.15.38:0/3521179006 shutdown_connections 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.454+0000 7fa2b5800640 1 -- 172.21.15.38:0/3521179006 wait complete. 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.455+0000 7fa2b5800640 1 Processor -- start 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.455+0000 7fa2b5800640 1 -- start start 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.455+0000 7fa2b5800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:59.394 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.455+0000 7fa2b5800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b010dc40 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.456+0000 7fa2aea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.456+0000 7fa2aea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46568/0 (socket says 172.21.15.38:46568) 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.456+0000 7fa2aea00640 1 -- 172.21.15.38:0/574995131 learned_addr learned my addr 172.21.15.38:0/574995131 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.456+0000 7fa2aea00640 1 -- 172.21.15.38:0/574995131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b019dc30 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.456+0000 7fa2aea00640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b019d6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2a002acc0 tx=0x7fa2a0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.457+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2a0036050 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.457+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2a0037040 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.457+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b019dec0 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.457+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2a003d8c0 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.457+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b01a0bb0 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.458+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b0109c90 con 0x7fa2b0109890 2024-09-12T12:14:59.395 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.458+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa2a0044020 con 0x7fa2b0109890 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.459+0000 7fa2a7e00640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7fa294038f70 0x7fa29403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.459+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa2a0042020 con 0x7fa2b0109890 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.459+0000 7fa2a6000640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7fa294038f70 0x7fa29403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.459+0000 7fa2a6000640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7fa294038f70 0x7fa29403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa2980098c0 tx=0x7fa298006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.463+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2a004b020 con 0x7fa2b0109890 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.696+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fa2b01a1230 con 0x7fa2b0109890 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.753+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fa2a003bb30 con 0x7fa2b0109890 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.754+0000 7fa2a7e00640 1 -- 172.21.15.38:0/574995131 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fa2a003b610 con 0x7fa2b0109890 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.756+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7fa294038f70 msgr2=0x7fa29403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.756+0000 7fa2b5800640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7fa294038f70 0x7fa29403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa2980098c0 tx=0x7fa298006db0 comp rx=0 tx=0).stop 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.756+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 msgr2=0x7fa2b019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.756+0000 7fa2b5800640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b019d6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2a002acc0 tx=0x7fa2a0031ca0 comp rx=0 tx=0).stop 2024-09-12T12:14:59.396 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.757+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 shutdown_connections 2024-09-12T12:14:59.397 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.757+0000 7fa2b5800640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7fa294038f70 0x7fa29403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:59.397 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.757+0000 7fa2b5800640 1 --2- 172.21.15.38:0/574995131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2b0109890 0x7fa2b019d6f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:59.397 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.757+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 >> 172.21.15.38:0/574995131 conn(0x7fa2b007ccc0 msgr2=0x7fa2b0107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:59.397 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.757+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 shutdown_connections 2024-09-12T12:14:59.397 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:58.757+0000 7fa2b5800640 1 -- 172.21.15.38:0/574995131 wait complete. 2024-09-12T12:14:59.514 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:59.331+0000 7f61db5d3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:14:59.514 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:59.514+0000 7f61db5d3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:14:59.767 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:14:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:14:59.691+0000 7f61db5d3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:15:00.077 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:59 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/574995131' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T12:15:00.077 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:14:59 smithi038 ceph-mon[30810]: mgrmap e5: x(active, since 4s) 2024-09-12T12:15:00.375 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:00.076+0000 7f61db5d3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:15:00.375 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:00.152+0000 7f61db5d3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:15:00.376 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:00.375+0000 7f61db5d3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:15:00.833 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:15:00.833 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T12:15:00.833 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:15:00.833 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T12:15:00.833 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T12:15:00.833 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:15:00.833 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.919+0000 7f9a82600640 1 Processor -- start 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.919+0000 7f9a82600640 1 -- start start 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.920+0000 7f9a82600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.920+0000 7f9a82600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c10a260 con 0x7f9a7c109890 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.920+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.920+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46588/0 (socket says 172.21.15.38:46588) 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.920+0000 7f9a7b400640 1 -- 172.21.15.38:0/1122210087 learned_addr learned my addr 172.21.15.38:0/1122210087 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.921+0000 7f9a7b400640 1 -- 172.21.15.38:0/1122210087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c10a890 con 0x7f9a7c109890 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.922+0000 7f9a7b400640 1 --2- 172.21.15.38:0/1122210087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c109c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009820 tx=0x7f9a6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5605589b99e48e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.922+0000 7f9a7a000640 1 -- 172.21.15.38:0/1122210087 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a6c037070 con 0x7f9a7c109890 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.922+0000 7f9a7a000640 1 -- 172.21.15.38:0/1122210087 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a6c032900 con 0x7f9a7c109890 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.922+0000 7f9a7a000640 1 -- 172.21.15.38:0/1122210087 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a6c030850 con 0x7f9a7c109890 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.923+0000 7f9a82600640 1 -- 172.21.15.38:0/1122210087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 msgr2=0x7f9a7c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.923+0000 7f9a82600640 1 --2- 172.21.15.38:0/1122210087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c109c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009820 tx=0x7f9a6c02a270 comp rx=0 tx=0).stop 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.923+0000 7f9a82600640 1 -- 172.21.15.38:0/1122210087 shutdown_connections 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.923+0000 7f9a82600640 1 --2- 172.21.15.38:0/1122210087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c109c90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.923+0000 7f9a82600640 1 -- 172.21.15.38:0/1122210087 >> 172.21.15.38:0/1122210087 conn(0x7f9a7c07ccc0 msgr2=0x7f9a7c07d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.923+0000 7f9a82600640 1 -- 172.21.15.38:0/1122210087 shutdown_connections 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.923+0000 7f9a82600640 1 -- 172.21.15.38:0/1122210087 wait complete. 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.924+0000 7f9a82600640 1 Processor -- start 2024-09-12T12:15:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.924+0000 7f9a82600640 1 -- start start 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.924+0000 7f9a82600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.924+0000 7f9a82600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c10dc40 con 0x7f9a7c109890 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.925+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.925+0000 7f9a7b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46594/0 (socket says 172.21.15.38:46594) 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.925+0000 7f9a7b400640 1 -- 172.21.15.38:0/3918125441 learned_addr learned my addr 172.21.15.38:0/3918125441 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.925+0000 7f9a7b400640 1 -- 172.21.15.38:0/3918125441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c19dc30 con 0x7f9a7c109890 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.925+0000 7f9a7b400640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c19d6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0097f0 tx=0x7f9a6c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.925+0000 7f9a73e00640 1 -- 172.21.15.38:0/3918125441 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a6c037040 con 0x7f9a7c109890 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.926+0000 7f9a73e00640 1 -- 172.21.15.38:0/3918125441 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a6c040070 con 0x7f9a7c109890 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.926+0000 7f9a73e00640 1 -- 172.21.15.38:0/3918125441 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a6c03a390 con 0x7f9a7c109890 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.926+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c19dec0 con 0x7f9a7c109890 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.926+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c1a0bb0 con 0x7f9a7c109890 2024-09-12T12:15:00.836 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.927+0000 7f9a73e00640 1 -- 172.21.15.38:0/3918125441 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f9a6c032ab0 con 0x7f9a7c109890 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.927+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c109c90 con 0x7f9a7c109890 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.927+0000 7f9a73e00640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 0x7f9a6003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.927+0000 7f9a73e00640 1 -- 172.21.15.38:0/3918125441 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9a6c06c0f0 con 0x7f9a7c109890 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.927+0000 7f9a7aa00640 1 -- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 msgr2=0x7f9a6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3803178885 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.927+0000 7f9a7aa00640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 0x7f9a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:14:59.932+0000 7f9a73e00640 1 -- 172.21.15.38:0/3918125441 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a6c06be50 con 0x7f9a7c109890 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.128+0000 7f9a7aa00640 1 -- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 msgr2=0x7f9a6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3803178885 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.128+0000 7f9a7aa00640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 0x7f9a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.165+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9a7c1a12a0 con 0x7f9a7c109890 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.166+0000 7f9a73e00640 1 -- 172.21.15.38:0/3918125441 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f9a6c040ce0 con 0x7f9a7c109890 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 msgr2=0x7f9a6003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 0x7f9a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 msgr2=0x7f9a7c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c19d6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0097f0 tx=0x7f9a6c030d80 comp rx=0 tx=0).stop 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 shutdown_connections 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7f9a60038fc0 0x7f9a6003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 --2- 172.21.15.38:0/3918125441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a7c109890 0x7f9a7c19d6f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 >> 172.21.15.38:0/3918125441 conn(0x7f9a7c07ccc0 msgr2=0x7f9a7c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 shutdown_connections 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:00.168+0000 7f9a82600640 1 -- 172.21.15.38:0/3918125441 wait complete. 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2024-09-12T12:15:00.838 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 5... 2024-09-12T12:15:01.115 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:00 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3918125441' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T12:15:01.719 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:01.532+0000 7f61db5d3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:15:01.719 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:01.615+0000 7f61db5d3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:15:02.870 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:02.560+0000 7f61db5d3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:15:02.871 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:02.701+0000 7f61db5d3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:15:02.871 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:02.870+0000 7f61db5d3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:15:03.122 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:02.944+0000 7f61db5d3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:15:03.466 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.121+0000 7f61db5d3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:15:03.467 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.205+0000 7f61db5d3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:15:03.467 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.279+0000 7f61db5d3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:15:03.467 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.466+0000 7f61db5d3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:15:03.719 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.545+0000 7f61db5d3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:15:03.719 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.627+0000 7f61db5d3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:15:04.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.727+0000 7f61db5d3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:15:04.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.800+0000 7f61db5d3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:15:04.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:03.872+0000 7f61db5d3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:15:05.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:04.818+0000 7f61db5d3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:15:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: Active manager daemon x restarted 2024-09-12T12:15:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: Activating manager daemon x 2024-09-12T12:15:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T12:15:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: mgrmap e6: x(active, starting, since 0.00612151s) 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: Manager daemon x is now available 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: Found migration_current of "None". Setting to last migration. 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:04 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:06.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:05 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:15:06.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:05 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:15:06.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:05 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:06.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:05 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:06.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:05 smithi038 ceph-mon[30810]: mgrmap e7: x(active, since 1.01029s) 2024-09-12T12:15:06.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:05 smithi038 ceph-mon[30810]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T12:15:06.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:05 smithi038 ceph-mon[30810]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T12:15:06.496 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:15:06.496 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T12:15:06.496 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.373+0000 7faec0e00640 1 Processor -- start 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.373+0000 7faec0e00640 1 -- start start 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.373+0000 7faec0e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.373+0000 7faec0e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faebc107ee0 con 0x7faebc107510 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.374+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.374+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46606/0 (socket says 172.21.15.38:46606) 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.374+0000 7faeb9e00640 1 -- 172.21.15.38:0/654243922 learned_addr learned my addr 172.21.15.38:0/654243922 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.374+0000 7faeb9e00640 1 -- 172.21.15.38:0/654243922 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc1086c0 con 0x7faebc107510 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.375+0000 7faeb9e00640 1 --2- 172.21.15.38:0/654243922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc107910 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faeac009820 tx=0x7faeac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57b45a7ca4a8608 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.375+0000 7faeb8a00640 1 -- 172.21.15.38:0/654243922 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeac037070 con 0x7faebc107510 2024-09-12T12:15:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.375+0000 7faeb8a00640 1 -- 172.21.15.38:0/654243922 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faeac032900 con 0x7faebc107510 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.375+0000 7faeb8a00640 1 -- 172.21.15.38:0/654243922 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeac030850 con 0x7faebc107510 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.376+0000 7faec0e00640 1 -- 172.21.15.38:0/654243922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 msgr2=0x7faebc107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.376+0000 7faec0e00640 1 --2- 172.21.15.38:0/654243922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc107910 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faeac009820 tx=0x7faeac02a270 comp rx=0 tx=0).stop 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.376+0000 7faec0e00640 1 -- 172.21.15.38:0/654243922 shutdown_connections 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.376+0000 7faec0e00640 1 --2- 172.21.15.38:0/654243922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc107910 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.376+0000 7faec0e00640 1 -- 172.21.15.38:0/654243922 >> 172.21.15.38:0/654243922 conn(0x7faebc102ce0 msgr2=0x7faebc105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.376+0000 7faec0e00640 1 -- 172.21.15.38:0/654243922 shutdown_connections 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.376+0000 7faec0e00640 1 -- 172.21.15.38:0/654243922 wait complete. 2024-09-12T12:15:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.377+0000 7faec0e00640 1 Processor -- start 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.377+0000 7faec0e00640 1 -- start start 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.378+0000 7faec0e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc07db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.378+0000 7faec0e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faebc10ba70 con 0x7faebc107510 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.378+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc07db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.378+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc07db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46620/0 (socket says 172.21.15.38:46620) 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.378+0000 7faeb9e00640 1 -- 172.21.15.38:0/4076949772 learned_addr learned my addr 172.21.15.38:0/4076949772 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.378+0000 7faeb9e00640 1 -- 172.21.15.38:0/4076949772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc07e080 con 0x7faebc107510 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.378+0000 7faeb9e00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc07db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faeac0097f0 tx=0x7faeac030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.379+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeac037040 con 0x7faebc107510 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.379+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faeac040070 con 0x7faebc107510 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.379+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeac03a390 con 0x7faebc107510 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.379+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faebc07c270 con 0x7faebc107510 2024-09-12T12:15:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.379+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faebc07c750 con 0x7faebc107510 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.380+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7faeac032900 con 0x7faebc107510 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.380+0000 7faeb2a00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.380+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 --> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faea003bb40 con 0x7faea0038f70 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.380+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faeac06c100 con 0x7faebc107510 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.381+0000 7faeb9400640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 msgr2=0x7faea003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3803178885 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.381+0000 7faeb9400640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.582+0000 7faeb9400640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 msgr2=0x7faea003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3803178885 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.582+0000 7faeb9400640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.983+0000 7faeb9400640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 msgr2=0x7faea003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3803178885 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:01.983+0000 7faeb9400640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:02.784+0000 7faeb9400640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 msgr2=0x7faea003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3803178885 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:02.784+0000 7faeb9400640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T12:15:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:04.385+0000 7faeb9400640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 msgr2=0x7faea003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3803178885 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:04.385+0000 7faeb9400640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:04.824+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7faeac03a630 con 0x7faebc107510 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:04.824+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 msgr2=0x7faea003b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:04.824+0000 7faeb2a00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.828+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7faeac04bcf0 con 0x7faebc107510 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.828+0000 7faeb2a00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7faea003c8a0 0x7faea003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.828+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faeac049e50 con 0x7faea003c8a0 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.829+0000 7faeb9400640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7faea003c8a0 0x7faea003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.830+0000 7faeb9400640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7faea003c8a0 0x7faea003ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faea8003980 tx=0x7faea8009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.831+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7faeac049e50 con 0x7faea003c8a0 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.844+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7faebc10bbf0 con 0x7faea003c8a0 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.844+0000 7faeb2a00640 1 -- 172.21.15.38:0/4076949772 <== mgr.14118 v2:172.21.15.38:6800/2462218902 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7faebc10bbf0 con 0x7faea003c8a0 2024-09-12T12:15:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.844+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7faea003c8a0 msgr2=0x7faea003ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.844+0000 7faec0e00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7faea003c8a0 0x7faea003ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faea8003980 tx=0x7faea8009290 comp rx=0 tx=0).stop 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.844+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 msgr2=0x7faebc07db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.844+0000 7faec0e00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc07db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faeac0097f0 tx=0x7faeac030d80 comp rx=0 tx=0).stop 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.845+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 shutdown_connections 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.845+0000 7faec0e00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7faea003c8a0 0x7faea003ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.845+0000 7faec0e00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:6800/3803178885,v1:172.21.15.38:6801/3803178885] conn(0x7faea0038f70 0x7faea003b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.845+0000 7faec0e00640 1 --2- 172.21.15.38:0/4076949772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faebc107510 0x7faebc07db40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.845+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 >> 172.21.15.38:0/4076949772 conn(0x7faebc102ce0 msgr2=0x7faebc103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.845+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 shutdown_connections 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:05.845+0000 7faec0e00640 1 -- 172.21.15.38:0/4076949772 wait complete. 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 5 is available 2024-09-12T12:15:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:Setting orchestrator backend to cephadm... 2024-09-12T12:15:07.469 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:07.125+0000 7f6132e00640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:12:15:07] ENGINE Error in HTTPServer.serve 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: Traceback (most recent call last): 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self._connections.run(self.expiration_interval) 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self._run(expiration_interval) 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:15:07.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: s = self.context.wrap_socket( 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: return self.sslsocket_class._create( 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self.do_handshake() 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self._sslobj.do_handshake() 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:15:07.471 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:07.874 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.995+0000 7fd96f200640 1 Processor -- start 2024-09-12T12:15:07.874 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.996+0000 7fd96f200640 1 -- start start 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.996+0000 7fd96f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd968109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.996+0000 7fd96f200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd96810a260 con 0x7fd968109890 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.996+0000 7fd967e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd968109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.996+0000 7fd967e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd968109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51046/0 (socket says 172.21.15.38:51046) 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.996+0000 7fd967e00640 1 -- 172.21.15.38:0/1631690761 learned_addr learned my addr 172.21.15.38:0/1631690761 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.997+0000 7fd967e00640 1 -- 172.21.15.38:0/1631690761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96810a890 con 0x7fd968109890 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd967e00640 1 --2- 172.21.15.38:0/1631690761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd968109c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd958009820 tx=0x7fd95802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c122a6048efadc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd967400640 1 -- 172.21.15.38:0/1631690761 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd958037070 con 0x7fd968109890 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd967400640 1 -- 172.21.15.38:0/1631690761 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd958032900 con 0x7fd968109890 2024-09-12T12:15:07.875 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd967400640 1 -- 172.21.15.38:0/1631690761 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd958030850 con 0x7fd968109890 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd96f200640 1 -- 172.21.15.38:0/1631690761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 msgr2=0x7fd968109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd96f200640 1 --2- 172.21.15.38:0/1631690761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd968109c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd958009820 tx=0x7fd95802a270 comp rx=0 tx=0).stop 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd96f200640 1 -- 172.21.15.38:0/1631690761 shutdown_connections 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd96f200640 1 --2- 172.21.15.38:0/1631690761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd968109c90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd96f200640 1 -- 172.21.15.38:0/1631690761 >> 172.21.15.38:0/1631690761 conn(0x7fd96807ccc0 msgr2=0x7fd96807d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd96f200640 1 -- 172.21.15.38:0/1631690761 shutdown_connections 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:06.999+0000 7fd96f200640 1 -- 172.21.15.38:0/1631690761 wait complete. 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.000+0000 7fd96f200640 1 Processor -- start 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.000+0000 7fd96f200640 1 -- start start 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.000+0000 7fd96f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd96819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:07.876 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.000+0000 7fd96f200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd96810dc40 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.001+0000 7fd967e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd96819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.001+0000 7fd967e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd96819d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51050/0 (socket says 172.21.15.38:51050) 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.001+0000 7fd967e00640 1 -- 172.21.15.38:0/3981400600 learned_addr learned my addr 172.21.15.38:0/3981400600 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.001+0000 7fd967e00640 1 -- 172.21.15.38:0/3981400600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96819dc30 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.001+0000 7fd967e00640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd96819d6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097f0 tx=0x7fd958030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.002+0000 7fd965600640 1 -- 172.21.15.38:0/3981400600 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd958037040 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.002+0000 7fd965600640 1 -- 172.21.15.38:0/3981400600 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd958040070 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.002+0000 7fd965600640 1 -- 172.21.15.38:0/3981400600 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95803a390 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.002+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96819dec0 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.002+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9681a0bb0 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.003+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd968109c90 con 0x7fd968109890 2024-09-12T12:15:07.877 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.003+0000 7fd965600640 1 -- 172.21.15.38:0/3981400600 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd95803b430 con 0x7fd968109890 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.004+0000 7fd965600640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fd94c038f70 0x7fd94c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.004+0000 7fd965600640 1 -- 172.21.15.38:0/3981400600 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd95806c530 con 0x7fd968109890 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.005+0000 7fd95f400640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fd94c038f70 0x7fd94c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.005+0000 7fd95f400640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fd94c038f70 0x7fd94c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd9500098c0 tx=0x7fd950006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.014+0000 7fd965600640 1 -- 172.21.15.38:0/3981400600 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd95806bec0 con 0x7fd968109890 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.215+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fd968107c60 con 0x7fd94c038f70 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.223+0000 7fd965600640 1 -- 172.21.15.38:0/3981400600 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd968107c60 con 0x7fd94c038f70 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fd94c038f70 msgr2=0x7fd94c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fd94c038f70 0x7fd94c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd9500098c0 tx=0x7fd950006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 msgr2=0x7fd96819d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.878 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd96819d6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097f0 tx=0x7fd958030d80 comp rx=0 tx=0).stop 2024-09-12T12:15:07.879 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 shutdown_connections 2024-09-12T12:15:07.879 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fd94c038f70 0x7fd94c03b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.879 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 --2- 172.21.15.38:0/3981400600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd968109890 0x7fd96819d6f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.879 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.225+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 >> 172.21.15.38:0/3981400600 conn(0x7fd96807ccc0 msgr2=0x7fd968107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:07.879 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.226+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 shutdown_connections 2024-09-12T12:15:07.879 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:07.226+0000 7fd96f200640 1 -- 172.21.15.38:0/3981400600 wait complete. 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: mgrmap e8: x(active, since 2s) 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:06] ENGINE Bus STARTING 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:06] ENGINE Serving on http://172.21.15.38:8765 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:07] ENGINE Serving on https://172.21.15.38:7150 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:07] ENGINE Bus STARTED 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:07] ENGINE Error in HTTPServer.serve 2024-09-12T12:15:08.126 INFO:journalctl@ceph.mon.a.smithi038.stdout: Traceback (most recent call last): 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._run(expiration_interval) 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: s = self.context.wrap_socket( 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: return self.sslsocket_class._create( 2024-09-12T12:15:08.127 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:15:08.128 INFO:journalctl@ceph.mon.a.smithi038.stdout: self.do_handshake() 2024-09-12T12:15:08.128 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:15:08.128 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._sslobj.do_handshake() 2024-09-12T12:15:08.128 INFO:journalctl@ceph.mon.a.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:15:08.128 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:08.128 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:08.128 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:07 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:09.132 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:08 smithi038 ceph-mon[30810]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:09.526 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T12:15:09.526 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.361+0000 7f13cbe00640 1 Processor -- start 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.361+0000 7f13cbe00640 1 -- start start 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.361+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc1055c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.361+0000 7f13cbe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc105b90 con 0x7f13cc1051c0 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.361+0000 7f13caa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc1055c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.361+0000 7f13caa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc1055c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51052/0 (socket says 172.21.15.38:51052) 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.361+0000 7f13caa00640 1 -- 172.21.15.38:0/1472911317 learned_addr learned my addr 172.21.15.38:0/1472911317 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.362+0000 7f13caa00640 1 -- 172.21.15.38:0/1472911317 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc106320 con 0x7f13cc1051c0 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.363+0000 7f13caa00640 1 --2- 172.21.15.38:0/1472911317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc1055c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009e80 tx=0x7f13bc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c89ed319440ee72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.363+0000 7f13ca000640 1 -- 172.21.15.38:0/1472911317 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc036070 con 0x7f13cc1051c0 2024-09-12T12:15:09.527 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.363+0000 7f13ca000640 1 -- 172.21.15.38:0/1472911317 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13bc0318c0 con 0x7f13cc1051c0 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.363+0000 7f13ca000640 1 -- 172.21.15.38:0/1472911317 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc007ab0 con 0x7f13cc1051c0 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.364+0000 7f13cbe00640 1 -- 172.21.15.38:0/1472911317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 msgr2=0x7f13cc1055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.364+0000 7f13cbe00640 1 --2- 172.21.15.38:0/1472911317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc1055c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009e80 tx=0x7f13bc02a7a0 comp rx=0 tx=0).stop 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.364+0000 7f13cbe00640 1 -- 172.21.15.38:0/1472911317 shutdown_connections 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.364+0000 7f13cbe00640 1 --2- 172.21.15.38:0/1472911317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc1055c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.364+0000 7f13cbe00640 1 -- 172.21.15.38:0/1472911317 >> 172.21.15.38:0/1472911317 conn(0x7f13cc100d60 msgr2=0x7f13cc103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.364+0000 7f13cbe00640 1 -- 172.21.15.38:0/1472911317 shutdown_connections 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.364+0000 7f13cbe00640 1 -- 172.21.15.38:0/1472911317 wait complete. 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.365+0000 7f13cbe00640 1 Processor -- start 2024-09-12T12:15:09.528 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.365+0000 7f13cbe00640 1 -- start start 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.365+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc19d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.365+0000 7f13cbe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1076e0 con 0x7f13cc1051c0 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13caa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc19d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13caa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc19d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51068/0 (socket says 172.21.15.38:51068) 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13caa00640 1 -- 172.21.15.38:0/1434564639 learned_addr learned my addr 172.21.15.38:0/1434564639 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13caa00640 1 -- 172.21.15.38:0/1434564639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc19da70 con 0x7f13cc1051c0 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13caa00640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc19d530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13bc02acc0 tx=0x7f13bc031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:09.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13c3e00640 1 -- 172.21.15.38:0/1434564639 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc036050 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13c3e00640 1 -- 172.21.15.38:0/1434564639 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13bc037040 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.366+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc19dd00 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.367+0000 7f13c3e00640 1 -- 172.21.15.38:0/1434564639 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc03d920 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.367+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc1a09f0 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.368+0000 7f13c3e00640 1 -- 172.21.15.38:0/1434564639 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f13bc044020 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.368+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13cc1055c0 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.368+0000 7f13c3e00640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f13b0038f70 0x7f13b003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.368+0000 7f13c3e00640 1 -- 172.21.15.38:0/1434564639 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f13bc042020 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.368+0000 7f13c2000640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f13b0038f70 0x7f13b003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.369+0000 7f13c2000640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f13b0038f70 0x7f13b003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13b40098c0 tx=0x7f13b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.373+0000 7f13c3e00640 1 -- 172.21.15.38:0/1434564639 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13bc04b020 con 0x7f13cc1051c0 2024-09-12T12:15:09.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.559+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f13cc062630 con 0x7f13b0038f70 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.560+0000 7f13c3e00640 1 -- 172.21.15.38:0/1434564639 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f13cc062630 con 0x7f13b0038f70 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f13b0038f70 msgr2=0x7f13b003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f13b0038f70 0x7f13b003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13b40098c0 tx=0x7f13b4006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 msgr2=0x7f13cc19d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc19d530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13bc02acc0 tx=0x7f13bc031ca0 comp rx=0 tx=0).stop 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 shutdown_connections 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f13b0038f70 0x7f13b003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 --2- 172.21.15.38:0/1434564639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13cc1051c0 0x7f13cc19d530 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.562+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 >> 172.21.15.38:0/1434564639 conn(0x7f13cc100d60 msgr2=0x7f13cc193b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.563+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 shutdown_connections 2024-09-12T12:15:09.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:08.563+0000 7f13cbe00640 1 -- 172.21.15.38:0/1434564639 wait complete. 2024-09-12T12:15:09.532 INFO:teuthology.orchestra.run.smithi038.stdout:Generating ssh key... 2024-09-12T12:15:10.662 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: Generating public/private rsa key pair. 2024-09-12T12:15:10.662 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: Your identification has been saved in /tmp/tmpdhuem01z/key 2024-09-12T12:15:10.663 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: Your public key has been saved in /tmp/tmpdhuem01z/key.pub 2024-09-12T12:15:10.663 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: The key fingerprint is: 2024-09-12T12:15:10.663 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: SHA256:eEclqbo4vs0E2F+J46ngdOz6qct95aqJqZ+xPKvKkVo ceph-726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:15:10.663 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: The key's randomart image is: 2024-09-12T12:15:10.663 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: +---[RSA 3072]----+ 2024-09-12T12:15:10.663 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: | ... | 2024-09-12T12:15:10.664 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: | .o | 2024-09-12T12:15:10.664 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: | .. | 2024-09-12T12:15:10.664 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: | o o.o | 2024-09-12T12:15:10.664 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: | . o +.S . | 2024-09-12T12:15:10.664 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: | .. +.=.. | 2024-09-12T12:15:10.664 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: | oE o.=+ | 2024-09-12T12:15:10.665 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: |o*o@oBo . | 2024-09-12T12:15:10.665 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: |*=#O@=+. | 2024-09-12T12:15:10.665 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: +----[SHA256]-----+ 2024-09-12T12:15:11.005 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.049+0000 7f10d1200640 1 Processor -- start 2024-09-12T12:15:11.006 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.049+0000 7f10d1200640 1 -- start start 2024-09-12T12:15:11.006 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.050+0000 7f10d1200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:11.006 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.050+0000 7f10d1200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc107ee0 con 0x7f10cc107510 2024-09-12T12:15:11.006 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.050+0000 7f10c9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:11.006 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.050+0000 7f10c9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51074/0 (socket says 172.21.15.38:51074) 2024-09-12T12:15:11.006 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.050+0000 7f10c9e00640 1 -- 172.21.15.38:0/3657280350 learned_addr learned my addr 172.21.15.38:0/3657280350 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:11.006 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.051+0000 7f10c9e00640 1 -- 172.21.15.38:0/3657280350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc1086c0 con 0x7f10cc107510 2024-09-12T12:15:11.007 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.052+0000 7f10c9e00640 1 --2- 172.21.15.38:0/3657280350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc107910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009820 tx=0x7f10bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efc8fca5296e388 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:11.007 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.052+0000 7f10c9400640 1 -- 172.21.15.38:0/3657280350 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10bc037070 con 0x7f10cc107510 2024-09-12T12:15:11.007 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.052+0000 7f10c9400640 1 -- 172.21.15.38:0/3657280350 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10bc032900 con 0x7f10cc107510 2024-09-12T12:15:11.007 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.052+0000 7f10c9400640 1 -- 172.21.15.38:0/3657280350 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10bc030850 con 0x7f10cc107510 2024-09-12T12:15:11.007 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.052+0000 7f10d1200640 1 -- 172.21.15.38:0/3657280350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 msgr2=0x7f10cc107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:11.007 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.052+0000 7f10d1200640 1 --2- 172.21.15.38:0/3657280350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc107910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009820 tx=0x7f10bc02a270 comp rx=0 tx=0).stop 2024-09-12T12:15:11.007 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.053+0000 7f10d1200640 1 -- 172.21.15.38:0/3657280350 shutdown_connections 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.053+0000 7f10d1200640 1 --2- 172.21.15.38:0/3657280350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc107910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.053+0000 7f10d1200640 1 -- 172.21.15.38:0/3657280350 >> 172.21.15.38:0/3657280350 conn(0x7f10cc102ce0 msgr2=0x7f10cc105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.053+0000 7f10d1200640 1 -- 172.21.15.38:0/3657280350 shutdown_connections 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.053+0000 7f10d1200640 1 -- 172.21.15.38:0/3657280350 wait complete. 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.054+0000 7f10d1200640 1 Processor -- start 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.054+0000 7f10d1200640 1 -- start start 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.054+0000 7f10d1200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:11.008 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.054+0000 7f10d1200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc10ba70 con 0x7f10cc107510 2024-09-12T12:15:11.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.054+0000 7f10c9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:11.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.054+0000 7f10c9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc19b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51076/0 (socket says 172.21.15.38:51076) 2024-09-12T12:15:11.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.054+0000 7f10c9e00640 1 -- 172.21.15.38:0/278375593 learned_addr learned my addr 172.21.15.38:0/278375593 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:11.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.055+0000 7f10c9e00640 1 -- 172.21.15.38:0/278375593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc19ba20 con 0x7f10cc107510 2024-09-12T12:15:11.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.055+0000 7f10c9e00640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc19b4e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0097f0 tx=0x7f10bc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:11.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.055+0000 7f10c2a00640 1 -- 172.21.15.38:0/278375593 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10bc037040 con 0x7f10cc107510 2024-09-12T12:15:11.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.055+0000 7f10c2a00640 1 -- 172.21.15.38:0/278375593 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10bc040070 con 0x7f10cc107510 2024-09-12T12:15:11.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.055+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc19bcb0 con 0x7f10cc107510 2024-09-12T12:15:11.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.055+0000 7f10c2a00640 1 -- 172.21.15.38:0/278375593 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10bc03a390 con 0x7f10cc107510 2024-09-12T12:15:11.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.055+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc19e9a0 con 0x7f10cc107510 2024-09-12T12:15:11.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.056+0000 7f10c2a00640 1 -- 172.21.15.38:0/278375593 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f10bc03b430 con 0x7f10cc107510 2024-09-12T12:15:11.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.056+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10cc107990 con 0x7f10cc107510 2024-09-12T12:15:11.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.057+0000 7f10c2a00640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f10b0038fc0 0x7f10b003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:11.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.057+0000 7f10c2a00640 1 -- 172.21.15.38:0/278375593 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f10bc06c4e0 con 0x7f10cc107510 2024-09-12T12:15:11.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.057+0000 7f10c3e00640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f10b0038fc0 0x7f10b003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:11.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.058+0000 7f10c3e00640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f10b0038fc0 0x7f10b003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10b40098c0 tx=0x7f10b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:11.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.062+0000 7f10c2a00640 1 -- 172.21.15.38:0/278375593 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10bc06be30 con 0x7f10cc107510 2024-09-12T12:15:11.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.247+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f10cc103f30 con 0x7f10b0038fc0 2024-09-12T12:15:11.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.342+0000 7f10c2a00640 1 -- 172.21.15.38:0/278375593 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f10cc103f30 con 0x7f10b0038fc0 2024-09-12T12:15:11.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f10b0038fc0 msgr2=0x7f10b003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:11.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f10b0038fc0 0x7f10b003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10b40098c0 tx=0x7f10b4006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:11.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 msgr2=0x7f10cc19b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:11.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc19b4e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0097f0 tx=0x7f10bc030d80 comp rx=0 tx=0).stop 2024-09-12T12:15:11.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 shutdown_connections 2024-09-12T12:15:11.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f10b0038fc0 0x7f10b003b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:11.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 --2- 172.21.15.38:0/278375593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10cc107510 0x7f10cc19b4e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:11.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 >> 172.21.15.38:0/278375593 conn(0x7f10cc102ce0 msgr2=0x7f10cc103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:11.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 shutdown_connections 2024-09-12T12:15:11.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:10.345+0000 7f10d1200640 1 -- 172.21.15.38:0/278375593 wait complete. 2024-09-12T12:15:11.679 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:11 smithi038 ceph-mon[30810]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:11.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:11 smithi038 ceph-mon[30810]: Generating ssh key... 2024-09-12T12:15:11.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:11 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:11.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:11 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:12.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR4vEyRGxc49cCav8mzwoEXFWE+hgSQTJLX5sPqaIelbn98Atk4zvWzLGIrAezbpwFVnbqPcSeMRpZATrtiapu2D83rBEeGyQ2oN68+T8RhBfj/RGk5a0x8cfLle8QzaU6XskInHwpgbHR96pnShF9AMmXR+j51oJ79OyQYPBub4/hnDfqj+AsAV02hA0/k6vpiNyCHW5l7PPKX9jH4MIKCADm1FEEwodQMH7/nLydvoqR2rc691zMEvg2lJpxC5BKbrl/GcSuxmjfyL1CVock6iR7BSre88XGDKkAQOJI2HHQTdGEoTV3pqH/mxHYsv03m17h/kydtGDN2kAXT18mu3GpB7rvsK0uUk1jjDwy2Jy9eaMEodbKVO+ftzIDp9u1DTXJMiLt7iDOSIc3mhQGoU2c+4l5FjbtwnvX68Yh2dHWSJJxw+/fnqQcz/1u39xAB2EYtJOQzm6hmOgI2MdnAxWtYQ1HTycAeJtJK0BLs849o+/aRVPqbYCXILsqpV8= ceph-726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:15:12.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.481+0000 7fede6800640 1 Processor -- start 2024-09-12T12:15:12.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.481+0000 7fede6800640 1 -- start start 2024-09-12T12:15:12.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.482+0000 7fede6800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.482+0000 7fede6800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fede007c8c0 con 0x7fede007de40 2024-09-12T12:15:12.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.482+0000 7feddf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.322 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.482+0000 7feddf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51090/0 (socket says 172.21.15.38:51090) 2024-09-12T12:15:12.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.482+0000 7feddf400640 1 -- 172.21.15.38:0/2360136078 learned_addr learned my addr 172.21.15.38:0/2360136078 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:12.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.482+0000 7feddf400640 1 -- 172.21.15.38:0/2360136078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede007ca40 con 0x7fede007de40 2024-09-12T12:15:12.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.483+0000 7feddf400640 1 --2- 172.21.15.38:0/2360136078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede007c2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009820 tx=0x7fedd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffbd78d1e1a19dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.323 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7feddea00640 1 -- 172.21.15.38:0/2360136078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd0037070 con 0x7fede007de40 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7feddea00640 1 -- 172.21.15.38:0/2360136078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedd0032900 con 0x7fede007de40 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7feddea00640 1 -- 172.21.15.38:0/2360136078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd0030850 con 0x7fede007de40 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7fede6800640 1 -- 172.21.15.38:0/2360136078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 msgr2=0x7fede007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7fede6800640 1 --2- 172.21.15.38:0/2360136078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede007c2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009820 tx=0x7fedd002a270 comp rx=0 tx=0).stop 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7fede6800640 1 -- 172.21.15.38:0/2360136078 shutdown_connections 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7fede6800640 1 --2- 172.21.15.38:0/2360136078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede007c2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7fede6800640 1 -- 172.21.15.38:0/2360136078 >> 172.21.15.38:0/2360136078 conn(0x7fede0102ce0 msgr2=0x7fede0105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7fede6800640 1 -- 172.21.15.38:0/2360136078 shutdown_connections 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.484+0000 7fede6800640 1 -- 172.21.15.38:0/2360136078 wait complete. 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.485+0000 7fede6800640 1 Processor -- start 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.486+0000 7fede6800640 1 -- start start 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.486+0000 7fede6800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.324 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.486+0000 7fede6800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fede010db00 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.486+0000 7feddf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.486+0000 7feddf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51094/0 (socket says 172.21.15.38:51094) 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.486+0000 7feddf400640 1 -- 172.21.15.38:0/2282426288 learned_addr learned my addr 172.21.15.38:0/2282426288 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.486+0000 7feddf400640 1 -- 172.21.15.38:0/2282426288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede019dbd0 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.487+0000 7feddf400640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede019d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedd0032ce0 tx=0x7fedd0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.487+0000 7feddcc00640 1 -- 172.21.15.38:0/2282426288 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd0042070 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.487+0000 7feddcc00640 1 -- 172.21.15.38:0/2282426288 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedd00308c0 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.487+0000 7feddcc00640 1 -- 172.21.15.38:0/2282426288 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd0037040 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.487+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede019de60 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.487+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede01a0b50 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.488+0000 7feddcc00640 1 -- 172.21.15.38:0/2282426288 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fedd0045070 con 0x7fede007de40 2024-09-12T12:15:12.325 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.488+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede007c370 con 0x7fede007de40 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.489+0000 7feddcc00640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fedc4038fc0 0x7fedc403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.489+0000 7feddcc00640 1 -- 172.21.15.38:0/2282426288 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fedd006c090 con 0x7fede007de40 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.489+0000 7fedd7e00640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fedc4038fc0 0x7fedc403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.490+0000 7fedd7e00640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fedc4038fc0 0x7fedc403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fedc80098c0 tx=0x7fedc8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.494+0000 7feddcc00640 1 -- 172.21.15.38:0/2282426288 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fedd004b170 con 0x7fede007de40 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.680+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fede0103f60 con 0x7fedc4038fc0 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.681+0000 7feddcc00640 1 -- 172.21.15.38:0/2282426288 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fede0103f60 con 0x7fedc4038fc0 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fedc4038fc0 msgr2=0x7fedc403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fedc4038fc0 0x7fedc403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fedc80098c0 tx=0x7fedc8006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 msgr2=0x7fede019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede019d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedd0032ce0 tx=0x7fedd0032d10 comp rx=0 tx=0).stop 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 shutdown_connections 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fedc4038fc0 0x7fedc403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 --2- 172.21.15.38:0/2282426288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fede007de40 0x7fede019d690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 >> 172.21.15.38:0/2282426288 conn(0x7fede0102ce0 msgr2=0x7fede0103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 shutdown_connections 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:11.683+0000 7fede6800640 1 -- 172.21.15.38:0/2282426288 wait complete. 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:15:12.327 INFO:teuthology.orchestra.run.smithi038.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T12:15:12.328 INFO:teuthology.orchestra.run.smithi038.stdout:Adding host smithi038... 2024-09-12T12:15:12.579 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:12 smithi038 ceph-mon[30810]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:14.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:13 smithi038 ceph-mon[30810]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi038", "addr": "172.21.15.38", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:15.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:14 smithi038 ceph-mon[30810]: Deploying cephadm binary to smithi038 2024-09-12T12:15:18.236 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Added host 'smithi038' with addr '172.21.15.38' 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.815+0000 7f6357600640 1 Processor -- start 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.815+0000 7f6357600640 1 -- start start 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.815+0000 7f6357600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f6350107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.815+0000 7f6357600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6350107ee0 con 0x7f6350107510 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.816+0000 7f6354c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f6350107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.816+0000 7f6354c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f6350107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51108/0 (socket says 172.21.15.38:51108) 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.816+0000 7f6354c00640 1 -- 172.21.15.38:0/3795195445 learned_addr learned my addr 172.21.15.38:0/3795195445 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.816+0000 7f6354c00640 1 -- 172.21.15.38:0/3795195445 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63501086c0 con 0x7f6350107510 2024-09-12T12:15:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.817+0000 7f6354c00640 1 --2- 172.21.15.38:0/3795195445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f6350107910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6344009820 tx=0x7f634402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a047bb5a899e2942 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f634f400640 1 -- 172.21.15.38:0/3795195445 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6344037070 con 0x7f6350107510 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f634f400640 1 -- 172.21.15.38:0/3795195445 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6344032900 con 0x7f6350107510 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f634f400640 1 -- 172.21.15.38:0/3795195445 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6344030850 con 0x7f6350107510 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f6357600640 1 -- 172.21.15.38:0/3795195445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 msgr2=0x7f6350107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f6357600640 1 --2- 172.21.15.38:0/3795195445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f6350107910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6344009820 tx=0x7f634402a270 comp rx=0 tx=0).stop 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f6357600640 1 -- 172.21.15.38:0/3795195445 shutdown_connections 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f6357600640 1 --2- 172.21.15.38:0/3795195445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f6350107910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f6357600640 1 -- 172.21.15.38:0/3795195445 >> 172.21.15.38:0/3795195445 conn(0x7f6350102ce0 msgr2=0x7f6350105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f6357600640 1 -- 172.21.15.38:0/3795195445 shutdown_connections 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.818+0000 7f6357600640 1 -- 172.21.15.38:0/3795195445 wait complete. 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.819+0000 7f6357600640 1 Processor -- start 2024-09-12T12:15:18.238 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.819+0000 7f6357600640 1 -- start start 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.820+0000 7f6357600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f635019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.820+0000 7f6357600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f635010ba70 con 0x7f6350107510 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.820+0000 7f6354c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f635019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.820+0000 7f6354c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f635019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51124/0 (socket says 172.21.15.38:51124) 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.820+0000 7f6354c00640 1 -- 172.21.15.38:0/3748500450 learned_addr learned my addr 172.21.15.38:0/3748500450 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.820+0000 7f6354c00640 1 -- 172.21.15.38:0/3748500450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635019ba20 con 0x7f6350107510 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.821+0000 7f6354c00640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f635019b4e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f63440097f0 tx=0x7f6344030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.821+0000 7f634d600640 1 -- 172.21.15.38:0/3748500450 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6344037040 con 0x7f6350107510 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.821+0000 7f634d600640 1 -- 172.21.15.38:0/3748500450 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6344040070 con 0x7f6350107510 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.821+0000 7f634d600640 1 -- 172.21.15.38:0/3748500450 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634403a390 con 0x7f6350107510 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.821+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635019bcb0 con 0x7f6350107510 2024-09-12T12:15:18.239 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.821+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635019e9a0 con 0x7f6350107510 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.822+0000 7f634d600640 1 -- 172.21.15.38:0/3748500450 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6344032900 con 0x7f6350107510 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.822+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6350107990 con 0x7f6350107510 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.823+0000 7f634d600640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6338038fc0 0x7f633803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.823+0000 7f634d600640 1 -- 172.21.15.38:0/3748500450 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f634406c500 con 0x7f6350107510 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.823+0000 7f634fe00640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6338038fc0 0x7f633803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.824+0000 7f634fe00640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6338038fc0 0x7f633803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f633c0098c0 tx=0x7f633c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:12.828+0000 7f634d600640 1 -- 172.21.15.38:0/3748500450 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f634406be50 con 0x7f6350107510 2024-09-12T12:15:18.240 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:13.017+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi038", "addr": "172.21.15.38", "target": ["mon-mgr", ""]}) -- 0x7f6350103f30 con 0x7f6338038fc0 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.563+0000 7f634d600640 1 -- 172.21.15.38:0/3748500450 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6350103f30 con 0x7f6338038fc0 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6338038fc0 msgr2=0x7f633803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6338038fc0 0x7f633803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f633c0098c0 tx=0x7f633c006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 msgr2=0x7f635019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f635019b4e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f63440097f0 tx=0x7f6344030d80 comp rx=0 tx=0).stop 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 shutdown_connections 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6338038fc0 0x7f633803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 --2- 172.21.15.38:0/3748500450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6350107510 0x7f635019b4e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 >> 172.21.15.38:0/3748500450 conn(0x7f6350102ce0 msgr2=0x7f6350103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 shutdown_connections 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:17.566+0000 7f6357600640 1 -- 172.21.15.38:0/3748500450 wait complete. 2024-09-12T12:15:18.241 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying unmanaged mon service... 2024-09-12T12:15:18.835 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:18 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:18.835 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:18 smithi038 ceph-mon[30810]: Added host smithi038 2024-09-12T12:15:18.835 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:18 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:20.148 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:20 smithi038 ceph-mon[30810]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:20.148 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:20 smithi038 ceph-mon[30810]: Saving service mon spec with placement count:5 2024-09-12T12:15:20.148 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:20 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.834+0000 7f6abc200640 1 Processor -- start 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.834+0000 7f6abc200640 1 -- start start 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.834+0000 7f6abc200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab4107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.834+0000 7f6abc200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4107ee0 con 0x7f6ab4107510 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.835+0000 7f6ab9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab4107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.835+0000 7f6ab9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab4107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37148/0 (socket says 172.21.15.38:37148) 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.835+0000 7f6ab9800640 1 -- 172.21.15.38:0/2305152788 learned_addr learned my addr 172.21.15.38:0/2305152788 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:20.762 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.835+0000 7f6ab9800640 1 -- 172.21.15.38:0/2305152788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab41086c0 con 0x7f6ab4107510 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.836+0000 7f6ab9800640 1 --2- 172.21.15.38:0/2305152788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab4107910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009820 tx=0x7f6aa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880f3fc4220c11c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.836+0000 7f6ab3e00640 1 -- 172.21.15.38:0/2305152788 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa8037070 con 0x7f6ab4107510 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.836+0000 7f6ab3e00640 1 -- 172.21.15.38:0/2305152788 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6aa8032900 con 0x7f6ab4107510 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.836+0000 7f6ab3e00640 1 -- 172.21.15.38:0/2305152788 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa8030850 con 0x7f6ab4107510 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.837+0000 7f6abc200640 1 -- 172.21.15.38:0/2305152788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 msgr2=0x7f6ab4107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.837+0000 7f6abc200640 1 --2- 172.21.15.38:0/2305152788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab4107910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009820 tx=0x7f6aa802a270 comp rx=0 tx=0).stop 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.837+0000 7f6abc200640 1 -- 172.21.15.38:0/2305152788 shutdown_connections 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.837+0000 7f6abc200640 1 --2- 172.21.15.38:0/2305152788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab4107910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.837+0000 7f6abc200640 1 -- 172.21.15.38:0/2305152788 >> 172.21.15.38:0/2305152788 conn(0x7f6ab4102ce0 msgr2=0x7f6ab4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.837+0000 7f6abc200640 1 -- 172.21.15.38:0/2305152788 shutdown_connections 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.837+0000 7f6abc200640 1 -- 172.21.15.38:0/2305152788 wait complete. 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.838+0000 7f6abc200640 1 Processor -- start 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.838+0000 7f6abc200640 1 -- start start 2024-09-12T12:15:20.763 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.839+0000 7f6abc200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.839+0000 7f6abc200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab410ba70 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.839+0000 7f6ab9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.839+0000 7f6ab9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37150/0 (socket says 172.21.15.38:37150) 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.839+0000 7f6ab9800640 1 -- 172.21.15.38:0/1710002304 learned_addr learned my addr 172.21.15.38:0/1710002304 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.839+0000 7f6ab9800640 1 -- 172.21.15.38:0/1710002304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab407e080 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.840+0000 7f6ab9800640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab407db40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80097f0 tx=0x7f6aa8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.840+0000 7f6ab2000640 1 -- 172.21.15.38:0/1710002304 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa8037040 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.840+0000 7f6ab2000640 1 -- 172.21.15.38:0/1710002304 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6aa8040070 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.840+0000 7f6ab2000640 1 -- 172.21.15.38:0/1710002304 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa803a390 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.840+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab407c270 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.840+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab407c750 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.841+0000 7f6ab2000640 1 -- 172.21.15.38:0/1710002304 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6aa803b430 con 0x7f6ab4107510 2024-09-12T12:15:20.764 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.842+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab410bbf0 con 0x7f6ab4107510 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.842+0000 7f6ab2000640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6a9c038fc0 0x7f6a9c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.842+0000 7f6ab2000640 1 -- 172.21.15.38:0/1710002304 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6aa806c4e0 con 0x7f6ab4107510 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.842+0000 7f6ab8e00640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6a9c038fc0 0x7f6a9c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.843+0000 7f6ab8e00640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6a9c038fc0 0x7f6a9c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00098c0 tx=0x7f6aa0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:18.847+0000 7f6ab2000640 1 -- 172.21.15.38:0/1710002304 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6aa806be30 con 0x7f6ab4107510 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.052+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6ab407d000 con 0x7f6a9c038fc0 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.059+0000 7f6ab2000640 1 -- 172.21.15.38:0/1710002304 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6ab407d000 con 0x7f6a9c038fc0 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6a9c038fc0 msgr2=0x7f6a9c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6a9c038fc0 0x7f6a9c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00098c0 tx=0x7f6aa0006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 msgr2=0x7f6ab407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab407db40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80097f0 tx=0x7f6aa8030d80 comp rx=0 tx=0).stop 2024-09-12T12:15:20.765 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 shutdown_connections 2024-09-12T12:15:20.766 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f6a9c038fc0 0x7f6a9c03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.766 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 --2- 172.21.15.38:0/1710002304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ab4107510 0x7f6ab407db40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.766 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.061+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 >> 172.21.15.38:0/1710002304 conn(0x7f6ab4102ce0 msgr2=0x7f6ab4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:20.766 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.062+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 shutdown_connections 2024-09-12T12:15:20.766 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:19.062+0000 7f6abc200640 1 -- 172.21.15.38:0/1710002304 wait complete. 2024-09-12T12:15:20.766 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying unmanaged mgr service... 2024-09-12T12:15:21.307 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:21 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:21.307 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:21 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:22.675 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:22 smithi038 ceph-mon[30810]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:22.675 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:22 smithi038 ceph-mon[30810]: Saving service mgr spec with placement count:2 2024-09-12T12:15:22.675 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:22 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:22.675 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:22 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.296+0000 7f3ee9600640 1 Processor -- start 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.297+0000 7f3ee9600640 1 -- start start 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.297+0000 7f3ee9600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.297+0000 7f3ee9600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee410a260 con 0x7f3ee4109890 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.297+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.297+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee4109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37164/0 (socket says 172.21.15.38:37164) 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.297+0000 7f3ee2a00640 1 -- 172.21.15.38:0/3613998844 learned_addr learned my addr 172.21.15.38:0/3613998844 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:22.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.298+0000 7f3ee2a00640 1 -- 172.21.15.38:0/3613998844 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee410a890 con 0x7f3ee4109890 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.299+0000 7f3ee2a00640 1 --2- 172.21.15.38:0/3613998844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee4109c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009820 tx=0x7f3ed402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdf3f6dd5ff6821 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.299+0000 7f3ee1600640 1 -- 172.21.15.38:0/3613998844 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4037070 con 0x7f3ee4109890 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.299+0000 7f3ee1600640 1 -- 172.21.15.38:0/3613998844 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed4032920 con 0x7f3ee4109890 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.299+0000 7f3ee1600640 1 -- 172.21.15.38:0/3613998844 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4030810 con 0x7f3ee4109890 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.300+0000 7f3ee9600640 1 -- 172.21.15.38:0/3613998844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 msgr2=0x7f3ee4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.300+0000 7f3ee9600640 1 --2- 172.21.15.38:0/3613998844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee4109c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009820 tx=0x7f3ed402a270 comp rx=0 tx=0).stop 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.300+0000 7f3ee9600640 1 -- 172.21.15.38:0/3613998844 shutdown_connections 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.300+0000 7f3ee9600640 1 --2- 172.21.15.38:0/3613998844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee4109c90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.300+0000 7f3ee9600640 1 -- 172.21.15.38:0/3613998844 >> 172.21.15.38:0/3613998844 conn(0x7f3ee407ccc0 msgr2=0x7f3ee407d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.300+0000 7f3ee9600640 1 -- 172.21.15.38:0/3613998844 shutdown_connections 2024-09-12T12:15:22.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.300+0000 7f3ee9600640 1 -- 172.21.15.38:0/3613998844 wait complete. 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.301+0000 7f3ee9600640 1 Processor -- start 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.301+0000 7f3ee9600640 1 -- start start 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.301+0000 7f3ee9600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.301+0000 7f3ee9600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee410dc40 con 0x7f3ee4109890 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.302+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.302+0000 7f3ee2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37172/0 (socket says 172.21.15.38:37172) 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.302+0000 7f3ee2a00640 1 -- 172.21.15.38:0/905995399 learned_addr learned my addr 172.21.15.38:0/905995399 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.302+0000 7f3ee2a00640 1 -- 172.21.15.38:0/905995399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee419dc70 con 0x7f3ee4109890 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.302+0000 7f3ee2a00640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee419d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4030560 tx=0x7f3ed4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.303+0000 7f3edb400640 1 -- 172.21.15.38:0/905995399 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4037040 con 0x7f3ee4109890 2024-09-12T12:15:22.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.303+0000 7f3edb400640 1 -- 172.21.15.38:0/905995399 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed4040070 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.303+0000 7f3edb400640 1 -- 172.21.15.38:0/905995399 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed403a740 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.303+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee419df00 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.303+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee41a0bf0 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.304+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee4109d10 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.304+0000 7f3edb400640 1 -- 172.21.15.38:0/905995399 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3ed403bb90 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.305+0000 7f3edb400640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3ec8038f70 0x7f3ec803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.305+0000 7f3edb400640 1 -- 172.21.15.38:0/905995399 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3ed406c650 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.305+0000 7f3ee2000640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3ec8038f70 0x7f3ec803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.306+0000 7f3ee2000640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3ec8038f70 0x7f3ec803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00098c0 tx=0x7f3ed0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.311+0000 7f3edb400640 1 -- 172.21.15.38:0/905995399 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ed404a200 con 0x7f3ee4109890 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.553+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3ee4107c90 con 0x7f3ec8038f70 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.559+0000 7f3edb400640 1 -- 172.21.15.38:0/905995399 <== mgr.14118 v2:172.21.15.38:6800/2462218902 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3ee4107c90 con 0x7f3ec8038f70 2024-09-12T12:15:22.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3ec8038f70 msgr2=0x7f3ec803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3ec8038f70 0x7f3ec803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00098c0 tx=0x7f3ed0006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 msgr2=0x7f3ee419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee419d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4030560 tx=0x7f3ed4032670 comp rx=0 tx=0).stop 2024-09-12T12:15:22.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 shutdown_connections 2024-09-12T12:15:22.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3ec8038f70 0x7f3ec803b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 --2- 172.21.15.38:0/905995399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ee4109890 0x7f3ee419d730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 >> 172.21.15.38:0/905995399 conn(0x7f3ee407ccc0 msgr2=0x7f3ee4107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 shutdown_connections 2024-09-12T12:15:22.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:21.563+0000 7f3ee9600640 1 -- 172.21.15.38:0/905995399 wait complete. 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.419+0000 7fb1f7e00640 1 Processor -- start 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.419+0000 7fb1f7e00640 1 -- start start 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.419+0000 7fb1f7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f807b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.419+0000 7fb1f7e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f807b7d0 con 0x7fb1f807cd50 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.420+0000 7fb1f6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.420+0000 7fb1f6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f807b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37178/0 (socket says 172.21.15.38:37178) 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.420+0000 7fb1f6a00640 1 -- 172.21.15.38:0/2209246463 learned_addr learned my addr 172.21.15.38:0/2209246463 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.420+0000 7fb1f6a00640 1 -- 172.21.15.38:0/2209246463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f807b950 con 0x7fb1f807cd50 2024-09-12T12:15:24.315 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.421+0000 7fb1f6a00640 1 --2- 172.21.15.38:0/2209246463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f807b200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009820 tx=0x7fb1e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a11f39ab912cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.421+0000 7fb1f6000640 1 -- 172.21.15.38:0/2209246463 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1e8037070 con 0x7fb1f807cd50 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.421+0000 7fb1f6000640 1 -- 172.21.15.38:0/2209246463 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e8032920 con 0x7fb1f807cd50 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.421+0000 7fb1f6000640 1 -- 172.21.15.38:0/2209246463 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1e8030810 con 0x7fb1f807cd50 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.422+0000 7fb1f7e00640 1 -- 172.21.15.38:0/2209246463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 msgr2=0x7fb1f807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.422+0000 7fb1f7e00640 1 --2- 172.21.15.38:0/2209246463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f807b200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009820 tx=0x7fb1e802a270 comp rx=0 tx=0).stop 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.422+0000 7fb1f7e00640 1 -- 172.21.15.38:0/2209246463 shutdown_connections 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.422+0000 7fb1f7e00640 1 --2- 172.21.15.38:0/2209246463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f807b200 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.422+0000 7fb1f7e00640 1 -- 172.21.15.38:0/2209246463 >> 172.21.15.38:0/2209246463 conn(0x7fb1f8102ae0 msgr2=0x7fb1f8104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.422+0000 7fb1f7e00640 1 -- 172.21.15.38:0/2209246463 shutdown_connections 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.422+0000 7fb1f7e00640 1 -- 172.21.15.38:0/2209246463 wait complete. 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.423+0000 7fb1f7e00640 1 Processor -- start 2024-09-12T12:15:24.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.423+0000 7fb1f7e00640 1 -- start start 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.424+0000 7fb1f7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f81a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.424+0000 7fb1f7e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f8109530 con 0x7fb1f807cd50 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.424+0000 7fb1f6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f81a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.424+0000 7fb1f6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f81a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37190/0 (socket says 172.21.15.38:37190) 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.424+0000 7fb1f6a00640 1 -- 172.21.15.38:0/851208411 learned_addr learned my addr 172.21.15.38:0/851208411 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.424+0000 7fb1f6a00640 1 -- 172.21.15.38:0/851208411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f81a1e10 con 0x7fb1f807cd50 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.425+0000 7fb1f6a00640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f81a18d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8030380 tx=0x7fb1e8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.425+0000 7fb1ef400640 1 -- 172.21.15.38:0/851208411 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1e8037040 con 0x7fb1f807cd50 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.425+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f81a20a0 con 0x7fb1f807cd50 2024-09-12T12:15:24.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.425+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f81a4d90 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.425+0000 7fb1ef400640 1 -- 172.21.15.38:0/851208411 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e8040070 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.425+0000 7fb1ef400640 1 -- 172.21.15.38:0/851208411 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1e803a380 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.426+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d40052c0 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.426+0000 7fb1ef400640 1 -- 172.21.15.38:0/851208411 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb1e803b420 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.427+0000 7fb1ef400640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fb1dc038fc0 0x7fb1dc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.427+0000 7fb1ef400640 1 -- 172.21.15.38:0/851208411 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb1e806c680 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.427+0000 7fb1efe00640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fb1dc038fc0 0x7fb1dc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.428+0000 7fb1efe00640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fb1dc038fc0 0x7fb1dc03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00098c0 tx=0x7fb1e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.433+0000 7fb1ef400640 1 -- 172.21.15.38:0/851208411 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1e8043360 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.621+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb1d40055b0 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.625+0000 7fb1ef400640 1 -- 172.21.15.38:0/851208411 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb1e8040220 con 0x7fb1f807cd50 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.627+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fb1dc038fc0 msgr2=0x7fb1dc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.627+0000 7fb1f7e00640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fb1dc038fc0 0x7fb1dc03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00098c0 tx=0x7fb1e0006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.627+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 msgr2=0x7fb1f81a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.627+0000 7fb1f7e00640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f81a18d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8030380 tx=0x7fb1e8032670 comp rx=0 tx=0).stop 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.628+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 shutdown_connections 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.628+0000 7fb1f7e00640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fb1dc038fc0 0x7fb1dc03b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.628+0000 7fb1f7e00640 1 --2- 172.21.15.38:0/851208411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1f807cd50 0x7fb1f81a18d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.628+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 >> 172.21.15.38:0/851208411 conn(0x7fb1f8102ae0 msgr2=0x7fb1f8104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.628+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 shutdown_connections 2024-09-12T12:15:24.319 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:23.628+0000 7fb1f7e00640 1 -- 172.21.15.38:0/851208411 wait complete. 2024-09-12T12:15:24.854 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:24 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/851208411' entity='client.admin' 2024-09-12T12:15:24.854 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:24 smithi038 ceph-mon[30810]: from='mgr.14118 172.21.15.38:0/2482443602' entity='mgr.x' 2024-09-12T12:15:25.732 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.853+0000 7fcbd0200640 1 Processor -- start 2024-09-12T12:15:25.732 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.853+0000 7fcbd0200640 1 -- start start 2024-09-12T12:15:25.732 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.854+0000 7fcbd0200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.732 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.854+0000 7fcbd0200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc807b6e0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.732 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.854+0000 7fcbcd800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.732 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.854+0000 7fcbcd800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc807b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37200/0 (socket says 172.21.15.38:37200) 2024-09-12T12:15:25.732 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.854+0000 7fcbcd800640 1 -- 172.21.15.38:0/3575940562 learned_addr learned my addr 172.21.15.38:0/3575940562 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.855+0000 7fcbcd800640 1 -- 172.21.15.38:0/3575940562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc807b860 con 0x7fcbc807ccf0 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.856+0000 7fcbcd800640 1 --2- 172.21.15.38:0/3575940562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc807b1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009820 tx=0x7fcbbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2b1295ecf87fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.856+0000 7fcbc7e00640 1 -- 172.21.15.38:0/3575940562 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc037070 con 0x7fcbc807ccf0 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.856+0000 7fcbc7e00640 1 -- 172.21.15.38:0/3575940562 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbbc032920 con 0x7fcbc807ccf0 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.856+0000 7fcbc7e00640 1 -- 172.21.15.38:0/3575940562 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc030810 con 0x7fcbc807ccf0 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.857+0000 7fcbd0200640 1 -- 172.21.15.38:0/3575940562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 msgr2=0x7fcbc807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.857+0000 7fcbd0200640 1 --2- 172.21.15.38:0/3575940562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc807b1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009820 tx=0x7fcbbc02a270 comp rx=0 tx=0).stop 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.857+0000 7fcbd0200640 1 -- 172.21.15.38:0/3575940562 shutdown_connections 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.857+0000 7fcbd0200640 1 --2- 172.21.15.38:0/3575940562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc807b1a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.857+0000 7fcbd0200640 1 -- 172.21.15.38:0/3575940562 >> 172.21.15.38:0/3575940562 conn(0x7fcbc8102c10 msgr2=0x7fcbc8105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.857+0000 7fcbd0200640 1 -- 172.21.15.38:0/3575940562 shutdown_connections 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.857+0000 7fcbd0200640 1 -- 172.21.15.38:0/3575940562 wait complete. 2024-09-12T12:15:25.733 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.858+0000 7fcbd0200640 1 Processor -- start 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.858+0000 7fcbd0200640 1 -- start start 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.858+0000 7fcbd0200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.858+0000 7fcbd0200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc810daf0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.859+0000 7fcbcd800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.859+0000 7fcbcd800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37204/0 (socket says 172.21.15.38:37204) 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.859+0000 7fcbcd800640 1 -- 172.21.15.38:0/3797949636 learned_addr learned my addr 172.21.15.38:0/3797949636 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.859+0000 7fcbcd800640 1 -- 172.21.15.38:0/3797949636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc819dc10 con 0x7fcbc807ccf0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.859+0000 7fcbcd800640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc819d6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097f0 tx=0x7fcbbc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.860+0000 7fcbc6000640 1 -- 172.21.15.38:0/3797949636 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc037040 con 0x7fcbc807ccf0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.860+0000 7fcbc6000640 1 -- 172.21.15.38:0/3797949636 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbbc030cc0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.860+0000 7fcbc6000640 1 -- 172.21.15.38:0/3797949636 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc03a6b0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.860+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc819dea0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.734 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.860+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc81a0b90 con 0x7fcbc807ccf0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.861+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc807b220 con 0x7fcbc807ccf0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.861+0000 7fcbc6000640 1 -- 172.21.15.38:0/3797949636 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcbbc03baf0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.862+0000 7fcbc6000640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fcbb0038f70 0x7fcbb003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.862+0000 7fcbc6000640 1 -- 172.21.15.38:0/3797949636 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcbbc06c540 con 0x7fcbc807ccf0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.862+0000 7fcbcce00640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fcbb0038f70 0x7fcbb003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.863+0000 7fcbcce00640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fcbb0038f70 0x7fcbb003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40098c0 tx=0x7fcbb4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:24.867+0000 7fcbc6000640 1 -- 172.21.15.38:0/3797949636 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbbc042dc0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.057+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fcbc81a11f0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.060+0000 7fcbc6000640 1 -- 172.21.15.38:0/3797949636 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fcbbc03b4a0 con 0x7fcbc807ccf0 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.062+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fcbb0038f70 msgr2=0x7fcbb003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.062+0000 7fcbd0200640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fcbb0038f70 0x7fcbb003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40098c0 tx=0x7fcbb4006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.735 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.062+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 msgr2=0x7fcbc819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.062+0000 7fcbd0200640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc819d6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097f0 tx=0x7fcbbc0327b0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.063+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 shutdown_connections 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.063+0000 7fcbd0200640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7fcbb0038f70 0x7fcbb003b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.063+0000 7fcbd0200640 1 --2- 172.21.15.38:0/3797949636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbc807ccf0 0x7fcbc819d6d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.063+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 >> 172.21.15.38:0/3797949636 conn(0x7fcbc8102c10 msgr2=0x7fcbc8103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.063+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 shutdown_connections 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:25.063+0000 7fcbd0200640 1 -- 172.21.15.38:0/3797949636 wait complete. 2024-09-12T12:15:25.736 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling the dashboard module... 2024-09-12T12:15:26.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:25 smithi038 ceph-mon[30810]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:15:26.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:25 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3797949636' entity='client.admin' 2024-09-12T12:15:28.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:27 smithi038 ceph-mon[30810]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:15:28.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:27 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/747476853' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T12:15:28.101 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: ignoring --setuser ceph since I am not root 2024-09-12T12:15:28.101 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: ignoring --setgroup ceph since I am not root 2024-09-12T12:15:28.101 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:28.100+0000 7f6c8260a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:15:28.366 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:28.174+0000 7f6c8260a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:15:28.367 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:28.366+0000 7f6c8260a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.073+0000 7f45f5c00640 1 Processor -- start 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.073+0000 7f45f5c00640 1 -- start start 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.073+0000 7f45f5c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f01076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.073+0000 7f45f5c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f45f0107cb0 con 0x7f45f01072e0 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.073+0000 7f45efe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f01076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.074+0000 7f45efe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f01076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37968/0 (socket says 172.21.15.38:37968) 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.074+0000 7f45efe00640 1 -- 172.21.15.38:0/3939192458 learned_addr learned my addr 172.21.15.38:0/3939192458 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:28.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.074+0000 7f45efe00640 1 -- 172.21.15.38:0/3939192458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f01084e0 con 0x7f45f01072e0 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.075+0000 7f45efe00640 1 --2- 172.21.15.38:0/3939192458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f01076e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009820 tx=0x7f45e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d668f565aff01e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.075+0000 7f45ef400640 1 -- 172.21.15.38:0/3939192458 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0037070 con 0x7f45f01072e0 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.075+0000 7f45ef400640 1 -- 172.21.15.38:0/3939192458 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45e0032920 con 0x7f45f01072e0 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.075+0000 7f45ef400640 1 -- 172.21.15.38:0/3939192458 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0030810 con 0x7f45f01072e0 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.076+0000 7f45f5c00640 1 -- 172.21.15.38:0/3939192458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 msgr2=0x7f45f01076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.076+0000 7f45f5c00640 1 --2- 172.21.15.38:0/3939192458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f01076e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009820 tx=0x7f45e002a270 comp rx=0 tx=0).stop 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.076+0000 7f45f5c00640 1 -- 172.21.15.38:0/3939192458 shutdown_connections 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.076+0000 7f45f5c00640 1 --2- 172.21.15.38:0/3939192458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f01076e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.076+0000 7f45f5c00640 1 -- 172.21.15.38:0/3939192458 >> 172.21.15.38:0/3939192458 conn(0x7f45f0102ad0 msgr2=0x7f45f0104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.076+0000 7f45f5c00640 1 -- 172.21.15.38:0/3939192458 shutdown_connections 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.076+0000 7f45f5c00640 1 -- 172.21.15.38:0/3939192458 wait complete. 2024-09-12T12:15:28.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.077+0000 7f45f5c00640 1 Processor -- start 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.077+0000 7f45f5c00640 1 -- start start 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.078+0000 7f45f5c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f019d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.078+0000 7f45f5c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f45f010b890 con 0x7f45f01072e0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.078+0000 7f45efe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f019d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.078+0000 7f45efe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f019d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37970/0 (socket says 172.21.15.38:37970) 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.078+0000 7f45efe00640 1 -- 172.21.15.38:0/747476853 learned_addr learned my addr 172.21.15.38:0/747476853 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.078+0000 7f45efe00640 1 -- 172.21.15.38:0/747476853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f019daa0 con 0x7f45f01072e0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.079+0000 7f45efe00640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f019d560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45e00097f0 tx=0x7f45e00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.079+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0037040 con 0x7f45f01072e0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.079+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45e0030cc0 con 0x7f45f01072e0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.079+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e003a640 con 0x7f45f01072e0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.079+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f019dd30 con 0x7f45f01072e0 2024-09-12T12:15:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.079+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f01a0a20 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.080+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f45e003b3f0 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.080+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f010ba10 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.081+0000 7f45ed600640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f45d4038fc0 0x7f45d403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.081+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f45e006c560 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.081+0000 7f45e7e00640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f45d4038fc0 0x7f45d403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.082+0000 7f45e7e00640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f45d4038fc0 0x7f45d403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45d80098c0 tx=0x7f45d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.086+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45e00328c0 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.318+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f45f01a0bf0 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.849+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f45e0042dc0 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.851+0000 7f45ed600640 1 -- 172.21.15.38:0/747476853 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f45e0049ca0 con 0x7f45f01072e0 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.853+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f45d4038fc0 msgr2=0x7f45d403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.853+0000 7f45f5c00640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f45d4038fc0 0x7f45d403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45d80098c0 tx=0x7f45d8006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.853+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 msgr2=0x7f45f019d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.853+0000 7f45f5c00640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f019d560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45e00097f0 tx=0x7f45e00327b0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.854+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 shutdown_connections 2024-09-12T12:15:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.854+0000 7f45f5c00640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f45d4038fc0 0x7f45d403b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.854+0000 7f45f5c00640 1 --2- 172.21.15.38:0/747476853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45f01072e0 0x7f45f019d560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.854+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 >> 172.21.15.38:0/747476853 conn(0x7f45f0102ad0 msgr2=0x7f45f0103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.854+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 shutdown_connections 2024-09-12T12:15:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:27.854+0000 7f45f5c00640 1 -- 172.21.15.38:0/747476853 wait complete. 2024-09-12T12:15:28.633 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:28.448+0000 7f6c8260a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:15:28.633 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:28.632+0000 7f6c8260a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:15:28.961 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/747476853' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T12:15:28.961 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-mon[30810]: mgrmap e9: x(active, since 23s) 2024-09-12T12:15:28.961 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:28 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:28.813+0000 7f6c8260a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:15:29.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:29 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:29.199+0000 7f6c8260a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:15:29.647 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:29 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:29.274+0000 7f6c8260a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:15:29.647 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:29 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:29.503+0000 7f6c8260a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:15:29.963 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:29 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3150792125' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.071+0000 7f4b20a00640 1 Processor -- start 2024-09-12T12:15:29.979 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.071+0000 7f4b20a00640 1 -- start start 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.072+0000 7f4b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.072+0000 7f4b20a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c10a260 con 0x7f4b1c109890 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.072+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.072+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37990/0 (socket says 172.21.15.38:37990) 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.072+0000 7f4b19e00640 1 -- 172.21.15.38:0/916718536 learned_addr learned my addr 172.21.15.38:0/916718536 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.072+0000 7f4b19e00640 1 -- 172.21.15.38:0/916718536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c10a890 con 0x7f4b1c109890 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.073+0000 7f4b19e00640 1 --2- 172.21.15.38:0/916718536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c109c90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009820 tx=0x7f4b0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f30fccab58565bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b18a00640 1 -- 172.21.15.38:0/916718536 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c037070 con 0x7f4b1c109890 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b18a00640 1 -- 172.21.15.38:0/916718536 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b0c032920 con 0x7f4b1c109890 2024-09-12T12:15:29.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b18a00640 1 -- 172.21.15.38:0/916718536 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c030810 con 0x7f4b1c109890 2024-09-12T12:15:29.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b20a00640 1 -- 172.21.15.38:0/916718536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 msgr2=0x7f4b1c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b20a00640 1 --2- 172.21.15.38:0/916718536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c109c90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009820 tx=0x7f4b0c02a270 comp rx=0 tx=0).stop 2024-09-12T12:15:29.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b20a00640 1 -- 172.21.15.38:0/916718536 shutdown_connections 2024-09-12T12:15:29.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b20a00640 1 --2- 172.21.15.38:0/916718536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c109c90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.074+0000 7f4b20a00640 1 -- 172.21.15.38:0/916718536 >> 172.21.15.38:0/916718536 conn(0x7f4b1c07ccc0 msgr2=0x7f4b1c07d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:29.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.075+0000 7f4b20a00640 1 -- 172.21.15.38:0/916718536 shutdown_connections 2024-09-12T12:15:29.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.075+0000 7f4b20a00640 1 -- 172.21.15.38:0/916718536 wait complete. 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.076+0000 7f4b20a00640 1 Processor -- start 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.076+0000 7f4b20a00640 1 -- start start 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.076+0000 7f4b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.076+0000 7f4b20a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c10dc40 con 0x7f4b1c109890 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.076+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.076+0000 7f4b19e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38006/0 (socket says 172.21.15.38:38006) 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.076+0000 7f4b19e00640 1 -- 172.21.15.38:0/3150792125 learned_addr learned my addr 172.21.15.38:0/3150792125 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:29.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.077+0000 7f4b19e00640 1 -- 172.21.15.38:0/3150792125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c19dc70 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.077+0000 7f4b19e00640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c19d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097f0 tx=0x7f4b0c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.077+0000 7f4b12a00640 1 -- 172.21.15.38:0/3150792125 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c037040 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.077+0000 7f4b12a00640 1 -- 172.21.15.38:0/3150792125 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b0c030cc0 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.077+0000 7f4b12a00640 1 -- 172.21.15.38:0/3150792125 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c03a640 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.077+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1c19df00 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.078+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1c1a0bf0 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.079+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1c109d10 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.079+0000 7f4b12a00640 1 -- 172.21.15.38:0/3150792125 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f4b0c03b3f0 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.079+0000 7f4b12a00640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 0x7f4b0003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.080+0000 7f4b12a00640 1 -- 172.21.15.38:0/3150792125 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4b0c06c610 con 0x7f4b1c109890 2024-09-12T12:15:29.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.080+0000 7f4b19400640 1 -- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 msgr2=0x7f4b0003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2462218902 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.080+0000 7f4b19400640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 0x7f4b0003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.085+0000 7f4b12a00640 1 -- 172.21.15.38:0/3150792125 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b0c042e10 con 0x7f4b1c109890 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.281+0000 7f4b19400640 1 -- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 msgr2=0x7f4b0003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2462218902 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.281+0000 7f4b19400640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 0x7f4b0003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.320+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f4b1c1a0dc0 con 0x7f4b1c109890 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.320+0000 7f4b12a00640 1 -- 172.21.15.38:0/3150792125 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f4b1c1a0dc0 con 0x7f4b1c109890 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.322+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 msgr2=0x7f4b0003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.322+0000 7f4b20a00640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 0x7f4b0003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.322+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 msgr2=0x7f4b1c19d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.322+0000 7f4b20a00640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c19d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097f0 tx=0x7f4b0c0327b0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.322+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 shutdown_connections 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.322+0000 7f4b20a00640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f4b00038fc0 0x7f4b0003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.323+0000 7f4b20a00640 1 --2- 172.21.15.38:0/3150792125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c109890 0x7f4b1c19d730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.323+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 >> 172.21.15.38:0/3150792125 conn(0x7f4b1c07ccc0 msgr2=0x7f4b1c107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.323+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 shutdown_connections 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:29.323+0000 7f4b20a00640 1 -- 172.21.15.38:0/3150792125 wait complete. 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2024-09-12T12:15:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 9... 2024-09-12T12:15:30.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:30 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:30.671+0000 7f6c8260a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:15:30.970 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:30 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:30.755+0000 7f6c8260a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:15:31.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:31 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:31.698+0000 7f6c8260a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:15:31.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:31 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:31.840+0000 7f6c8260a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:15:32.264 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.010+0000 7f6c8260a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:15:32.265 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.085+0000 7f6c8260a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:15:32.265 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.264+0000 7f6c8260a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:15:32.612 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.348+0000 7f6c8260a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:15:32.612 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.423+0000 7f6c8260a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:15:32.612 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.611+0000 7f6c8260a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:15:32.875 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.691+0000 7f6c8260a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:15:32.875 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.773+0000 7f6c8260a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:15:32.875 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.874+0000 7f6c8260a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:15:33.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:32 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:32.947+0000 7f6c8260a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:15:33.219 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:33 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:33.020+0000 7f6c8260a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:15:34.262 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:33 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:33.974+0000 7f6c8260a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:15:34.262 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: Active manager daemon x restarted 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: Activating manager daemon x 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: mgrmap e10: x(active, starting, since 0.00866247s) 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: Manager daemon x is now available 2024-09-12T12:15:34.263 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:35.261 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:15:35.261 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:15:35.261 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-mon[30810]: mgrmap e11: x(active, since 1.00811s) 2024-09-12T12:15:35.889 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:35.757+0000 7f6bd7e00640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:12:15:35] ENGINE Error in HTTPServer.serve 2024-09-12T12:15:35.889 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: Traceback (most recent call last): 2024-09-12T12:15:35.889 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self._connections.run(self.expiration_interval) 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self._run(expiration_interval) 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: s = self.context.wrap_socket( 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: return self.sslsocket_class._create( 2024-09-12T12:15:35.890 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:15:35.891 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self.do_handshake() 2024-09-12T12:15:35.891 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:15:35.891 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: self._sslobj.do_handshake() 2024-09-12T12:15:35.891 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:15:35.891 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:15:35 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:15:36.195 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:15:36.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T12:15:36.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T12:15:36.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:15:36.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.461+0000 7f3b16400640 1 Processor -- start 2024-09-12T12:15:36.196 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.461+0000 7f3b16400640 1 -- start start 2024-09-12T12:15:36.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.461+0000 7f3b16400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b1007b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.461+0000 7f3b16400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1007b7d0 con 0x7f3b1007cd50 2024-09-12T12:15:36.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.461+0000 7f3b15000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b1007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:36.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.462+0000 7f3b15000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b1007b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38012/0 (socket says 172.21.15.38:38012) 2024-09-12T12:15:36.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.462+0000 7f3b15000640 1 -- 172.21.15.38:0/3378172384 learned_addr learned my addr 172.21.15.38:0/3378172384 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:36.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.462+0000 7f3b15000640 1 -- 172.21.15.38:0/3378172384 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1007b950 con 0x7f3b1007cd50 2024-09-12T12:15:36.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.463+0000 7f3b15000640 1 --2- 172.21.15.38:0/3378172384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b1007b200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009820 tx=0x7f3b0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb7692f45d9817b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:36.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.463+0000 7f3b0f400640 1 -- 172.21.15.38:0/3378172384 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b04037070 con 0x7f3b1007cd50 2024-09-12T12:15:36.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.463+0000 7f3b0f400640 1 -- 172.21.15.38:0/3378172384 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b04032920 con 0x7f3b1007cd50 2024-09-12T12:15:36.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.463+0000 7f3b0f400640 1 -- 172.21.15.38:0/3378172384 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b04030810 con 0x7f3b1007cd50 2024-09-12T12:15:36.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.464+0000 7f3b16400640 1 -- 172.21.15.38:0/3378172384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 msgr2=0x7f3b1007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.464+0000 7f3b16400640 1 --2- 172.21.15.38:0/3378172384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b1007b200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009820 tx=0x7f3b0402a270 comp rx=0 tx=0).stop 2024-09-12T12:15:36.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.464+0000 7f3b16400640 1 -- 172.21.15.38:0/3378172384 shutdown_connections 2024-09-12T12:15:36.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.464+0000 7f3b16400640 1 --2- 172.21.15.38:0/3378172384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b1007b200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.464+0000 7f3b16400640 1 -- 172.21.15.38:0/3378172384 >> 172.21.15.38:0/3378172384 conn(0x7f3b10102ae0 msgr2=0x7f3b10104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:36.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.464+0000 7f3b16400640 1 -- 172.21.15.38:0/3378172384 shutdown_connections 2024-09-12T12:15:36.199 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.464+0000 7f3b16400640 1 -- 172.21.15.38:0/3378172384 wait complete. 2024-09-12T12:15:36.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.465+0000 7f3b16400640 1 Processor -- start 2024-09-12T12:15:36.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.466+0000 7f3b16400640 1 -- start start 2024-09-12T12:15:36.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.466+0000 7f3b16400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b101a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.466+0000 7f3b16400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3b10109530 con 0x7f3b1007cd50 2024-09-12T12:15:36.200 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.466+0000 7f3b15000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b101a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:36.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.466+0000 7f3b15000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b101a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38022/0 (socket says 172.21.15.38:38022) 2024-09-12T12:15:36.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.466+0000 7f3b15000640 1 -- 172.21.15.38:0/2906503702 learned_addr learned my addr 172.21.15.38:0/2906503702 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:36.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.467+0000 7f3b15000640 1 -- 172.21.15.38:0/2906503702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b101a1df0 con 0x7f3b1007cd50 2024-09-12T12:15:36.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.467+0000 7f3b15000640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b101a18b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b040097f0 tx=0x7f3b040327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:36.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.467+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b04037040 con 0x7f3b1007cd50 2024-09-12T12:15:36.201 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.467+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b04030cc0 con 0x7f3b1007cd50 2024-09-12T12:15:36.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.467+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b101a2080 con 0x7f3b1007cd50 2024-09-12T12:15:36.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.467+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b101a4d70 con 0x7f3b1007cd50 2024-09-12T12:15:36.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.467+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0403a6b0 con 0x7f3b1007cd50 2024-09-12T12:15:36.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.469+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f3b0403baf0 con 0x7f3b1007cd50 2024-09-12T12:15:36.202 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.470+0000 7f3b0d600640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.470+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 --> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3af803bb90 con 0x7f3af8038fc0 2024-09-12T12:15:36.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.470+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3b0406c5d0 con 0x7f3b1007cd50 2024-09-12T12:15:36.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.470+0000 7f3b0fe00640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 msgr2=0x7f3af803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2462218902 2024-09-12T12:15:36.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.470+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:15:36.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.671+0000 7f3b0fe00640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 msgr2=0x7f3af803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2462218902 2024-09-12T12:15:36.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:30.671+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:15:36.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:31.072+0000 7f3b0fe00640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 msgr2=0x7f3af803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2462218902 2024-09-12T12:15:36.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:31.072+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T12:15:36.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:31.873+0000 7f3b0fe00640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 msgr2=0x7f3af803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2462218902 2024-09-12T12:15:36.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:31.873+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T12:15:36.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:33.474+0000 7f3b0fe00640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 msgr2=0x7f3af803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/2462218902 2024-09-12T12:15:36.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:33.475+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T12:15:36.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:33.983+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f3b0403b3f0 con 0x7f3b1007cd50 2024-09-12T12:15:36.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:33.983+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 msgr2=0x7f3af803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:15:36.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:33.983+0000 7f3b0d600640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.981+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f3b0406e720 con 0x7f3b1007cd50 2024-09-12T12:15:36.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.981+0000 7f3b0d600640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3af803ca80 0x7f3af803ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.981+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3b04049a50 con 0x7f3af803ca80 2024-09-12T12:15:36.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.981+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3af803ca80 0x7f3af803ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:36.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.982+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3af803ca80 0x7f3af803ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3afc003980 tx=0x7f3afc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:36.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.983+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f3b04049a50 con 0x7f3af803ca80 2024-09-12T12:15:36.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.991+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3b1007b280 con 0x7f3af803ca80 2024-09-12T12:15:36.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.991+0000 7f3b0d600640 1 -- 172.21.15.38:0/2906503702 <== mgr.14150 v2:172.21.15.38:6800/1234723065 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f3b1007b280 con 0x7f3af803ca80 2024-09-12T12:15:36.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3af803ca80 msgr2=0x7f3af803ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3af803ca80 0x7f3af803ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3afc003980 tx=0x7f3afc009290 comp rx=0 tx=0).stop 2024-09-12T12:15:36.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 msgr2=0x7f3b101a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b101a18b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b040097f0 tx=0x7f3b040327b0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 shutdown_connections 2024-09-12T12:15:36.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3af803ca80 0x7f3af803ee70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:6800/2462218902,v1:172.21.15.38:6801/2462218902] conn(0x7f3af8038fc0 0x7f3af803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 --2- 172.21.15.38:0/2906503702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b1007cd50 0x7f3b101a18b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 >> 172.21.15.38:0/2906503702 conn(0x7f3b10102ae0 msgr2=0x7f3b10104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:36.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 shutdown_connections 2024-09-12T12:15:36.208 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:34.992+0000 7f3b16400640 1 -- 172.21.15.38:0/2906503702 wait complete. 2024-09-12T12:15:36.209 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 9 is available 2024-09-12T12:15:36.209 INFO:teuthology.orchestra.run.smithi038.stdout:Generating a dashboard self-signed certificate... 2024-09-12T12:15:36.727 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:36 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:35] ENGINE Bus STARTING 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:36 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:35] ENGINE Serving on http://172.21.15.38:8765 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:36 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:36 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:35] ENGINE Serving on https://172.21.15.38:7150 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:36 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:35] ENGINE Bus STARTED 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:36 smithi038 ceph-mon[30810]: [12/Sep/2024:12:15:35] ENGINE Error in HTTPServer.serve 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout: Traceback (most recent call last): 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._run(expiration_interval) 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:15:36.728 INFO:journalctl@ceph.mon.a.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: s = self.context.wrap_socket( 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: return self.sslsocket_class._create( 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: self.do_handshake() 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._sslobj.do_handshake() 2024-09-12T12:15:36.729 INFO:journalctl@ceph.mon.a.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:15:37.634 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T12:15:37.634 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.730+0000 7fa364e00640 1 Processor -- start 2024-09-12T12:15:37.634 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.731+0000 7fa364e00640 1 -- start start 2024-09-12T12:15:37.634 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.731+0000 7fa364e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa360109b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:37.634 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.731+0000 7fa364e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010a120 con 0x7fa360109750 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.731+0000 7fa35de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa360109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.731+0000 7fa35de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa360109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48938/0 (socket says 172.21.15.38:48938) 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.731+0000 7fa35de00640 1 -- 172.21.15.38:0/4150104442 learned_addr learned my addr 172.21.15.38:0/4150104442 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.732+0000 7fa35de00640 1 -- 172.21.15.38:0/4150104442 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36010a900 con 0x7fa360109750 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.733+0000 7fa35de00640 1 --2- 172.21.15.38:0/4150104442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa360109b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa350009820 tx=0x7fa35002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bb4e31df2a8840 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.733+0000 7fa35ca00640 1 -- 172.21.15.38:0/4150104442 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350037070 con 0x7fa360109750 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.733+0000 7fa35ca00640 1 -- 172.21.15.38:0/4150104442 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa350032920 con 0x7fa360109750 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.733+0000 7fa35ca00640 1 -- 172.21.15.38:0/4150104442 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350030810 con 0x7fa360109750 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.734+0000 7fa364e00640 1 -- 172.21.15.38:0/4150104442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 msgr2=0x7fa360109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:37.635 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.734+0000 7fa364e00640 1 --2- 172.21.15.38:0/4150104442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa360109b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa350009820 tx=0x7fa35002a270 comp rx=0 tx=0).stop 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.734+0000 7fa364e00640 1 -- 172.21.15.38:0/4150104442 shutdown_connections 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.734+0000 7fa364e00640 1 --2- 172.21.15.38:0/4150104442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa360109b50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.734+0000 7fa364e00640 1 -- 172.21.15.38:0/4150104442 >> 172.21.15.38:0/4150104442 conn(0x7fa36007ccc0 msgr2=0x7fa360107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.734+0000 7fa364e00640 1 -- 172.21.15.38:0/4150104442 shutdown_connections 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.734+0000 7fa364e00640 1 -- 172.21.15.38:0/4150104442 wait complete. 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.735+0000 7fa364e00640 1 Processor -- start 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.735+0000 7fa364e00640 1 -- start start 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.735+0000 7fa364e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa36019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.735+0000 7fa364e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010dcb0 con 0x7fa360109750 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.736+0000 7fa35de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa36019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.736+0000 7fa35de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa36019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48942/0 (socket says 172.21.15.38:48942) 2024-09-12T12:15:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.736+0000 7fa35de00640 1 -- 172.21.15.38:0/3712548356 learned_addr learned my addr 172.21.15.38:0/3712548356 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.736+0000 7fa35de00640 1 -- 172.21.15.38:0/3712548356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36019dbf0 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.736+0000 7fa35de00640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa36019d6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3500097f0 tx=0x7fa3500327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.737+0000 7fa356a00640 1 -- 172.21.15.38:0/3712548356 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa350037040 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.737+0000 7fa356a00640 1 -- 172.21.15.38:0/3712548356 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa350030cc0 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.737+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36019de80 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.737+0000 7fa356a00640 1 -- 172.21.15.38:0/3712548356 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35003a640 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.737+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3601a0b70 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.738+0000 7fa356a00640 1 -- 172.21.15.38:0/3712548356 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa35003b3f0 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.738+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa360109bd0 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.739+0000 7fa356a00640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa344038fc0 0x7fa34403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.739+0000 7fa356a00640 1 -- 172.21.15.38:0/3712548356 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa35006c6d0 con 0x7fa360109750 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.739+0000 7fa35d400640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa344038fc0 0x7fa34403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:37.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.740+0000 7fa35d400640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa344038fc0 0x7fa34403b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0098c0 tx=0x7fa34c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.744+0000 7fa356a00640 1 -- 172.21.15.38:0/3712548356 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3500328c0 con 0x7fa360109750 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:36.956+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa3601061b0 con 0x7fa344038fc0 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.038+0000 7fa356a00640 1 -- 172.21.15.38:0/3712548356 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa3601061b0 con 0x7fa344038fc0 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa344038fc0 msgr2=0x7fa34403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa344038fc0 0x7fa34403b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0098c0 tx=0x7fa34c006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 msgr2=0x7fa36019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa36019d6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3500097f0 tx=0x7fa3500327b0 comp rx=0 tx=0).stop 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 shutdown_connections 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa344038fc0 0x7fa34403b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 --2- 172.21.15.38:0/3712548356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa360109750 0x7fa36019d6b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.040+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 >> 172.21.15.38:0/3712548356 conn(0x7fa36007ccc0 msgr2=0x7fa360105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.041+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 shutdown_connections 2024-09-12T12:15:37.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:37.041+0000 7fa364e00640 1 -- 172.21.15.38:0/3712548356 wait complete. 2024-09-12T12:15:37.639 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial admin user... 2024-09-12T12:15:37.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:37 smithi038 ceph-mon[30810]: mgrmap e12: x(active, since 2s) 2024-09-12T12:15:37.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:37 smithi038 ceph-mon[30810]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:37.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:37.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:37.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:40.047 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Cnb6P24FTVdMxa/kYapI9ONHqO2WvtZfvTmiCv4XSmw5Hr9DqGUuO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726143339, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.893+0000 7fa197200640 1 Processor -- start 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.893+0000 7fa197200640 1 -- start start 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.893+0000 7fa197200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19007c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.893+0000 7fa197200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa19007c7f0 con 0x7fa19007de00 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.894+0000 7fa18fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19007c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.894+0000 7fa18fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19007c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48954/0 (socket says 172.21.15.38:48954) 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.894+0000 7fa18fe00640 1 -- 172.21.15.38:0/568602357 learned_addr learned my addr 172.21.15.38:0/568602357 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.894+0000 7fa18fe00640 1 -- 172.21.15.38:0/568602357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19007c970 con 0x7fa19007de00 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.895+0000 7fa18fe00640 1 --2- 172.21.15.38:0/568602357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19007c2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa180009820 tx=0x7fa18002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa0d3c930e12d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa18ea00640 1 -- 172.21.15.38:0/568602357 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa180037070 con 0x7fa19007de00 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa18ea00640 1 -- 172.21.15.38:0/568602357 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa180032920 con 0x7fa19007de00 2024-09-12T12:15:40.048 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa18ea00640 1 -- 172.21.15.38:0/568602357 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa180030810 con 0x7fa19007de00 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa197200640 1 -- 172.21.15.38:0/568602357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 msgr2=0x7fa19007c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa197200640 1 --2- 172.21.15.38:0/568602357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19007c2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa180009820 tx=0x7fa18002a270 comp rx=0 tx=0).stop 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa197200640 1 -- 172.21.15.38:0/568602357 shutdown_connections 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa197200640 1 --2- 172.21.15.38:0/568602357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19007c2b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa197200640 1 -- 172.21.15.38:0/568602357 >> 172.21.15.38:0/568602357 conn(0x7fa190102ce0 msgr2=0x7fa190105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa197200640 1 -- 172.21.15.38:0/568602357 shutdown_connections 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.896+0000 7fa197200640 1 -- 172.21.15.38:0/568602357 wait complete. 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.897+0000 7fa197200640 1 Processor -- start 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.898+0000 7fa197200640 1 -- start start 2024-09-12T12:15:40.049 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.898+0000 7fa197200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.898+0000 7fa197200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa19010db40 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.898+0000 7fa18fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.898+0000 7fa18fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48956/0 (socket says 172.21.15.38:48956) 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.898+0000 7fa18fe00640 1 -- 172.21.15.38:0/3711570239 learned_addr learned my addr 172.21.15.38:0/3711570239 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.898+0000 7fa18fe00640 1 -- 172.21.15.38:0/3711570239 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19019dbe0 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.899+0000 7fa18fe00640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19019d6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097f0 tx=0x7fa1800327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.899+0000 7fa18cc00640 1 -- 172.21.15.38:0/3711570239 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa180037040 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.899+0000 7fa18cc00640 1 -- 172.21.15.38:0/3711570239 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa180030cc0 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.899+0000 7fa18cc00640 1 -- 172.21.15.38:0/3711570239 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa18003a6b0 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.899+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19019de70 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.899+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1901a0b60 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.900+0000 7fa18cc00640 1 -- 172.21.15.38:0/3711570239 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa18003baf0 con 0x7fa19007de00 2024-09-12T12:15:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.900+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19007c330 con 0x7fa19007de00 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.901+0000 7fa18cc00640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa174039020 0x7fa17403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.901+0000 7fa18cc00640 1 -- 172.21.15.38:0/3711570239 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa18006c6b0 con 0x7fa19007de00 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.901+0000 7fa18f400640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa174039020 0x7fa17403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.902+0000 7fa18f400640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa174039020 0x7fa17403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098c0 tx=0x7fa17c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:38.906+0000 7fa18cc00640 1 -- 172.21.15.38:0/3711570239 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1800371e0 con 0x7fa19007de00 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.132+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fa1901a0d30 con 0x7fa174039020 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.407+0000 7fa18cc00640 1 -- 172.21.15.38:0/3711570239 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fa1901a0d30 con 0x7fa174039020 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa174039020 msgr2=0x7fa17403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa174039020 0x7fa17403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098c0 tx=0x7fa17c006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 msgr2=0x7fa19019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19019d6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097f0 tx=0x7fa1800327b0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 shutdown_connections 2024-09-12T12:15:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa174039020 0x7fa17403b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 --2- 172.21.15.38:0/3711570239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa19007de00 0x7fa19019d6a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 >> 172.21.15.38:0/3711570239 conn(0x7fa190102ce0 msgr2=0x7fa190103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 shutdown_connections 2024-09-12T12:15:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:39.409+0000 7fa197200640 1 -- 172.21.15.38:0/3711570239 wait complete. 2024-09-12T12:15:40.052 INFO:teuthology.orchestra.run.smithi038.stdout:Fetching dashboard port number... 2024-09-12T12:15:40.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:40 smithi038 ceph-mon[30810]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:40.713 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:40 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:41.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T12:15:41.388 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.516+0000 7f0520e00640 1 Processor -- start 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.516+0000 7f0520e00640 1 -- start start 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.516+0000 7f0520e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.516+0000 7f0520e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f051c07c810 con 0x7f051c07de20 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.517+0000 7f0519e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.517+0000 7f0519e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c07c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48958/0 (socket says 172.21.15.38:48958) 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.517+0000 7f0519e00640 1 -- 172.21.15.38:0/2330127663 learned_addr learned my addr 172.21.15.38:0/2330127663 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.517+0000 7f0519e00640 1 -- 172.21.15.38:0/2330127663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c07c990 con 0x7f051c07de20 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.518+0000 7f0519e00640 1 --2- 172.21.15.38:0/2330127663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c07c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f050c009820 tx=0x7f050c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d401ac8027814c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.518+0000 7f0518a00640 1 -- 172.21.15.38:0/2330127663 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f050c037070 con 0x7f051c07de20 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.518+0000 7f0518a00640 1 -- 172.21.15.38:0/2330127663 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f050c032920 con 0x7f051c07de20 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.518+0000 7f0518a00640 1 -- 172.21.15.38:0/2330127663 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f050c030890 con 0x7f051c07de20 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.519+0000 7f0520e00640 1 -- 172.21.15.38:0/2330127663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 msgr2=0x7f051c07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.389 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.519+0000 7f0520e00640 1 --2- 172.21.15.38:0/2330127663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c07c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f050c009820 tx=0x7f050c02a300 comp rx=0 tx=0).stop 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.519+0000 7f0520e00640 1 -- 172.21.15.38:0/2330127663 shutdown_connections 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.519+0000 7f0520e00640 1 --2- 172.21.15.38:0/2330127663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c07c2d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.519+0000 7f0520e00640 1 -- 172.21.15.38:0/2330127663 >> 172.21.15.38:0/2330127663 conn(0x7f051c102ce0 msgr2=0x7f051c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.519+0000 7f0520e00640 1 -- 172.21.15.38:0/2330127663 shutdown_connections 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.519+0000 7f0520e00640 1 -- 172.21.15.38:0/2330127663 wait complete. 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.520+0000 7f0520e00640 1 Processor -- start 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.520+0000 7f0520e00640 1 -- start start 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.520+0000 7f0520e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.520+0000 7f0520e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f051c10db20 con 0x7f051c07de20 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.521+0000 7f0519e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.521+0000 7f0519e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48962/0 (socket says 172.21.15.38:48962) 2024-09-12T12:15:41.390 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.521+0000 7f0519e00640 1 -- 172.21.15.38:0/622467115 learned_addr learned my addr 172.21.15.38:0/622467115 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.521+0000 7f0519e00640 1 -- 172.21.15.38:0/622467115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c19dc20 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.521+0000 7f0519e00640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c19d6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f050c02a820 tx=0x7f050c0308b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.521+0000 7f0512a00640 1 -- 172.21.15.38:0/622467115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f050c037040 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.521+0000 7f0512a00640 1 -- 172.21.15.38:0/622467115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f050c040070 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.522+0000 7f0512a00640 1 -- 172.21.15.38:0/622467115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f050c03a390 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.522+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c19deb0 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.522+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c1a0ba0 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.523+0000 7f0512a00640 1 -- 172.21.15.38:0/622467115 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f050c030b70 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.523+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051c07c350 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.523+0000 7f0512a00640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05000390c0 0x7f050003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.523+0000 7f0512a00640 1 -- 172.21.15.38:0/622467115 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f050c06c3f0 con 0x7f051c07de20 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.524+0000 7f0519400640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05000390c0 0x7f050003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:41.391 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.524+0000 7f0519400640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05000390c0 0x7f050003b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05080098c0 tx=0x7f0508006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.529+0000 7f0512a00640 1 -- 172.21.15.38:0/622467115 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f050c042770 con 0x7f051c07de20 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.712+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f051c1a1190 con 0x7f051c07de20 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.713+0000 7f0512a00640 1 -- 172.21.15.38:0/622467115 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f050c03b4e0 con 0x7f051c07de20 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.715+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05000390c0 msgr2=0x7f050003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.715+0000 7f0520e00640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05000390c0 0x7f050003b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05080098c0 tx=0x7f0508006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.715+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 msgr2=0x7f051c19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.715+0000 7f0520e00640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c19d6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f050c02a820 tx=0x7f050c0308b0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.716+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 shutdown_connections 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.716+0000 7f0520e00640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05000390c0 0x7f050003b580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.716+0000 7f0520e00640 1 --2- 172.21.15.38:0/622467115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f051c07de20 0x7f051c19d6e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.716+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 >> 172.21.15.38:0/622467115 conn(0x7f051c102ce0 msgr2=0x7f051c103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.716+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 shutdown_connections 2024-09-12T12:15:41.392 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:40.716+0000 7f0520e00640 1 -- 172.21.15.38:0/622467115 wait complete. 2024-09-12T12:15:41.404 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:15:41.404 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-12T12:15:41.418 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:15:41.418 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-12T12:15:41.418 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-12T12:15:41.419 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T12:15:41.420 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph Dashboard is now available at: 2024-09-12T12:15:41.421 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:41.421 INFO:teuthology.orchestra.run.smithi038.stdout: URL: https://smithi038.front.sepia.ceph.com:8443/ 2024-09-12T12:15:41.421 INFO:teuthology.orchestra.run.smithi038.stdout: User: admin 2024-09-12T12:15:41.421 INFO:teuthology.orchestra.run.smithi038.stdout: Password: mj6444pkgg 2024-09-12T12:15:41.421 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:41.421 INFO:teuthology.orchestra.run.smithi038.stdout:Saving cluster configuration to /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config directory 2024-09-12T12:15:41.662 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:41 smithi038 ceph-mon[30810]: mgrmap e13: x(active, since 6s) 2024-09-12T12:15:41.662 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:41 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/622467115' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T12:15:42.753 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.881+0000 7f6390000640 1 Processor -- start 2024-09-12T12:15:42.754 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.882+0000 7f6390000640 1 -- start start 2024-09-12T12:15:42.754 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.882+0000 7f6390000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f6388109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:42.754 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.882+0000 7f6390000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f638810a260 con 0x7f6388109890 2024-09-12T12:15:42.754 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.882+0000 7f638d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f6388109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:42.754 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.882+0000 7f638d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f6388109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48966/0 (socket says 172.21.15.38:48966) 2024-09-12T12:15:42.754 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.882+0000 7f638d600640 1 -- 172.21.15.38:0/929881131 learned_addr learned my addr 172.21.15.38:0/929881131 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:42.754 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.883+0000 7f638d600640 1 -- 172.21.15.38:0/929881131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638810a890 con 0x7f6388109890 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.884+0000 7f638d600640 1 --2- 172.21.15.38:0/929881131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f6388109c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f637c009820 tx=0x7f637c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6a570055431a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.884+0000 7f6387e00640 1 -- 172.21.15.38:0/929881131 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c037070 con 0x7f6388109890 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.884+0000 7f6387e00640 1 -- 172.21.15.38:0/929881131 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c032920 con 0x7f6388109890 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.884+0000 7f6387e00640 1 -- 172.21.15.38:0/929881131 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c030810 con 0x7f6388109890 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.884+0000 7f6390000640 1 -- 172.21.15.38:0/929881131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 msgr2=0x7f6388109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.884+0000 7f6390000640 1 --2- 172.21.15.38:0/929881131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f6388109c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f637c009820 tx=0x7f637c02a270 comp rx=0 tx=0).stop 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.885+0000 7f6390000640 1 -- 172.21.15.38:0/929881131 shutdown_connections 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.885+0000 7f6390000640 1 --2- 172.21.15.38:0/929881131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f6388109c90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.885+0000 7f6390000640 1 -- 172.21.15.38:0/929881131 >> 172.21.15.38:0/929881131 conn(0x7f638807ccc0 msgr2=0x7f638807d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:42.755 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.885+0000 7f6390000640 1 -- 172.21.15.38:0/929881131 shutdown_connections 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.885+0000 7f6390000640 1 -- 172.21.15.38:0/929881131 wait complete. 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.886+0000 7f6390000640 1 Processor -- start 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.886+0000 7f6390000640 1 -- start start 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.886+0000 7f6390000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f638819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.886+0000 7f6390000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f638810dc40 con 0x7f6388109890 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.886+0000 7f638d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f638819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.886+0000 7f638d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f638819d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48970/0 (socket says 172.21.15.38:48970) 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.886+0000 7f638d600640 1 -- 172.21.15.38:0/126067970 learned_addr learned my addr 172.21.15.38:0/126067970 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.887+0000 7f638d600640 1 -- 172.21.15.38:0/126067970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638819dc70 con 0x7f6388109890 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.887+0000 7f638d600640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f638819d730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097f0 tx=0x7f637c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:42.756 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.887+0000 7f6386000640 1 -- 172.21.15.38:0/126067970 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c037040 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.887+0000 7f6386000640 1 -- 172.21.15.38:0/126067970 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c030cc0 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.887+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638819df00 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.887+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63881a0bf0 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.887+0000 7f6386000640 1 -- 172.21.15.38:0/126067970 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c03a630 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.888+0000 7f6386000640 1 -- 172.21.15.38:0/126067970 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f637c03b3f0 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.888+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6388109d10 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.889+0000 7f6386000640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f63700390c0 0x7f637003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.889+0000 7f6386000640 1 -- 172.21.15.38:0/126067970 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f637c06c7d0 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.889+0000 7f638cc00640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f63700390c0 0x7f637003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.890+0000 7f638cc00640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f63700390c0 0x7f637003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63740098c0 tx=0x7f6374006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:41.894+0000 7f6386000640 1 -- 172.21.15.38:0/126067970 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f637c041890 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.178+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f63881a11e0 con 0x7f6388109890 2024-09-12T12:15:42.757 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.181+0000 7f6386000640 1 -- 172.21.15.38:0/126067970 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f637c0371e0 con 0x7f6388109890 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f63700390c0 msgr2=0x7f637003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f63700390c0 0x7f637003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63740098c0 tx=0x7f6374006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 msgr2=0x7f638819d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f638819d730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097f0 tx=0x7f637c0327b0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 shutdown_connections 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f63700390c0 0x7f637003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 --2- 172.21.15.38:0/126067970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6388109890 0x7f638819d730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 >> 172.21.15.38:0/126067970 conn(0x7f638807ccc0 msgr2=0x7f6388107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 shutdown_connections 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-12T12:15:42.183+0000 7f6390000640 1 -- 172.21.15.38:0/126067970 wait complete. 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T12:15:42.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: ceph telemetry on 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout:For more information see: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T12:15:42.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:42.760 INFO:teuthology.orchestra.run.smithi038.stdout:Bootstrap complete. 2024-09-12T12:15:42.809 INFO:tasks.cephadm:Fetching config... 2024-09-12T12:15:42.809 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:15:42.809 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T12:15:42.846 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T12:15:42.846 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:15:42.846 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T12:15:42.924 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T12:15:42.924 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:15:42.925 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T12:15:43.021 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T12:15:43.021 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:15:43.021 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T12:15:43.097 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T12:15:43.097 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR4vEyRGxc49cCav8mzwoEXFWE+hgSQTJLX5sPqaIelbn98Atk4zvWzLGIrAezbpwFVnbqPcSeMRpZATrtiapu2D83rBEeGyQ2oN68+T8RhBfj/RGk5a0x8cfLle8QzaU6XskInHwpgbHR96pnShF9AMmXR+j51oJ79OyQYPBub4/hnDfqj+AsAV02hA0/k6vpiNyCHW5l7PPKX9jH4MIKCADm1FEEwodQMH7/nLydvoqR2rc691zMEvg2lJpxC5BKbrl/GcSuxmjfyL1CVock6iR7BSre88XGDKkAQOJI2HHQTdGEoTV3pqH/mxHYsv03m17h/kydtGDN2kAXT18mu3GpB7rvsK0uUk1jjDwy2Jy9eaMEodbKVO+ftzIDp9u1DTXJMiLt7iDOSIc3mhQGoU2c+4l5FjbtwnvX68Yh2dHWSJJxw+/fnqQcz/1u39xAB2EYtJOQzm6hmOgI2MdnAxWtYQ1HTycAeJtJK0BLs849o+/aRVPqbYCXILsqpV8= ceph-726420ce-7100-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:15:43.232 INFO:teuthology.orchestra.run.smithi038.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR4vEyRGxc49cCav8mzwoEXFWE+hgSQTJLX5sPqaIelbn98Atk4zvWzLGIrAezbpwFVnbqPcSeMRpZATrtiapu2D83rBEeGyQ2oN68+T8RhBfj/RGk5a0x8cfLle8QzaU6XskInHwpgbHR96pnShF9AMmXR+j51oJ79OyQYPBub4/hnDfqj+AsAV02hA0/k6vpiNyCHW5l7PPKX9jH4MIKCADm1FEEwodQMH7/nLydvoqR2rc691zMEvg2lJpxC5BKbrl/GcSuxmjfyL1CVock6iR7BSre88XGDKkAQOJI2HHQTdGEoTV3pqH/mxHYsv03m17h/kydtGDN2kAXT18mu3GpB7rvsK0uUk1jjDwy2Jy9eaMEodbKVO+ftzIDp9u1DTXJMiLt7iDOSIc3mhQGoU2c+4l5FjbtwnvX68Yh2dHWSJJxw+/fnqQcz/1u39xAB2EYtJOQzm6hmOgI2MdnAxWtYQ1HTycAeJtJK0BLs849o+/aRVPqbYCXILsqpV8= ceph-726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:15:43.249 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:43 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/126067970' entity='client.admin' 2024-09-12T12:15:43.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR4vEyRGxc49cCav8mzwoEXFWE+hgSQTJLX5sPqaIelbn98Atk4zvWzLGIrAezbpwFVnbqPcSeMRpZATrtiapu2D83rBEeGyQ2oN68+T8RhBfj/RGk5a0x8cfLle8QzaU6XskInHwpgbHR96pnShF9AMmXR+j51oJ79OyQYPBub4/hnDfqj+AsAV02hA0/k6vpiNyCHW5l7PPKX9jH4MIKCADm1FEEwodQMH7/nLydvoqR2rc691zMEvg2lJpxC5BKbrl/GcSuxmjfyL1CVock6iR7BSre88XGDKkAQOJI2HHQTdGEoTV3pqH/mxHYsv03m17h/kydtGDN2kAXT18mu3GpB7rvsK0uUk1jjDwy2Jy9eaMEodbKVO+ftzIDp9u1DTXJMiLt7iDOSIc3mhQGoU2c+4l5FjbtwnvX68Yh2dHWSJJxw+/fnqQcz/1u39xAB2EYtJOQzm6hmOgI2MdnAxWtYQ1HTycAeJtJK0BLs849o+/aRVPqbYCXILsqpV8= ceph-726420ce-7100-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:15:43.299 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR4vEyRGxc49cCav8mzwoEXFWE+hgSQTJLX5sPqaIelbn98Atk4zvWzLGIrAezbpwFVnbqPcSeMRpZATrtiapu2D83rBEeGyQ2oN68+T8RhBfj/RGk5a0x8cfLle8QzaU6XskInHwpgbHR96pnShF9AMmXR+j51oJ79OyQYPBub4/hnDfqj+AsAV02hA0/k6vpiNyCHW5l7PPKX9jH4MIKCADm1FEEwodQMH7/nLydvoqR2rc691zMEvg2lJpxC5BKbrl/GcSuxmjfyL1CVock6iR7BSre88XGDKkAQOJI2HHQTdGEoTV3pqH/mxHYsv03m17h/kydtGDN2kAXT18mu3GpB7rvsK0uUk1jjDwy2Jy9eaMEodbKVO+ftzIDp9u1DTXJMiLt7iDOSIc3mhQGoU2c+4l5FjbtwnvX68Yh2dHWSJJxw+/fnqQcz/1u39xAB2EYtJOQzm6hmOgI2MdnAxWtYQ1HTycAeJtJK0BLs849o+/aRVPqbYCXILsqpV8= ceph-726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:15:43.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR4vEyRGxc49cCav8mzwoEXFWE+hgSQTJLX5sPqaIelbn98Atk4zvWzLGIrAezbpwFVnbqPcSeMRpZATrtiapu2D83rBEeGyQ2oN68+T8RhBfj/RGk5a0x8cfLle8QzaU6XskInHwpgbHR96pnShF9AMmXR+j51oJ79OyQYPBub4/hnDfqj+AsAV02hA0/k6vpiNyCHW5l7PPKX9jH4MIKCADm1FEEwodQMH7/nLydvoqR2rc691zMEvg2lJpxC5BKbrl/GcSuxmjfyL1CVock6iR7BSre88XGDKkAQOJI2HHQTdGEoTV3pqH/mxHYsv03m17h/kydtGDN2kAXT18mu3GpB7rvsK0uUk1jjDwy2Jy9eaMEodbKVO+ftzIDp9u1DTXJMiLt7iDOSIc3mhQGoU2c+4l5FjbtwnvX68Yh2dHWSJJxw+/fnqQcz/1u39xAB2EYtJOQzm6hmOgI2MdnAxWtYQ1HTycAeJtJK0BLs849o+/aRVPqbYCXILsqpV8= ceph-726420ce-7100-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:15:43.354 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR4vEyRGxc49cCav8mzwoEXFWE+hgSQTJLX5sPqaIelbn98Atk4zvWzLGIrAezbpwFVnbqPcSeMRpZATrtiapu2D83rBEeGyQ2oN68+T8RhBfj/RGk5a0x8cfLle8QzaU6XskInHwpgbHR96pnShF9AMmXR+j51oJ79OyQYPBub4/hnDfqj+AsAV02hA0/k6vpiNyCHW5l7PPKX9jH4MIKCADm1FEEwodQMH7/nLydvoqR2rc691zMEvg2lJpxC5BKbrl/GcSuxmjfyL1CVock6iR7BSre88XGDKkAQOJI2HHQTdGEoTV3pqH/mxHYsv03m17h/kydtGDN2kAXT18mu3GpB7rvsK0uUk1jjDwy2Jy9eaMEodbKVO+ftzIDp9u1DTXJMiLt7iDOSIc3mhQGoU2c+4l5FjbtwnvX68Yh2dHWSJJxw+/fnqQcz/1u39xAB2EYtJOQzm6hmOgI2MdnAxWtYQ1HTycAeJtJK0BLs849o+/aRVPqbYCXILsqpV8= ceph-726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:15:43.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T12:15:43.734 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:44.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.284+0000 7faff9c00640 1 -- 172.21.15.38:0/4046439583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 msgr2=0x7faff4103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:44.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.284+0000 7faff9c00640 1 --2- 172.21.15.38:0/4046439583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4103bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009880 tx=0x7fafe402a5d0 comp rx=0 tx=0).stop 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.284+0000 7faff9c00640 1 -- 172.21.15.38:0/4046439583 shutdown_connections 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.284+0000 7faff9c00640 1 --2- 172.21.15.38:0/4046439583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4103bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.284+0000 7faff9c00640 1 -- 172.21.15.38:0/4046439583 >> 172.21.15.38:0/4046439583 conn(0x7faff40fefc0 msgr2=0x7faff4101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.284+0000 7faff9c00640 1 -- 172.21.15.38:0/4046439583 shutdown_connections 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.284+0000 7faff9c00640 1 -- 172.21.15.38:0/4046439583 wait complete. 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.285+0000 7faff9c00640 1 Processor -- start 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.285+0000 7faff9c00640 1 -- start start 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.286+0000 7faff9c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.286+0000 7faff9c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faff4109900 con 0x7faff41037f0 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.286+0000 7faff2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:44.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.286+0000 7faff2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49000/0 (socket says 172.21.15.38:49000) 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.286+0000 7faff2a00640 1 -- 172.21.15.38:0/3840102417 learned_addr learned my addr 172.21.15.38:0/3840102417 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.286+0000 7faff2a00640 1 -- 172.21.15.38:0/3840102417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff41994c0 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.287+0000 7faff2a00640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004f60 tx=0x7fafe40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.287+0000 7fafeb400640 1 -- 172.21.15.38:0/3840102417 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe403f070 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.287+0000 7fafeb400640 1 -- 172.21.15.38:0/3840102417 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafe4004cc0 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.287+0000 7fafeb400640 1 -- 172.21.15.38:0/3840102417 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe4035030 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.287+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff4199750 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.287+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff419c440 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.288+0000 7fafeb400640 1 -- 172.21.15.38:0/3840102417 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fafe4042070 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.288+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff410a080 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.289+0000 7fafeb400640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fafd80390c0 0x7fafd803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.289+0000 7fafeb400640 1 -- 172.21.15.38:0/3840102417 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fafe406ce00 con 0x7faff41037f0 2024-09-12T12:15:44.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.289+0000 7faff2000640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fafd80390c0 0x7fafd803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:44.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.290+0000 7faff2000640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fafd80390c0 0x7fafd803b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fafe00098c0 tx=0x7fafe0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:44.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.294+0000 7fafeb400640 1 -- 172.21.15.38:0/3840102417 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafe403a3c0 con 0x7faff41037f0 2024-09-12T12:15:44.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.545+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7faff402d830 con 0x7faff41037f0 2024-09-12T12:15:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.550+0000 7fafeb400640 1 -- 172.21.15.38:0/3840102417 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fafe4003dd0 con 0x7faff41037f0 2024-09-12T12:15:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.552+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fafd80390c0 msgr2=0x7fafd803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.552+0000 7faff9c00640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fafd80390c0 0x7fafd803b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fafe00098c0 tx=0x7fafe0006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 msgr2=0x7faff4198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafe4004f60 tx=0x7fafe40048f0 comp rx=0 tx=0).stop 2024-09-12T12:15:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 shutdown_connections 2024-09-12T12:15:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fafd80390c0 0x7fafd803b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 --2- 172.21.15.38:0/3840102417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faff41037f0 0x7faff4198f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 >> 172.21.15.38:0/3840102417 conn(0x7faff40fefc0 msgr2=0x7faff40ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 shutdown_connections 2024-09-12T12:15:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:44.553+0000 7faff9c00640 1 -- 172.21.15.38:0/3840102417 wait complete. 2024-09-12T12:15:45.687 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T12:15:45.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T12:15:45.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:45 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3840102417' entity='client.admin' 2024-09-12T12:15:46.248 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.751+0000 7f25c6400640 1 -- 172.21.15.38:0/3107495261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 msgr2=0x7f25c01019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.751+0000 7f25c6400640 1 --2- 172.21.15.38:0/3107495261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c01019f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009880 tx=0x7f25b002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.751+0000 7f25c6400640 1 -- 172.21.15.38:0/3107495261 shutdown_connections 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.751+0000 7f25c6400640 1 --2- 172.21.15.38:0/3107495261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c01019f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.751+0000 7f25c6400640 1 -- 172.21.15.38:0/3107495261 >> 172.21.15.38:0/3107495261 conn(0x7f25c00fcd80 msgr2=0x7f25c00ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.751+0000 7f25c6400640 1 -- 172.21.15.38:0/3107495261 shutdown_connections 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.751+0000 7f25c6400640 1 -- 172.21.15.38:0/3107495261 wait complete. 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.752+0000 7f25c6400640 1 Processor -- start 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.752+0000 7f25c6400640 1 -- start start 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.753+0000 7f25c6400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c0198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.753+0000 7f25c6400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0107700 con 0x7f25c01015f0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.753+0000 7f25bf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c0198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.753+0000 7f25bf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c0198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40336/0 (socket says 172.21.15.38:40336) 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.753+0000 7f25bf400640 1 -- 172.21.15.38:0/1231289903 learned_addr learned my addr 172.21.15.38:0/1231289903 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.753+0000 7f25bf400640 1 -- 172.21.15.38:0/1231289903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c0199500 con 0x7f25c01015f0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.754+0000 7f25bf400640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c0198fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25b0004f60 tx=0x7f25b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.754+0000 7f25bcc00640 1 -- 172.21.15.38:0/1231289903 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b003f070 con 0x7f25c01015f0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.754+0000 7f25bcc00640 1 -- 172.21.15.38:0/1231289903 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b0004d40 con 0x7f25c01015f0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.754+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c0199790 con 0x7f25c01015f0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.754+0000 7f25bcc00640 1 -- 172.21.15.38:0/1231289903 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b0035030 con 0x7f25c01015f0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.754+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c019c480 con 0x7f25c01015f0 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.756+0000 7f25bcc00640 1 -- 172.21.15.38:0/1231289903 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f25b0042070 con 0x7f25c01015f0 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.756+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c0107e80 con 0x7f25c01015f0 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.756+0000 7f25bcc00640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f25a40390c0 0x7f25a403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.756+0000 7f25bcc00640 1 -- 172.21.15.38:0/1231289903 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f25b006cd60 con 0x7f25c01015f0 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.756+0000 7f25b7e00640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f25a40390c0 0x7f25a403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.757+0000 7f25b7e00640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f25a40390c0 0x7f25a403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f25a80098c0 tx=0x7f25a8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.761+0000 7f25bcc00640 1 -- 172.21.15.38:0/1231289903 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25b004a260 con 0x7f25c01015f0 2024-09-12T12:15:46.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.971+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f25c002d830 con 0x7f25a40390c0 2024-09-12T12:15:46.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.975+0000 7f25bcc00640 1 -- 172.21.15.38:0/1231289903 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f25c002d830 con 0x7f25a40390c0 2024-09-12T12:15:46.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f25a40390c0 msgr2=0x7f25a403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f25a40390c0 0x7f25a403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f25a80098c0 tx=0x7f25a8006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 msgr2=0x7f25c0198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c0198fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25b0004f60 tx=0x7f25b00048f0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 shutdown_connections 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f25a40390c0 0x7f25a403b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 --2- 172.21.15.38:0/1231289903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25c01015f0 0x7f25c0198fc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 >> 172.21.15.38:0/1231289903 conn(0x7f25c00fcd80 msgr2=0x7f25c00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 shutdown_connections 2024-09-12T12:15:46.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:46.977+0000 7f25c6400640 1 -- 172.21.15.38:0/1231289903 wait complete. 2024-09-12T12:15:47.910 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi071 2024-09-12T12:15:47.911 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:15:47.911 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.conf 2024-09-12T12:15:47.930 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:15:47.930 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:15:47.988 INFO:tasks.cephadm:Adding host smithi071 to orchestrator... 2024-09-12T12:15:47.988 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch host add smithi071 2024-09-12T12:15:48.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:47 smithi038 ceph-mon[30810]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:48.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:48.368 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.977+0000 7f18c5600640 1 -- 172.21.15.38:0/3227993414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 msgr2=0x7f18c0103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.977+0000 7f18c5600640 1 --2- 172.21.15.38:0/3227993414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0103bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009880 tx=0x7f18b002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.977+0000 7f18c5600640 1 -- 172.21.15.38:0/3227993414 shutdown_connections 2024-09-12T12:15:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.977+0000 7f18c5600640 1 --2- 172.21.15.38:0/3227993414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0103bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.977+0000 7f18c5600640 1 -- 172.21.15.38:0/3227993414 >> 172.21.15.38:0/3227993414 conn(0x7f18c00fefc0 msgr2=0x7f18c0101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.977+0000 7f18c5600640 1 -- 172.21.15.38:0/3227993414 shutdown_connections 2024-09-12T12:15:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.977+0000 7f18c5600640 1 -- 172.21.15.38:0/3227993414 wait complete. 2024-09-12T12:15:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.978+0000 7f18c5600640 1 Processor -- start 2024-09-12T12:15:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.978+0000 7f18c5600640 1 -- start start 2024-09-12T12:15:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.979+0000 7f18c5600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.979+0000 7f18c5600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0109900 con 0x7f18c01037f0 2024-09-12T12:15:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.979+0000 7f18bea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.979+0000 7f18bea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40352/0 (socket says 172.21.15.38:40352) 2024-09-12T12:15:48.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.979+0000 7f18bea00640 1 -- 172.21.15.38:0/1206137230 learned_addr learned my addr 172.21.15.38:0/1206137230 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:48.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.979+0000 7f18bea00640 1 -- 172.21.15.38:0/1206137230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c01994c0 con 0x7f18c01037f0 2024-09-12T12:15:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.980+0000 7f18bea00640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0198f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18b0004f60 tx=0x7f18b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.980+0000 7f18b7400640 1 -- 172.21.15.38:0/1206137230 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b003f070 con 0x7f18c01037f0 2024-09-12T12:15:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.980+0000 7f18b7400640 1 -- 172.21.15.38:0/1206137230 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b0004cc0 con 0x7f18c01037f0 2024-09-12T12:15:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.980+0000 7f18b7400640 1 -- 172.21.15.38:0/1206137230 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b0035030 con 0x7f18c01037f0 2024-09-12T12:15:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.980+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c0199750 con 0x7f18c01037f0 2024-09-12T12:15:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.980+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c019c440 con 0x7f18c01037f0 2024-09-12T12:15:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.981+0000 7f18b7400640 1 -- 172.21.15.38:0/1206137230 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f18b0042070 con 0x7f18c01037f0 2024-09-12T12:15:48.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.981+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c010a080 con 0x7f18c01037f0 2024-09-12T12:15:48.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.982+0000 7f18b7400640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18a40390c0 0x7f18a403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.982+0000 7f18b7400640 1 -- 172.21.15.38:0/1206137230 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f18b006cd10 con 0x7f18c01037f0 2024-09-12T12:15:48.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.982+0000 7f18be000640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18a40390c0 0x7f18a403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.983+0000 7f18be000640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18a40390c0 0x7f18a403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0098c0 tx=0x7f18ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:48.987+0000 7f18b7400640 1 -- 172.21.15.38:0/1206137230 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18b0040260 con 0x7f18c01037f0 2024-09-12T12:15:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:49.178+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}) -- 0x7f18c002d830 con 0x7f18a40390c0 2024-09-12T12:15:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:15:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:15:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:15:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:49 smithi038 ceph-mon[30810]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-12T12:15:49.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:49 smithi038 ceph-mon[30810]: Updating smithi038:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:15:50.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:50 smithi038 ceph-mon[30810]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:15:50.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:50 smithi038 ceph-mon[30810]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:50.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:50 smithi038 ceph-mon[30810]: Updating smithi038:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:15:50.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:50.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:50.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:15:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:15:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:51 smithi038 ceph-mon[30810]: Deploying cephadm binary to smithi071 2024-09-12T12:15:53.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.033+0000 7f18b7400640 1 -- 172.21.15.38:0/1206137230 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f18c002d830 con 0x7f18a40390c0 2024-09-12T12:15:53.034 INFO:teuthology.orchestra.run.smithi038.stdout:Added host 'smithi071' with addr '172.21.15.71' 2024-09-12T12:15:53.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18a40390c0 msgr2=0x7f18a403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18a40390c0 0x7f18a403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0098c0 tx=0x7f18ac006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 msgr2=0x7f18c0198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0198f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18b0004f60 tx=0x7f18b00048f0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 shutdown_connections 2024-09-12T12:15:53.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18a40390c0 0x7f18a403b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 --2- 172.21.15.38:0/1206137230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c01037f0 0x7f18c0198f80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 >> 172.21.15.38:0/1206137230 conn(0x7f18c00fefc0 msgr2=0x7f18c00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.035+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 shutdown_connections 2024-09-12T12:15:53.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:53.036+0000 7f18c5600640 1 -- 172.21.15.38:0/1206137230 wait complete. 2024-09-12T12:15:53.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T12:15:54.067 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:54.359 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:54.360 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:54 smithi038 ceph-mon[30810]: Added host smithi071 2024-09-12T12:15:54.360 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:54.360 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:54.360 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:54.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.667+0000 7f36c7200640 1 -- 172.21.15.38:0/3699010438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 msgr2=0x7f36c8109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.667+0000 7f36c7200640 1 --2- 172.21.15.38:0/3699010438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c8109b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009880 tx=0x7f36b802a5d0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.668+0000 7f36c7200640 1 -- 172.21.15.38:0/3699010438 shutdown_connections 2024-09-12T12:15:54.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.668+0000 7f36c7200640 1 --2- 172.21.15.38:0/3699010438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c8109b20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.668+0000 7f36c7200640 1 -- 172.21.15.38:0/3699010438 >> 172.21.15.38:0/3699010438 conn(0x7f36c80ff2c0 msgr2=0x7f36c81016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.668+0000 7f36c7200640 1 -- 172.21.15.38:0/3699010438 shutdown_connections 2024-09-12T12:15:54.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.668+0000 7f36c7200640 1 -- 172.21.15.38:0/3699010438 wait complete. 2024-09-12T12:15:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.668+0000 7f36c7200640 1 Processor -- start 2024-09-12T12:15:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.669+0000 7f36c7200640 1 -- start start 2024-09-12T12:15:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.669+0000 7f36c7200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c81991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.669+0000 7f36c7200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f36c810dd50 con 0x7f36c8109740 2024-09-12T12:15:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.669+0000 7f36c5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c81991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.669+0000 7f36c5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c81991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40368/0 (socket says 172.21.15.38:40368) 2024-09-12T12:15:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.669+0000 7f36c5e00640 1 -- 172.21.15.38:0/3834030743 learned_addr learned my addr 172.21.15.38:0/3834030743 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:54.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.670+0000 7f36c5e00640 1 -- 172.21.15.38:0/3834030743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c8199720 con 0x7f36c8109740 2024-09-12T12:15:54.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.670+0000 7f36c5e00640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c81991e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009230 tx=0x7f36b8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.670+0000 7f36bea00640 1 -- 172.21.15.38:0/3834030743 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b803f070 con 0x7f36c8109740 2024-09-12T12:15:54.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.670+0000 7f36bea00640 1 -- 172.21.15.38:0/3834030743 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b803bc80 con 0x7f36c8109740 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.670+0000 7f36bea00640 1 -- 172.21.15.38:0/3834030743 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b8035030 con 0x7f36c8109740 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.670+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c8199a10 con 0x7f36c8109740 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.670+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c819dab0 con 0x7f36c8109740 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.671+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c8104ce0 con 0x7f36c8109740 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.671+0000 7f36bea00640 1 -- 172.21.15.38:0/3834030743 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f36b8042070 con 0x7f36c8109740 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.672+0000 7f36bea00640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f36ac0390c0 0x7f36ac03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.672+0000 7f36bea00640 1 -- 172.21.15.38:0/3834030743 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f36b806ccc0 con 0x7f36c8109740 2024-09-12T12:15:54.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.672+0000 7f36c5400640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f36ac0390c0 0x7f36ac03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.673+0000 7f36c5400640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f36ac0390c0 0x7f36ac03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f36b40098c0 tx=0x7f36b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.677+0000 7f36bea00640 1 -- 172.21.15.38:0/3834030743 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36b80372d0 con 0x7f36c8109740 2024-09-12T12:15:54.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.863+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36c8109bd0 con 0x7f36ac0390c0 2024-09-12T12:15:54.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.864+0000 7f36bea00640 1 -- 172.21.15.38:0/3834030743 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f36c8109bd0 con 0x7f36ac0390c0 2024-09-12T12:15:54.865 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:15:54.865 INFO:teuthology.orchestra.run.smithi038.stdout:[{"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}] 2024-09-12T12:15:54.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f36ac0390c0 msgr2=0x7f36ac03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f36ac0390c0 0x7f36ac03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f36b40098c0 tx=0x7f36b4006db0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 msgr2=0x7f36c81991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c81991e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009230 tx=0x7f36b8003d40 comp rx=0 tx=0).stop 2024-09-12T12:15:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 shutdown_connections 2024-09-12T12:15:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f36ac0390c0 0x7f36ac03b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 --2- 172.21.15.38:0/3834030743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36c8109740 0x7f36c81991e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 >> 172.21.15.38:0/3834030743 conn(0x7f36c80ff2c0 msgr2=0x7f36c80ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 shutdown_connections 2024-09-12T12:15:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:54.867+0000 7f36c7200640 1 -- 172.21.15.38:0/3834030743 wait complete. 2024-09-12T12:15:55.531 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:55 smithi038 ceph-mon[30810]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:15:55.531 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:55.531 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:55 smithi038 ceph-mon[30810]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:55.567 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-09-12T12:15:55.568 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:15:55.568 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-09-12T12:15:55.588 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:15:55.588 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:15:55.647 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-09-12T12:15:55.648 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch host add smithi154 2024-09-12T12:15:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.528+0000 7f1a34000640 1 -- 172.21.15.38:0/1152483541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 msgr2=0x7f1a2c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.528+0000 7f1a34000640 1 --2- 172.21.15.38:0/1152483541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c076b00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009880 tx=0x7f1a2002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.529+0000 7f1a34000640 1 -- 172.21.15.38:0/1152483541 shutdown_connections 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.529+0000 7f1a34000640 1 --2- 172.21.15.38:0/1152483541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c076b00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.529+0000 7f1a34000640 1 -- 172.21.15.38:0/1152483541 >> 172.21.15.38:0/1152483541 conn(0x7f1a2c0ff450 msgr2=0x7f1a2c101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.529+0000 7f1a34000640 1 -- 172.21.15.38:0/1152483541 shutdown_connections 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.529+0000 7f1a34000640 1 -- 172.21.15.38:0/1152483541 wait complete. 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.530+0000 7f1a34000640 1 Processor -- start 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.530+0000 7f1a34000640 1 -- start start 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.530+0000 7f1a34000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c1a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.530+0000 7f1a34000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c112280 con 0x7f1a2c076720 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.530+0000 7f1a31600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c1a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.530+0000 7f1a31600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c1a33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35868/0 (socket says 172.21.15.38:35868) 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.530+0000 7f1a31600640 1 -- 172.21.15.38:0/1215846118 learned_addr learned my addr 172.21.15.38:0/1215846118 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.531+0000 7f1a31600640 1 -- 172.21.15.38:0/1215846118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c1a3930 con 0x7f1a2c076720 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.531+0000 7f1a31600640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c1a33f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009230 tx=0x7f1a20003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.532+0000 7f1a2a000640 1 -- 172.21.15.38:0/1215846118 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a2003f070 con 0x7f1a2c076720 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.532+0000 7f1a2a000640 1 -- 172.21.15.38:0/1215846118 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2003bc80 con 0x7f1a2c076720 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.532+0000 7f1a2a000640 1 -- 172.21.15.38:0/1215846118 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a20035030 con 0x7f1a2c076720 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.532+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c1a3bc0 con 0x7f1a2c076720 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.532+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c19d5b0 con 0x7f1a2c076720 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.533+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c077e60 con 0x7f1a2c076720 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.534+0000 7f1a2a000640 1 -- 172.21.15.38:0/1215846118 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1a20042070 con 0x7f1a2c076720 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.535+0000 7f1a2a000640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a140390c0 0x7f1a1403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.535+0000 7f1a2a000640 1 -- 172.21.15.38:0/1215846118 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1a2006d260 con 0x7f1a2c076720 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.535+0000 7f1a30c00640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a140390c0 0x7f1a1403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.535+0000 7f1a30c00640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a140390c0 0x7f1a1403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a180098c0 tx=0x7f1a18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.539+0000 7f1a2a000640 1 -- 172.21.15.38:0/1215846118 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a20049070 con 0x7f1a2c076720 2024-09-12T12:15:56.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:15:56.728+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) -- 0x7f1a2c076b80 con 0x7f1a140390c0 2024-09-12T12:15:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:15:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:15:59.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:58 smithi038 ceph-mon[30810]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-12T12:15:59.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:58 smithi038 ceph-mon[30810]: Updating smithi071:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:15:59.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:58 smithi038 ceph-mon[30810]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:15:59.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:58 smithi038 ceph-mon[30810]: Updating smithi071:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:15:59.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:58 smithi038 ceph-mon[30810]: Deploying cephadm binary to smithi154 2024-09-12T12:16:00.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:15:59 smithi038 ceph-mon[30810]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:00.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.591+0000 7f1a2a000640 1 -- 172.21.15.38:0/1215846118 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f1a2c076b80 con 0x7f1a140390c0 2024-09-12T12:16:00.592 INFO:teuthology.orchestra.run.smithi038.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a140390c0 msgr2=0x7f1a1403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a140390c0 0x7f1a1403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a180098c0 tx=0x7f1a18006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 msgr2=0x7f1a2c1a33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c1a33f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009230 tx=0x7f1a20003d40 comp rx=0 tx=0).stop 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 shutdown_connections 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a140390c0 0x7f1a1403b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 --2- 172.21.15.38:0/1215846118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a2c076720 0x7f1a2c1a33f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.593+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 >> 172.21.15.38:0/1215846118 conn(0x7f1a2c0ff450 msgr2=0x7f1a2c10dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:00.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.594+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 shutdown_connections 2024-09-12T12:16:00.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:00.594+0000 7f1a34000640 1 -- 172.21.15.38:0/1215846118 wait complete. 2024-09-12T12:16:01.211 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T12:16:01.575 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:01.851 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:01 smithi038 ceph-mon[30810]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:01.851 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:01.851 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:01 smithi038 ceph-mon[30810]: Added host smithi154 2024-09-12T12:16:01.851 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:01.851 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:01.851 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.176+0000 7f3b1d800640 1 -- 172.21.15.38:0/1242415103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 msgr2=0x7f3b18107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.176+0000 7f3b1d800640 1 --2- 172.21.15.38:0/1242415103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009880 tx=0x7f3b0802a5d0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.176+0000 7f3b1d800640 1 -- 172.21.15.38:0/1242415103 shutdown_connections 2024-09-12T12:16:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.176+0000 7f3b1d800640 1 --2- 172.21.15.38:0/1242415103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.177+0000 7f3b1d800640 1 -- 172.21.15.38:0/1242415103 >> 172.21.15.38:0/1242415103 conn(0x7f3b180fd290 msgr2=0x7f3b180ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.177+0000 7f3b1d800640 1 -- 172.21.15.38:0/1242415103 shutdown_connections 2024-09-12T12:16:02.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.177+0000 7f3b1d800640 1 -- 172.21.15.38:0/1242415103 wait complete. 2024-09-12T12:16:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.178+0000 7f3b1d800640 1 Processor -- start 2024-09-12T12:16:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.178+0000 7f3b1d800640 1 -- start start 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.178+0000 7f3b1d800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.178+0000 7f3b1d800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1810bc90 con 0x7f3b18107660 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.178+0000 7f3b16a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.178+0000 7f3b16a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35880/0 (socket says 172.21.15.38:35880) 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.178+0000 7f3b16a00640 1 -- 172.21.15.38:0/3487118068 learned_addr learned my addr 172.21.15.38:0/3487118068 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.179+0000 7f3b16a00640 1 -- 172.21.15.38:0/3487118068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b18199890 con 0x7f3b18107660 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.179+0000 7f3b16a00640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18199350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009230 tx=0x7f3b08003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.179+0000 7f3b0f400640 1 -- 172.21.15.38:0/3487118068 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0803f070 con 0x7f3b18107660 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.179+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b18199b20 con 0x7f3b18107660 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.179+0000 7f3b0f400640 1 -- 172.21.15.38:0/3487118068 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b0803bd40 con 0x7f3b18107660 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.179+0000 7f3b0f400640 1 -- 172.21.15.38:0/3487118068 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b08035030 con 0x7f3b18107660 2024-09-12T12:16:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.179+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1819dc20 con 0x7f3b18107660 2024-09-12T12:16:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.180+0000 7f3b0f400640 1 -- 172.21.15.38:0/3487118068 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3b08042070 con 0x7f3b18107660 2024-09-12T12:16:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.180+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b18102cd0 con 0x7f3b18107660 2024-09-12T12:16:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.181+0000 7f3b0f400640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3afc039060 0x7f3afc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.181+0000 7f3b0f400640 1 -- 172.21.15.38:0/3487118068 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3b0806c9d0 con 0x7f3b18107660 2024-09-12T12:16:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.181+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3afc039060 0x7f3afc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.182+0000 7f3b0fe00640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3afc039060 0x7f3afc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b000098c0 tx=0x7f3b00006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.186+0000 7f3b0f400640 1 -- 172.21.15.38:0/3487118068 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b08036db0 con 0x7f3b18107660 2024-09-12T12:16:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.378+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b18107ac0 con 0x7f3afc039060 2024-09-12T12:16:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.379+0000 7f3b0f400640 1 -- 172.21.15.38:0/3487118068 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f3b18107ac0 con 0x7f3afc039060 2024-09-12T12:16:02.379 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:16:02.379 INFO:teuthology.orchestra.run.smithi038.stdout:[{"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3afc039060 msgr2=0x7f3afc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3afc039060 0x7f3afc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b000098c0 tx=0x7f3b00006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 msgr2=0x7f3b18199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18199350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009230 tx=0x7f3b08003d80 comp rx=0 tx=0).stop 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 shutdown_connections 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3afc039060 0x7f3afc03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 --2- 172.21.15.38:0/3487118068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b18107660 0x7f3b18199350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.381+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 >> 172.21.15.38:0/3487118068 conn(0x7f3b180fd290 msgr2=0x7f3b18075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.382+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 shutdown_connections 2024-09-12T12:16:02.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:02.382+0000 7f3b1d800640 1 -- 172.21.15.38:0/3487118068 wait complete. 2024-09-12T12:16:03.020 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:03.056 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T12:16:03.057 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T12:16:03.421 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.895+0000 7f5feae00640 1 -- 172.21.15.38:0/1597495229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 msgr2=0x7f5fe4109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.896+0000 7f5feae00640 1 --2- 172.21.15.38:0/1597495229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4109a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009880 tx=0x7f5fd802a5d0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.896+0000 7f5feae00640 1 -- 172.21.15.38:0/1597495229 shutdown_connections 2024-09-12T12:16:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.896+0000 7f5feae00640 1 --2- 172.21.15.38:0/1597495229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4109a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.896+0000 7f5feae00640 1 -- 172.21.15.38:0/1597495229 >> 172.21.15.38:0/1597495229 conn(0x7f5fe40ff260 msgr2=0x7f5fe4101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.896+0000 7f5feae00640 1 -- 172.21.15.38:0/1597495229 shutdown_connections 2024-09-12T12:16:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.896+0000 7f5feae00640 1 -- 172.21.15.38:0/1597495229 wait complete. 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.897+0000 7f5feae00640 1 Processor -- start 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.897+0000 7f5feae00640 1 -- start start 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.897+0000 7f5feae00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.897+0000 7f5feae00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe410dca0 con 0x7f5fe4109670 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.897+0000 7f5fe9a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.897+0000 7f5fe9a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35900/0 (socket says 172.21.15.38:35900) 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.897+0000 7f5fe9a00640 1 -- 172.21.15.38:0/4132480384 learned_addr learned my addr 172.21.15.38:0/4132480384 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:16:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.898+0000 7f5fe9a00640 1 -- 172.21.15.38:0/4132480384 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe41996c0 con 0x7f5fe4109670 2024-09-12T12:16:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.898+0000 7f5fe9a00640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4199180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009230 tx=0x7f5fd8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.898+0000 7f5fe2000640 1 -- 172.21.15.38:0/4132480384 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd803f070 con 0x7f5fe4109670 2024-09-12T12:16:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.898+0000 7f5fe2000640 1 -- 172.21.15.38:0/4132480384 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fd803bd40 con 0x7f5fe4109670 2024-09-12T12:16:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.898+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe4199950 con 0x7f5fe4109670 2024-09-12T12:16:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.898+0000 7f5fe2000640 1 -- 172.21.15.38:0/4132480384 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd8035030 con 0x7f5fe4109670 2024-09-12T12:16:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.899+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe419da50 con 0x7f5fe4109670 2024-09-12T12:16:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.900+0000 7f5fe2000640 1 -- 172.21.15.38:0/4132480384 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5fd8042070 con 0x7f5fe4109670 2024-09-12T12:16:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.900+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe4104ce0 con 0x7f5fe4109670 2024-09-12T12:16:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.900+0000 7f5fe2000640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5fcc039060 0x7f5fcc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.900+0000 7f5fe2000640 1 -- 172.21.15.38:0/4132480384 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5fd806cd20 con 0x7f5fe4109670 2024-09-12T12:16:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.900+0000 7f5fe9000640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5fcc039060 0x7f5fcc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.901+0000 7f5fe9000640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5fcc039060 0x7f5fcc03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00098c0 tx=0x7f5fd0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:03.905+0000 7f5fe2000640 1 -- 172.21.15.38:0/4132480384 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5fd8030d60 con 0x7f5fe4109670 2024-09-12T12:16:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.096+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5fe419a4e0 con 0x7f5fe4109670 2024-09-12T12:16:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:03 smithi038 ceph-mon[30810]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:03 smithi038 ceph-mon[30810]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:04.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.957+0000 7f5fe2000640 1 -- 172.21.15.38:0/4132480384 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f5fd803b860 con 0x7f5fe4109670 2024-09-12T12:16:04.958 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2024-09-12T12:16:04.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.959+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5fcc039060 msgr2=0x7f5fcc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.959+0000 7f5feae00640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5fcc039060 0x7f5fcc03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00098c0 tx=0x7f5fd0006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.959+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 msgr2=0x7f5fe4199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.959+0000 7f5feae00640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4199180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009230 tx=0x7f5fd8003d80 comp rx=0 tx=0).stop 2024-09-12T12:16:04.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.960+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 shutdown_connections 2024-09-12T12:16:04.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.960+0000 7f5feae00640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5fcc039060 0x7f5fcc03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.960+0000 7f5feae00640 1 --2- 172.21.15.38:0/4132480384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe4109670 0x7f5fe4199180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.960+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 >> 172.21.15.38:0/4132480384 conn(0x7f5fe40ff260 msgr2=0x7f5fe4100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:04.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.960+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 shutdown_connections 2024-09-12T12:16:04.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:04.960+0000 7f5feae00640 1 -- 172.21.15.38:0/4132480384 wait complete. 2024-09-12T12:16:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/4132480384' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T12:16:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:05.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:05.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:05.650 INFO:tasks.cephadm:Adding mon.a on smithi038 2024-09-12T12:16:05.650 INFO:tasks.cephadm:Adding mon.b on smithi071 2024-09-12T12:16:05.650 INFO:tasks.cephadm:Adding mon.c on smithi154 2024-09-12T12:16:05.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c' 2024-09-12T12:16:05.884 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-12T12:16:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/4132480384' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T12:16:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:05 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:06.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.287+0000 7f11970cd640 1 -- 172.21.15.154:0/1885369909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 msgr2=0x7f1190106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.287+0000 7f11970cd640 1 --2- 172.21.15.154:0/1885369909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190106940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1184009880 tx=0x7f118402a5d0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.287+0000 7f11970cd640 1 -- 172.21.15.154:0/1885369909 shutdown_connections 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.287+0000 7f11970cd640 1 --2- 172.21.15.154:0/1885369909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190106940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.287+0000 7f11970cd640 1 -- 172.21.15.154:0/1885369909 >> 172.21.15.154:0/1885369909 conn(0x7f11900fc1b0 msgr2=0x7f11900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.287+0000 7f11970cd640 1 -- 172.21.15.154:0/1885369909 shutdown_connections 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.287+0000 7f11970cd640 1 -- 172.21.15.154:0/1885369909 wait complete. 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.288+0000 7f11970cd640 1 Processor -- start 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.288+0000 7f11970cd640 1 -- start start 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.288+0000 7f11970cd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.288+0000 7f11970cd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f119010ab90 con 0x7f1190106560 2024-09-12T12:16:06.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f1194e69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f1194e69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.154:41330/0 (socket says 172.21.15.154:41330) 2024-09-12T12:16:06.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f1194e69640 1 -- 172.21.15.154:0/76353428 learned_addr learned my addr 172.21.15.154:0/76353428 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:16:06.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f1194e69640 1 -- 172.21.15.154:0/76353428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1190197640 con 0x7f1190106560 2024-09-12T12:16:06.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f1194e69640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190197100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1184009230 tx=0x7f1184003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f118dffb640 1 -- 172.21.15.154:0/76353428 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f118403f070 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f118dffb640 1 -- 172.21.15.154:0/76353428 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f118403bc80 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11901978d0 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.289+0000 7f118dffb640 1 -- 172.21.15.154:0/76353428 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1184035030 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.290+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119019b9d0 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.291+0000 7f118dffb640 1 -- 172.21.15.154:0/76353428 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1184042070 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.291+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1190101bd0 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.291+0000 7f118dffb640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1180039060 0x7f118003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.291+0000 7f118dffb640 1 -- 172.21.15.154:0/76353428 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f118406cf60 con 0x7f1190106560 2024-09-12T12:16:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.291+0000 7f118ffff640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1180039060 0x7f118003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.292+0000 7f118ffff640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1180039060 0x7f118003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f117c0098c0 tx=0x7f117c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.296+0000 7f118dffb640 1 -- 172.21.15.154:0/76353428 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f118404c350 con 0x7f1190106560 2024-09-12T12:16:06.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.481+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}) -- 0x7f1190198460 con 0x7f1180039060 2024-09-12T12:16:06.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.487+0000 7f118dffb640 1 -- 172.21.15.154:0/76353428 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1190198460 con 0x7f1180039060 2024-09-12T12:16:06.487 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mon update... 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1180039060 msgr2=0x7f118003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1180039060 0x7f118003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f117c0098c0 tx=0x7f117c006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 msgr2=0x7f1190197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190197100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1184009230 tx=0x7f1184003d40 comp rx=0 tx=0).stop 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 shutdown_connections 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1180039060 0x7f118003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 --2- 172.21.15.154:0/76353428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1190106560 0x7f1190197100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 >> 172.21.15.154:0/76353428 conn(0x7f11900fc1b0 msgr2=0x7f1190069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 shutdown_connections 2024-09-12T12:16:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:06.490+0000 7f11970cd640 1 -- 172.21.15.154:0/76353428 wait complete. 2024-09-12T12:16:07.072 DEBUG:teuthology.orchestra.run.smithi071:mon.b> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T12:16:07.075 DEBUG:teuthology.orchestra.run.smithi154:mon.c> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T12:16:07.078 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:16:07.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:16:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:07.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:07.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:07.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:07.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:07.797 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.185+0000 7f770c579640 1 -- 172.21.15.154:0/220746156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 msgr2=0x7f7704106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.185+0000 7f770c579640 1 --2- 172.21.15.154:0/220746156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7700009880 tx=0x7f770002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.185+0000 7f770c579640 1 -- 172.21.15.154:0/220746156 shutdown_connections 2024-09-12T12:16:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.185+0000 7f770c579640 1 --2- 172.21.15.154:0/220746156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.185+0000 7f770c579640 1 -- 172.21.15.154:0/220746156 >> 172.21.15.154:0/220746156 conn(0x7f77040fc1b0 msgr2=0x7f77040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.185+0000 7f770c579640 1 -- 172.21.15.154:0/220746156 shutdown_connections 2024-09-12T12:16:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.185+0000 7f770c579640 1 -- 172.21.15.154:0/220746156 wait complete. 2024-09-12T12:16:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.186+0000 7f770c579640 1 Processor -- start 2024-09-12T12:16:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.186+0000 7f770c579640 1 -- start start 2024-09-12T12:16:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.186+0000 7f770c579640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.186+0000 7f770c579640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f770410ab90 con 0x7f7704106560 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.187+0000 7f770a315640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.187+0000 7f770a315640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.154:41338/0 (socket says 172.21.15.154:41338) 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.187+0000 7f770a315640 1 -- 172.21.15.154:0/3279738324 learned_addr learned my addr 172.21.15.154:0/3279738324 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.187+0000 7f770a315640 1 -- 172.21.15.154:0/3279738324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7704197640 con 0x7f7704106560 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.187+0000 7f770a315640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704197100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7700009230 tx=0x7f7700003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.188+0000 7f76fb7fe640 1 -- 172.21.15.154:0/3279738324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f770003f070 con 0x7f7704106560 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.188+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77041978d0 con 0x7f7704106560 2024-09-12T12:16:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.188+0000 7f76fb7fe640 1 -- 172.21.15.154:0/3279738324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f770003bd40 con 0x7f7704106560 2024-09-12T12:16:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.188+0000 7f76fb7fe640 1 -- 172.21.15.154:0/3279738324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7700035030 con 0x7f7704106560 2024-09-12T12:16:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.188+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770419b9d0 con 0x7f7704106560 2024-09-12T12:16:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.189+0000 7f76fb7fe640 1 -- 172.21.15.154:0/3279738324 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7700042070 con 0x7f7704106560 2024-09-12T12:16:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.189+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7704101bd0 con 0x7f7704106560 2024-09-12T12:16:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.189+0000 7f76fb7fe640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f76f0039060 0x7f76f003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.189+0000 7f76fb7fe640 1 -- 172.21.15.154:0/3279738324 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f770006cd20 con 0x7f7704106560 2024-09-12T12:16:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.189+0000 7f7709b14640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f76f0039060 0x7f76f003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.190+0000 7f7709b14640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f76f0039060 0x7f76f003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76f40098c0 tx=0x7f76f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:08.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.194+0000 7f76fb7fe640 1 -- 172.21.15.154:0/3279738324 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7700030d60 con 0x7f7704106560 2024-09-12T12:16:08.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.427+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7704198460 con 0x7f7704106560 2024-09-12T12:16:08.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.428+0000 7f76fb7fe640 1 -- 172.21.15.154:0/3279738324 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f770003b860 con 0x7f7704106560 2024-09-12T12:16:08.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:16:08.429 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:14:36.052123Z","created":"2024-09-12T12:14:36.052123Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T12:16:08.429 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-09-12T12:16:08.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f76f0039060 msgr2=0x7f76f003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f76f0039060 0x7f76f003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76f40098c0 tx=0x7f76f4006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 msgr2=0x7f7704197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704197100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7700009230 tx=0x7f7700003d80 comp rx=0 tx=0).stop 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 shutdown_connections 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f76f0039060 0x7f76f003b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 --2- 172.21.15.154:0/3279738324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7704106560 0x7f7704197100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 >> 172.21.15.154:0/3279738324 conn(0x7f77040fc1b0 msgr2=0x7f7704069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 shutdown_connections 2024-09-12T12:16:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:08.430+0000 7f770c579640 1 -- 172.21.15.154:0/3279738324 wait complete. 2024-09-12T12:16:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:07 smithi038 ceph-mon[30810]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:07 smithi038 ceph-mon[30810]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:07 smithi038 ceph-mon[30810]: Saving service mon spec with placement smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c;count:3 2024-09-12T12:16:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:07 smithi038 ceph-mon[30810]: Deploying daemon mon.c on smithi154 2024-09-12T12:16:09.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:08 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/3279738324' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:10.055 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:16:10.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:16:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:16:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:09 smithi038 ceph-mon[30810]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.223+0000 7fac53a96640 1 -- 172.21.15.154:0/1251038190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 msgr2=0x7fac4c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.223+0000 7fac53a96640 1 --2- 172.21.15.154:0/1251038190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c106a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac48009880 tx=0x7fac4802a5d0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.223+0000 7fac53a96640 1 -- 172.21.15.154:0/1251038190 shutdown_connections 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.223+0000 7fac53a96640 1 --2- 172.21.15.154:0/1251038190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c106a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.223+0000 7fac53a96640 1 -- 172.21.15.154:0/1251038190 >> 172.21.15.154:0/1251038190 conn(0x7fac4c0fc280 msgr2=0x7fac4c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.223+0000 7fac53a96640 1 -- 172.21.15.154:0/1251038190 shutdown_connections 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.223+0000 7fac53a96640 1 -- 172.21.15.154:0/1251038190 wait complete. 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.224+0000 7fac53a96640 1 Processor -- start 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.224+0000 7fac53a96640 1 -- start start 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.224+0000 7fac53a96640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.224+0000 7fac53a96640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c10ac80 con 0x7fac4c106650 2024-09-12T12:16:11.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.225+0000 7fac51832640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.225+0000 7fac51832640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.154:54152/0 (socket says 172.21.15.154:54152) 2024-09-12T12:16:11.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.225+0000 7fac51832640 1 -- 172.21.15.154:0/1826763899 learned_addr learned my addr 172.21.15.154:0/1826763899 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:16:11.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.225+0000 7fac51832640 1 -- 172.21.15.154:0/1826763899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c06aa10 con 0x7fac4c106650 2024-09-12T12:16:11.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.225+0000 7fac51832640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c195e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac48009230 tx=0x7fac48003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.226+0000 7fac42ffd640 1 -- 172.21.15.154:0/1826763899 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4803f070 con 0x7fac4c106650 2024-09-12T12:16:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.226+0000 7fac42ffd640 1 -- 172.21.15.154:0/1826763899 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4803bc80 con 0x7fac4c106650 2024-09-12T12:16:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.226+0000 7fac42ffd640 1 -- 172.21.15.154:0/1826763899 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac48035030 con 0x7fac4c106650 2024-09-12T12:16:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.226+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4c1963c0 con 0x7fac4c106650 2024-09-12T12:16:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.226+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4c196820 con 0x7fac4c106650 2024-09-12T12:16:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.227+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4c101cc0 con 0x7fac4c106650 2024-09-12T12:16:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.227+0000 7fac42ffd640 1 -- 172.21.15.154:0/1826763899 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fac48042070 con 0x7fac4c106650 2024-09-12T12:16:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.227+0000 7fac42ffd640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fac380390c0 0x7fac3803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.227+0000 7fac42ffd640 1 -- 172.21.15.154:0/1826763899 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fac4806c970 con 0x7fac4c106650 2024-09-12T12:16:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.228+0000 7fac51031640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fac380390c0 0x7fac3803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.228+0000 7fac51031640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fac380390c0 0x7fac3803b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0098c0 tx=0x7fac3c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.233+0000 7fac42ffd640 1 -- 172.21.15.154:0/1826763899 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac480314c0 con 0x7fac4c106650 2024-09-12T12:16:11.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:11 smithi154 systemd[1]: Starting Ceph mon.c for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:16:11.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:11 smithi038 ceph-mon[30810]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.495+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fac4c06a200 con 0x7fac4c106650 2024-09-12T12:16:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.495+0000 7fac42ffd640 1 -- 172.21.15.154:0/1826763899 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fac48044450 con 0x7fac4c106650 2024-09-12T12:16:11.496 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:16:11.496 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:14:36.052123Z","created":"2024-09-12T12:14:36.052123Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T12:16:11.497 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-09-12T12:16:11.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fac380390c0 msgr2=0x7fac3803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fac380390c0 0x7fac3803b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0098c0 tx=0x7fac3c006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 msgr2=0x7fac4c195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c195e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac48009230 tx=0x7fac48003d40 comp rx=0 tx=0).stop 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 shutdown_connections 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fac380390c0 0x7fac3803b580 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 --2- 172.21.15.154:0/1826763899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac4c106650 0x7fac4c195e80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.497+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 >> 172.21.15.154:0/1826763899 conn(0x7fac4c0fc280 msgr2=0x7fac4c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.498+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 shutdown_connections 2024-09-12T12:16:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:11.498+0000 7fac53a96640 1 -- 172.21.15.154:0/1826763899 wait complete. 2024-09-12T12:16:11.835 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:11 smithi154 podman[35543]: 2024-09-12 12:16:11.46623445 +0000 UTC m=+0.093570427 container create a61bbc94c05e94c8dda6f653b972fcb1904c42b5500fb6a92594ed30ae05eb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T12:16:11.835 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:11 smithi154 podman[35543]: 2024-09-12 12:16:11.388480213 +0000 UTC m=+0.015816188 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:16:12.422 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 podman[35543]: 2024-09-12 12:16:12.14691802 +0000 UTC m=+0.774254003 container init a61bbc94c05e94c8dda6f653b972fcb1904c42b5500fb6a92594ed30ae05eb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T12:16:12.423 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 podman[35543]: 2024-09-12 12:16:12.150832758 +0000 UTC m=+0.778168731 container start a61bbc94c05e94c8dda6f653b972fcb1904c42b5500fb6a92594ed30ae05eb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T12:16:12.423 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T12:16:12.423 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T12:16:12.423 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: pidfile_write: ignore empty --pid-file 2024-09-12T12:16:12.423 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: load: jerasure load: lrc 2024-09-12T12:16:12.423 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: RocksDB version: 7.9.2 2024-09-12T12:16:12.423 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Git sha 0 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: DB SUMMARY 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: DB Session ID: WMM89GEREX250395IG3O 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: CURRENT file: CURRENT 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.error_if_exists: 0 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.create_if_missing: 0 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.paranoid_checks: 1 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T12:16:12.424 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.env: 0x55ad5aac5940 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.info_log: 0x55ad5bbdb6e0 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.statistics: (nil) 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.use_fsync: 0 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_log_file_size: 0 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T12:16:12.425 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.allow_fallocate: 1 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.use_direct_reads: 0 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.db_log_dir: 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.wal_dir: 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T12:16:12.426 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.write_buffer_manager: 0x55ad5bbeadc0 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T12:16:12.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.unordered_write: 0 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.row_cache: None 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.wal_filter: None 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.two_write_queues: 0 2024-09-12T12:16:12.428 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.wal_compression: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.atomic_flush: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.log_readahead_size: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T12:16:12.429 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_background_jobs: 2 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_background_compactions: -1 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_subcompactions: 1 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_open_files: -1 2024-09-12T12:16:12.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_background_flushes: -1 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Compression algorithms supported: 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kZSTD supported: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kXpressCompression supported: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kBZip2Compression supported: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kLZ4Compression supported: 1 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kZlibCompression supported: 1 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: kSnappyCompression supported: 1 2024-09-12T12:16:12.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.merge_operator: 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_filter: None 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ad5bbdb320) 2024-09-12T12:16:12.432 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_type: 0 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_index_type: 0 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_shortening: 1 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: checksum: 4 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: no_block_cache: 0 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache: 0x55ad5bbcf1f0 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_options: 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: capacity : 536870912 2024-09-12T12:16:12.433 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_shard_bits : 4 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: strict_capacity_limit : 0 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_compressed: (nil) 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: persistent_cache: (nil) 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size: 4096 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size_deviation: 10 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_restart_interval: 16 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_block_restart_interval: 1 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: metadata_block_size: 4096 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: partition_filters: 0 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: use_delta_encoding: 1 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: filter_policy: bloomfilter 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: whole_key_filtering: 1 2024-09-12T12:16:12.434 INFO:journalctl@ceph.mon.c.smithi154.stdout: verify_compression: 0 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: format_version: 5 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_index_compression: 1 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_align: 0 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: max_auto_readahead_size: 262144 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: prepopulate_block_cache: 0 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: initial_auto_readahead_size: 8192 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression: NoCompression 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T12:16:12.435 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.num_levels: 7 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T12:16:12.436 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T12:16:12.437 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T12:16:12.438 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T12:16:12.439 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.inplace_update_support: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.bloom_locality: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.max_successive_merges: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T12:16:12.440 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.ttl: 2592000 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.enable_blob_files: false 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.min_blob_size: 0 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T12:16:12.441 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 64b7a157-4ccd-4196-aa8d-92dd69a661ec 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143372178153, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143372178577, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726143372, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "64b7a157-4ccd-4196-aa8d-92dd69a661ec", "db_session_id": "WMM89GEREX250395IG3O", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143372178676, "job": 1, "event": "recovery_finished"} 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ad5bbfce00 2024-09-12T12:16:12.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: DB pointer 0x55ad5bcf8000 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** DB Stats ** 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:16:12.443 INFO:journalctl@ceph.mon.c.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:16:12.444 INFO:journalctl@ceph.mon.c.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache BinnedLRUCache@0x55ad5bbcf1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T12:16:12.445 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: starting mon.c rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(???) e0 preinit fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout: e1 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout: btime 2024-09-12T12:14:39:913230+0000 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout: legacy client fscid: -1 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout: No filesystems configured 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T12:16:12.446 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/4132480384' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.447 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/4132480384' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:12.448 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: Saving service mon spec with placement smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c;count:3 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: Deploying daemon mon.c on smithi154 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/3279738324' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:12.449 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:12.450 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/1826763899' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:12.450 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 ceph-mon[35578]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T12:16:12.450 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 bash[35543]: a61bbc94c05e94c8dda6f653b972fcb1904c42b5500fb6a92594ed30ae05eb01 2024-09-12T12:16:12.450 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:12 smithi154 systemd[1]: Started Ceph mon.c for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:12.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:12 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/1826763899' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:13.066 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:16:13.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:16:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:16:17.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.341+0000 7f6f00f50640 1 -- 172.21.15.154:0/1470935431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 msgr2=0x7f6ee40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.341+0000 7f6f00f50640 1 --2- 172.21.15.154:0/1470935431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 0x7f6ee40059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6efc1016c0 tx=0x7f6ef002c3f0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.341+0000 7f6f00f50640 1 -- 172.21.15.154:0/1470935431 shutdown_connections 2024-09-12T12:16:17.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.341+0000 7f6f00f50640 1 --2- 172.21.15.154:0/1470935431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 0x7f6ee40059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.341+0000 7f6f00f50640 1 -- 172.21.15.154:0/1470935431 >> 172.21.15.154:0/1470935431 conn(0x7f6efc0fc280 msgr2=0x7f6efc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.341+0000 7f6f00f50640 1 -- 172.21.15.154:0/1470935431 shutdown_connections 2024-09-12T12:16:17.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.341+0000 7f6f00f50640 1 -- 172.21.15.154:0/1470935431 wait complete. 2024-09-12T12:16:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.342+0000 7f6f00f50640 1 Processor -- start 2024-09-12T12:16:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6f00f50640 1 -- start start 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6f00f50640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 0x7f6efc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6f00f50640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 0x7f6efc19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6f00f50640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc108690 con 0x7f6ee4003530 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6f00f50640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc108510 con 0x7f6efc1977f0 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6ef9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 0x7f6efc19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6ef9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 0x7f6efc19bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52228/0 (socket says 172.21.15.154:52228) 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6ef9d9b640 1 -- 172.21.15.154:0/4357459 learned_addr learned my addr 172.21.15.154:0/4357459 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6ef9d9b640 1 -- 172.21.15.154:0/4357459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 msgr2=0x7f6efc19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6ef9d9b640 1 -- 172.21.15.154:0/4357459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 msgr2=0x7f6efc19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6ef9d9b640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 0x7f6efc19bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.343+0000 7f6ef9d9b640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 0x7f6efc19bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.344+0000 7f6efa59c640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 0x7f6efc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.344+0000 7f6efa59c640 1 -- 172.21.15.154:0/4357459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 msgr2=0x7f6efc19bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.344+0000 7f6efa59c640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 0x7f6efc19bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.344+0000 7f6efa59c640 1 -- 172.21.15.154:0/4357459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc197e10 con 0x7f6ee4003530 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.344+0000 7f6efa59c640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 0x7f6efc1972b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0005f10 tx=0x7f6ef0034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.344+0000 7f6eeb7fe640 1 -- 172.21.15.154:0/4357459 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6ef00051f0 con 0x7f6ee4003530 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.345+0000 7f6eeb7fe640 1 -- 172.21.15.154:0/4357459 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ef0005390 con 0x7f6ee4003530 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.345+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc19c070 con 0x7f6ee4003530 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.345+0000 7f6eeb7fe640 1 -- 172.21.15.154:0/4357459 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6ef00128c0 con 0x7f6ee4003530 2024-09-12T12:16:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.345+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc19c630 con 0x7f6ee4003530 2024-09-12T12:16:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.346+0000 7f6eeb7fe640 1 -- 172.21.15.154:0/4357459 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6ef0044020 con 0x7f6ee4003530 2024-09-12T12:16:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.346+0000 7f6eeb7fe640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6edc038e00 0x7f6edc03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.346+0000 7f6eeb7fe640 1 -- 172.21.15.154:0/4357459 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6ef0042020 con 0x7f6ee4003530 2024-09-12T12:16:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.346+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc101cc0 con 0x7f6ee4003530 2024-09-12T12:16:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.346+0000 7f6ef9d9b640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6edc038e00 0x7f6edc03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.347+0000 7f6ef9d9b640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6edc038e00 0x7f6edc03b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009100 tx=0x7f6eec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.351+0000 7f6eeb7fe640 1 -- 172.21.15.154:0/4357459 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ef004b020 con 0x7f6ee4003530 2024-09-12T12:16:17.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.586+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6efc19c8e0 con 0x7f6ee4003530 2024-09-12T12:16:17.587 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:17.587 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:17.587 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.587 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: mon.a calling monitor election 2024-09-12T12:16:17.587 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.587 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:17.587 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: mon.c calling monitor election 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: monmap epoch 2 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: last_changed 2024-09-12T12:16:12.205450+0000 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: min_mon_release 19 (squid) 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: election_strategy: 1 2024-09-12T12:16:17.588 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: fsmap 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: mgrmap e13: x(active, since 43s) 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: overall HEALTH_OK 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:17.589 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:17.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.587+0000 7f6eeb7fe640 1 -- 172.21.15.154:0/4357459 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f6ef0044570 con 0x7f6ee4003530 2024-09-12T12:16:17.590 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:16:17.590 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:16:12.205450Z","created":"2024-09-12T12:14:36.052123Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6edc038e00 msgr2=0x7f6edc03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6edc038e00 0x7f6edc03b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009100 tx=0x7f6eec008040 comp rx=0 tx=0).stop 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 msgr2=0x7f6efc1972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 0x7f6efc1972b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0005f10 tx=0x7f6ef0034bb0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 shutdown_connections 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6edc038e00 0x7f6edc03b2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6efc1977f0 0x7f6efc19bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 --2- 172.21.15.154:0/4357459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4003530 0x7f6efc1972b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 >> 172.21.15.154:0/4357459 conn(0x7f6efc0fc280 msgr2=0x7f6efc06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.589+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 shutdown_connections 2024-09-12T12:16:17.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:17.590+0000 7f6f00f50640 1 -- 172.21.15.154:0/4357459 wait complete. 2024-09-12T12:16:17.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:17.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: mon.a calling monitor election 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: mon.c calling monitor election 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: monmap epoch 2 2024-09-12T12:16:17.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: last_changed 2024-09-12T12:16:12.205450+0000 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: min_mon_release 19 (squid) 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: election_strategy: 1 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: fsmap 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: mgrmap e13: x(active, since 43s) 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: overall HEALTH_OK 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:17.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:17.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:18 smithi154 ceph-mon[35578]: Deploying daemon mon.b on smithi071 2024-09-12T12:16:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:18 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/4357459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:18 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:18.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:18 smithi038 ceph-mon[30810]: Deploying daemon mon.b on smithi071 2024-09-12T12:16:18.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:18 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/4357459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:18.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:18 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:19.164 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:16:19.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:16:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:16:19.536 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:19 smithi154 ceph-mon[35578]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:19.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:19 smithi038 ceph-mon[30810]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:19.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.826+0000 7ff9596ec640 1 -- 172.21.15.154:0/3226798578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff954107670 msgr2=0x7ff954107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.826+0000 7ff9596ec640 1 --2- 172.21.15.154:0/3226798578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff954107670 0x7ff954107a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff944009c20 tx=0x7ff94402aa90 comp rx=0 tx=0).stop 2024-09-12T12:16:19.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.826+0000 7ff9596ec640 1 -- 172.21.15.154:0/3226798578 shutdown_connections 2024-09-12T12:16:19.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.826+0000 7ff9596ec640 1 --2- 172.21.15.154:0/3226798578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff954107670 0x7ff954107a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.826+0000 7ff9596ec640 1 -- 172.21.15.154:0/3226798578 >> 172.21.15.154:0/3226798578 conn(0x7ff9540fd330 msgr2=0x7ff9540ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.826+0000 7ff9596ec640 1 -- 172.21.15.154:0/3226798578 shutdown_connections 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.826+0000 7ff9596ec640 1 -- 172.21.15.154:0/3226798578 wait complete. 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff9596ec640 1 Processor -- start 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff9596ec640 1 -- start start 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff9596ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 0x7ff9541973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff9596ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9541978f0 0x7ff95419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff9596ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff95410bd30 con 0x7ff9541978f0 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff9596ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff95410bbb0 con 0x7ff954107670 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff952ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 0x7ff9541973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff952ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 0x7ff9541973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33824/0 (socket says 172.21.15.154:33824) 2024-09-12T12:16:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff952ffd640 1 -- 172.21.15.154:0/1834134051 learned_addr learned my addr 172.21.15.154:0/1834134051 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.827+0000 7ff9527fc640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9541978f0 0x7ff95419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff952ffd640 1 -- 172.21.15.154:0/1834134051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 msgr2=0x7ff9541973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff952ffd640 1 -- 172.21.15.154:0/1834134051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 msgr2=0x7ff9541973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff952ffd640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 0x7ff9541973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff952ffd640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 0x7ff9541973b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff9527fc640 1 -- 172.21.15.154:0/1834134051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 msgr2=0x7ff9541973b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff9527fc640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 0x7ff9541973b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff9527fc640 1 -- 172.21.15.154:0/1834134051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff954197f10 con 0x7ff9541978f0 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff9527fc640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9541978f0 0x7ff95419bc80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00b3d0 tx=0x7ff93c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff94bfff640 1 -- 172.21.15.154:0/1834134051 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff93c011630 con 0x7ff9541978f0 2024-09-12T12:16:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95419c1c0 con 0x7ff9541978f0 2024-09-12T12:16:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff94bfff640 1 -- 172.21.15.154:0/1834134051 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff93c011cb0 con 0x7ff9541978f0 2024-09-12T12:16:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff94bfff640 1 -- 172.21.15.154:0/1834134051 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff93c010df0 con 0x7ff9541978f0 2024-09-12T12:16:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.828+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95419c700 con 0x7ff9541978f0 2024-09-12T12:16:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.829+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff954102db0 con 0x7ff9541978f0 2024-09-12T12:16:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.829+0000 7ff94bfff640 1 -- 172.21.15.154:0/1834134051 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff93c018020 con 0x7ff9541978f0 2024-09-12T12:16:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.830+0000 7ff94bfff640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff940038e00 0x7ff94003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.830+0000 7ff94bfff640 1 -- 172.21.15.154:0/1834134051 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff93c04bcc0 con 0x7ff9541978f0 2024-09-12T12:16:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.830+0000 7ff952ffd640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff940038e00 0x7ff94003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.831+0000 7ff952ffd640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff940038e00 0x7ff94003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff94402b080 tx=0x7ff944005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:19.835+0000 7ff94bfff640 1 -- 172.21.15.154:0/1834134051 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff93c052080 con 0x7ff9541978f0 2024-09-12T12:16:20.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.062+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff95419ca10 con 0x7ff9541978f0 2024-09-12T12:16:20.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.063+0000 7ff94bfff640 1 -- 172.21.15.154:0/1834134051 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7ff93c01f020 con 0x7ff9541978f0 2024-09-12T12:16:20.064 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:16:20.064 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:16:12.205450Z","created":"2024-09-12T12:14:36.052123Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:16:20.065 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-09-12T12:16:20.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff940038e00 msgr2=0x7ff94003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff940038e00 0x7ff94003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff94402b080 tx=0x7ff944005dc0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9541978f0 msgr2=0x7ff95419bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9541978f0 0x7ff95419bc80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00b3d0 tx=0x7ff93c00b890 comp rx=0 tx=0).stop 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 shutdown_connections 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff940038e00 0x7ff94003b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9541978f0 0x7ff95419bc80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 --2- 172.21.15.154:0/1834134051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff954107670 0x7ff9541973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 >> 172.21.15.154:0/1834134051 conn(0x7ff9540fd330 msgr2=0x7ff9540fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 shutdown_connections 2024-09-12T12:16:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:20.065+0000 7ff9596ec640 1 -- 172.21.15.154:0/1834134051 wait complete. 2024-09-12T12:16:20.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:20 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/1834134051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:20.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:20 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/1834134051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:21.103 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 podman[34840]: 2024-09-12 12:16:21.082248869 +0000 UTC m=+0.346158245 container start 21bd368039d0e7c9b12b393245c0176c31530a7949f0cf7b4a1bae2530b46c5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T12:16:21.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T12:16:21.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T12:16:21.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pidfile_write: ignore empty --pid-file 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: load: jerasure load: lrc 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: RocksDB version: 7.9.2 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Git sha 0 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: DB SUMMARY 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: DB Session ID: UNNX8UQ90TG1RJT2UZFW 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: CURRENT file: CURRENT 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-12T12:16:21.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.error_if_exists: 0 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.create_if_missing: 0 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.paranoid_checks: 1 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.env: 0x5571b8678940 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.info_log: 0x5571ba0f56e0 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.statistics: (nil) 2024-09-12T12:16:21.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.use_fsync: 0 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_log_file_size: 0 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.allow_fallocate: 1 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.use_direct_reads: 0 2024-09-12T12:16:21.517 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T12:16:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T12:16:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.db_log_dir: 2024-09-12T12:16:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.wal_dir: 2024-09-12T12:16:21.518 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T12:16:21.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T12:16:21.519 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.write_buffer_manager: 0x5571ba104dc0 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T12:16:21.520 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.unordered_write: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.row_cache: None 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.wal_filter: None 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.two_write_queues: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T12:16:21.521 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.wal_compression: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.atomic_flush: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.log_readahead_size: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_background_jobs: 2 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_background_compactions: -1 2024-09-12T12:16:21.522 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_subcompactions: 1 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_open_files: -1 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T12:16:21.523 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_background_flushes: -1 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Compression algorithms supported: 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kZSTD supported: 0 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kXpressCompression supported: 0 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kBZip2Compression supported: 0 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kLZ4Compression supported: 1 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kZlibCompression supported: 1 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: kSnappyCompression supported: 1 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T12:16:21.524 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.merge_operator: 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_filter: None 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5571ba0f5320) 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout: index_type: 0 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout: data_block_index_type: 0 2024-09-12T12:16:21.525 INFO:journalctl@ceph.mon.b.smithi071.stdout: index_shortening: 1 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: checksum: 4 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: no_block_cache: 0 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_cache: 0x5571ba0e91f0 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_cache_options: 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: capacity : 536870912 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: num_shard_bits : 4 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: strict_capacity_limit : 0 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_cache_compressed: (nil) 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: persistent_cache: (nil) 2024-09-12T12:16:21.526 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_size: 4096 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_size_deviation: 10 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_restart_interval: 16 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: index_block_restart_interval: 1 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: metadata_block_size: 4096 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: partition_filters: 0 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: use_delta_encoding: 1 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: filter_policy: bloomfilter 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: whole_key_filtering: 1 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: verify_compression: 0 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: format_version: 5 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: enable_index_compression: 1 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: block_align: 0 2024-09-12T12:16:21.527 INFO:journalctl@ceph.mon.b.smithi071.stdout: max_auto_readahead_size: 262144 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout: prepopulate_block_cache: 0 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout: initial_auto_readahead_size: 8192 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression: NoCompression 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.num_levels: 7 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T12:16:21.528 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T12:16:21.529 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T12:16:21.530 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T12:16:21.531 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.inplace_update_support: 0 2024-09-12T12:16:21.532 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.bloom_locality: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.max_successive_merges: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.ttl: 2592000 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T12:16:21.533 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.enable_blob_files: false 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.min_blob_size: 0 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T12:16:21.534 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6e749bf7-3a6a-45a8-a1fb-ed8a703455a9 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143381109151, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143381109540, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726143381, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6e749bf7-3a6a-45a8-a1fb-ed8a703455a9", "db_session_id": "UNNX8UQ90TG1RJT2UZFW", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143381109632, "job": 1, "event": "recovery_finished"} 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5571ba116e00 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: DB pointer 0x5571ba212000 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout: ** DB Stats ** 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:21.535 INFO:journalctl@ceph.mon.b.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:21.536 INFO:journalctl@ceph.mon.b.smithi071.stdout: 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T12:16:21.537 INFO:journalctl@ceph.mon.b.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout: Interval compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout: Block cache BinnedLRUCache@0x5571ba0e91f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout: 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: using public_addr v2:172.21.15.71:0/0 -> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: starting mon.b rank -1 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(???) e0 preinit fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:21.538 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).mds e1 new map 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout: e1 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout: btime 2024-09-12T12:14:39:913230+0000 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout: legacy client fscid: -1 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout: 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout: No filesystems configured 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T12:16:21.539 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/4132480384' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.540 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/4132480384' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:21.541 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: Saving service mon spec with placement smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c;count:3 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: Deploying daemon mon.c on smithi154 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/3279738324' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/1826763899' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:21.542 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.a calling monitor election 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.c calling monitor election 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: monmap epoch 2 2024-09-12T12:16:21.543 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: last_changed 2024-09-12T12:16:12.205450+0000 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: min_mon_release 19 (squid) 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: election_strategy: 1 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: fsmap 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mgrmap e13: x(active, since 43s) 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: overall HEALTH_OK 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.544 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: Deploying daemon mon.b on smithi071 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/4357459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/1834134051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 ceph-mon[34859]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 bash[34840]: 21bd368039d0e7c9b12b393245c0176c31530a7949f0cf7b4a1bae2530b46c5b 2024-09-12T12:16:21.545 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:21 smithi071 systemd[1]: Started Ceph mon.b for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:21.638 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:16:21.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:16:21.889 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:16:26.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:26.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: mon.a calling monitor election 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: mon.c calling monitor election 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: monmap epoch 3 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:26.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: last_changed 2024-09-12T12:16:21.134132+0000 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: min_mon_release 19 (squid) 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: election_strategy: 1 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: fsmap 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: mgrmap e13: x(active, since 52s) 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: overall HEALTH_OK 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:26.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: mon.a calling monitor election 2024-09-12T12:16:26.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: mon.c calling monitor election 2024-09-12T12:16:26.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:26.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:26.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:26.669 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.669 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.669 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.669 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:16:26.669 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: monmap epoch 3 2024-09-12T12:16:26.670 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:26.670 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: last_changed 2024-09-12T12:16:21.134132+0000 2024-09-12T12:16:26.670 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:26.670 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: min_mon_release 19 (squid) 2024-09-12T12:16:26.670 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: election_strategy: 1 2024-09-12T12:16:26.671 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:26.671 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:26.671 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T12:16:26.671 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: fsmap 2024-09-12T12:16:26.671 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:26.671 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: mgrmap e13: x(active, since 52s) 2024-09-12T12:16:26.672 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: overall HEALTH_OK 2024-09-12T12:16:26.672 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.672 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.672 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.672 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:26.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.680+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2071283049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 msgr2=0x7fb6a40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.680+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2071283049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 0x7fb6a40059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc1016a0 tx=0x7fb6ac02c490 comp rx=0 tx=0).stop 2024-09-12T12:16:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.680+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2071283049 shutdown_connections 2024-09-12T12:16:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.680+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2071283049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 0x7fb6a40059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.680+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2071283049 >> 172.21.15.154:0/2071283049 conn(0x7fb6bc0fc220 msgr2=0x7fb6bc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.680+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2071283049 shutdown_connections 2024-09-12T12:16:26.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.680+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2071283049 wait complete. 2024-09-12T12:16:26.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.681+0000 7fb6c10b1640 1 Processor -- start 2024-09-12T12:16:26.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.681+0000 7fb6c10b1640 1 -- start start 2024-09-12T12:16:26.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6c10b1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 0x7fb6bc1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6c10b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 0x7fb6bc198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6c10b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 0x7fb6bc1a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6c10b1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc108660 con 0x7fb6a4003530 2024-09-12T12:16:26.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6c10b1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc1084e0 con 0x7fb6bc198720 2024-09-12T12:16:26.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6c10b1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc1087e0 con 0x7fb6bc1a1250 2024-09-12T12:16:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bb59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 0x7fb6bc1a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bb59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 0x7fb6bc1a3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33836/0 (socket says 172.21.15.154:33836) 2024-09-12T12:16:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bb59e640 1 -- 172.21.15.154:0/2807874685 learned_addr learned my addr 172.21.15.154:0/2807874685 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:16:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6ba59c640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 0x7fb6bc198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bb59e640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 msgr2=0x7fb6bc1a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T12:16:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bb59e640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 msgr2=0x7fb6bc1a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:16:26.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bb59e640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 0x7fb6bc1a3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:16:26.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bb59e640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 0x7fb6bc1a3640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:26.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6ba59c640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 msgr2=0x7fb6bc198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T12:16:26.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6ba59c640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 msgr2=0x7fb6bc198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:16:26.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6ba59c640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 0x7fb6bc198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:16:26.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6ba59c640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 0x7fb6bc198b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:26.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bad9d640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 0x7fb6bc1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bad9d640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 msgr2=0x7fb6bc1a3640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:26.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bad9d640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 0x7fb6bc1a3640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bad9d640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 msgr2=0x7fb6bc198b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:26.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.682+0000 7fb6bad9d640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 0x7fb6bc198b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.683+0000 7fb6bad9d640 1 -- 172.21.15.154:0/2807874685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6bc1a3de0 con 0x7fb6a4003530 2024-09-12T12:16:26.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.683+0000 7fb6bad9d640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 0x7fb6bc1981e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac02ca80 tx=0x7fb6ac033720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:26.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.683+0000 7fb6a3fff640 1 -- 172.21.15.154:0/2807874685 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac040030 con 0x7fb6a4003530 2024-09-12T12:16:26.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.683+0000 7fb6a3fff640 1 -- 172.21.15.154:0/2807874685 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6ac005500 con 0x7fb6a4003530 2024-09-12T12:16:26.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.683+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6bc1a4070 con 0x7fb6a4003530 2024-09-12T12:16:26.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.683+0000 7fb6a3fff640 1 -- 172.21.15.154:0/2807874685 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac038040 con 0x7fb6a4003530 2024-09-12T12:16:26.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.683+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6bc1a45b0 con 0x7fb6a4003530 2024-09-12T12:16:26.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.684+0000 7fb6a3fff640 1 -- 172.21.15.154:0/2807874685 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb6ac043070 con 0x7fb6a4003530 2024-09-12T12:16:26.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.685+0000 7fb6a3fff640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb6a80394f0 0x7fb6a803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.685+0000 7fb6a3fff640 1 -- 172.21.15.154:0/2807874685 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb6ac06e0d0 con 0x7fb6a4003530 2024-09-12T12:16:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.685+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6bc1097d0 con 0x7fb6a4003530 2024-09-12T12:16:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.685+0000 7fb6ba59c640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb6a80394f0 0x7fb6a803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.685+0000 7fb6ba59c640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb6a80394f0 0x7fb6a803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0006fd0 tx=0x7fb6b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:26.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.690+0000 7fb6a3fff640 1 -- 172.21.15.154:0/2807874685 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6ac04cbb0 con 0x7fb6a4003530 2024-09-12T12:16:26.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.932+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb6bc02d7c0 con 0x7fb6a4003530 2024-09-12T12:16:26.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.933+0000 7fb6a3fff640 1 -- 172.21.15.154:0/2807874685 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fb6ac03be90 con 0x7fb6a4003530 2024-09-12T12:16:26.934 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:16:26.934 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:16:21.134132Z","created":"2024-09-12T12:14:36.052123Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:16:26.934 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 3 2024-09-12T12:16:26.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb6a80394f0 msgr2=0x7fb6a803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb6a80394f0 0x7fb6a803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0006fd0 tx=0x7fb6b0008040 comp rx=0 tx=0).stop 2024-09-12T12:16:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 msgr2=0x7fb6bc1981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 0x7fb6bc1981e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac02ca80 tx=0x7fb6ac033720 comp rx=0 tx=0).stop 2024-09-12T12:16:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 shutdown_connections 2024-09-12T12:16:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb6a80394f0 0x7fb6a803b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6bc1a1250 0x7fb6bc1a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6bc198720 0x7fb6bc198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 --2- 172.21.15.154:0/2807874685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6a4003530 0x7fb6bc1981e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.935+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 >> 172.21.15.154:0/2807874685 conn(0x7fb6bc0fc220 msgr2=0x7fb6bc0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:26.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.936+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 shutdown_connections 2024-09-12T12:16:26.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:26.936+0000 7fb6c10b1640 1 -- 172.21.15.154:0/2807874685 wait complete. 2024-09-12T12:16:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:27 smithi038 ceph-mon[30810]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:27 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/2807874685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:27.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:27 smithi154 ceph-mon[35578]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:27.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:27.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:27 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/2807874685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:27.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:27.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:27.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:27.552 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T12:16:27.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T12:16:27.939 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.a calling monitor election 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.c calling monitor election 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:28.480 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: monmap epoch 3 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: last_changed 2024-09-12T12:16:21.134132+0000 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: min_mon_release 19 (squid) 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: election_strategy: 1 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:28.481 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: fsmap 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mgrmap e13: x(active, since 52s) 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: overall HEALTH_OK 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/2807874685' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:28.482 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:28.483 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:28.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.531+0000 7f3bc2800640 1 -- 172.21.15.38:0/670618137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 msgr2=0x7f3bbc109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.531+0000 7f3bc2800640 1 --2- 172.21.15.38:0/670618137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc109b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009880 tx=0x7f3bac02a5d0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.531+0000 7f3bc2800640 1 -- 172.21.15.38:0/670618137 shutdown_connections 2024-09-12T12:16:28.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.531+0000 7f3bc2800640 1 --2- 172.21.15.38:0/670618137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc109b60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.531+0000 7f3bc2800640 1 -- 172.21.15.38:0/670618137 >> 172.21.15.38:0/670618137 conn(0x7f3bbc0ff480 msgr2=0x7f3bbc1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:28.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.531+0000 7f3bc2800640 1 -- 172.21.15.38:0/670618137 shutdown_connections 2024-09-12T12:16:28.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.531+0000 7f3bc2800640 1 -- 172.21.15.38:0/670618137 wait complete. 2024-09-12T12:16:28.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.532+0000 7f3bc2800640 1 Processor -- start 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.532+0000 7f3bc2800640 1 -- start start 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bc2800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bc2800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bbc199b20 0x7f3bbc19deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bc2800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc19e3f0 0x7f3bbc19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bc2800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc10de40 con 0x7f3bbc109780 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bc2800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc10dcc0 con 0x7f3bbc199b20 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bc2800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc10dfc0 con 0x7f3bbc19e3f0 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bbb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bbb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc1995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47656/0 (socket says 172.21.15.38:47656) 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bbb400640 1 -- 172.21.15.38:0/2171926749 learned_addr learned my addr 172.21.15.38:0/2171926749 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bbaa00640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bbc199b20 0x7f3bbc19deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.533+0000 7f3bbbe00640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc19e3f0 0x7f3bbc19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.534+0000 7f3bbaa00640 1 -- 172.21.15.38:0/2171926749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc19e3f0 msgr2=0x7f3bbc19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.534+0000 7f3bbaa00640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc19e3f0 0x7f3bbc19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.534+0000 7f3bbaa00640 1 -- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 msgr2=0x7f3bbc1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.534+0000 7f3bbaa00640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc1995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.534+0000 7f3bbaa00640 1 -- 172.21.15.38:0/2171926749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bbc1a6160 con 0x7f3bbc199b20 2024-09-12T12:16:28.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.534+0000 7f3bbb400640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:28.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.534+0000 7f3bbaa00640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bbc199b20 0x7f3bbc19deb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b450 tx=0x7f3ba800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:28.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.535+0000 7f3bb3e00640 1 -- 172.21.15.38:0/2171926749 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8004230 con 0x7f3bbc199b20 2024-09-12T12:16:28.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.535+0000 7f3bb3e00640 1 -- 172.21.15.38:0/2171926749 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ba80043d0 con 0x7f3bbc199b20 2024-09-12T12:16:28.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.535+0000 7f3bb3e00640 1 -- 172.21.15.38:0/2171926749 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8003cb0 con 0x7f3bbc199b20 2024-09-12T12:16:28.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.535+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bbc1a6390 con 0x7f3bbc199b20 2024-09-12T12:16:28.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.535+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bbc1a6850 con 0x7f3bbc199b20 2024-09-12T12:16:28.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.536+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bbc109be0 con 0x7f3bbc199b20 2024-09-12T12:16:28.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.536+0000 7f3bb3e00640 1 -- 172.21.15.38:0/2171926749 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3ba800f050 con 0x7f3bbc199b20 2024-09-12T12:16:28.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.537+0000 7f3bb3e00640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3ba00394f0 0x7f3ba003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.537+0000 7f3bb3e00640 1 -- 172.21.15.38:0/2171926749 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3ba804bde0 con 0x7f3bbc199b20 2024-09-12T12:16:28.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.537+0000 7f3bbb400640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3ba00394f0 0x7f3ba003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.538+0000 7f3bbb400640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3ba00394f0 0x7f3ba003b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0096c0 tx=0x7f3bac02aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:28.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.542+0000 7f3bb3e00640 1 -- 172.21.15.38:0/2171926749 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ba800d040 con 0x7f3bbc199b20 2024-09-12T12:16:28.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.766+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f3bbc1a6c40 con 0x7f3bbc199b20 2024-09-12T12:16:28.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.767+0000 7f3bb3e00640 1 -- 172.21.15.38:0/2171926749 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f3ba801e1a0 con 0x7f3bbc199b20 2024-09-12T12:16:28.813 INFO:teuthology.orchestra.run.smithi038.stdout:# minimal ceph.conf for 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:28.813 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2024-09-12T12:16:28.813 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:28.813 INFO:teuthology.orchestra.run.smithi038.stdout: mon_host = [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3ba00394f0 msgr2=0x7f3ba003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3ba00394f0 0x7f3ba003b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0096c0 tx=0x7f3bac02aad0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bbc199b20 msgr2=0x7f3bbc19deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bbc199b20 0x7f3bbc19deb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b450 tx=0x7f3ba800b910 comp rx=0 tx=0).stop 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 shutdown_connections 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3ba00394f0 0x7f3ba003b9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc19e3f0 0x7f3bbc19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bbc199b20 0x7f3bbc19deb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 --2- 172.21.15.38:0/2171926749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3bbc109780 0x7f3bbc1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 >> 172.21.15.38:0/2171926749 conn(0x7f3bbc0ff480 msgr2=0x7f3bbc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:28.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 shutdown_connections 2024-09-12T12:16:28.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:28.769+0000 7f3bc2800640 1 -- 172.21.15.38:0/2171926749 wait complete. 2024-09-12T12:16:29.089 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: mon.b calling monitor election 2024-09-12T12:16:29.089 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: mon.b calling monitor election 2024-09-12T12:16:29.089 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: mon.c calling monitor election 2024-09-12T12:16:29.089 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: mon.a calling monitor election 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: monmap epoch 3 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: last_changed 2024-09-12T12:16:21.134132+0000 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: min_mon_release 19 (squid) 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: election_strategy: 1 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: fsmap 2024-09-12T12:16:29.090 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:29.091 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: mgrmap e13: x(active, since 54s) 2024-09-12T12:16:29.091 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: overall HEALTH_OK 2024-09-12T12:16:29.091 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.091 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.091 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.091 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.091 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:28 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2171926749' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: mon.b calling monitor election 2024-09-12T12:16:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: mon.b calling monitor election 2024-09-12T12:16:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: mon.c calling monitor election 2024-09-12T12:16:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: mon.a calling monitor election 2024-09-12T12:16:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: monmap epoch 3 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: last_changed 2024-09-12T12:16:21.134132+0000 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: min_mon_release 19 (squid) 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: election_strategy: 1 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: fsmap 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: mgrmap e13: x(active, since 54s) 2024-09-12T12:16:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: overall HEALTH_OK 2024-09-12T12:16:29.169 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.169 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.169 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.169 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.169 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:28 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2171926749' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.b calling monitor election 2024-09-12T12:16:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.b calling monitor election 2024-09-12T12:16:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.c calling monitor election 2024-09-12T12:16:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.a calling monitor election 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: monmap epoch 3 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: last_changed 2024-09-12T12:16:21.134132+0000 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: created 2024-09-12T12:14:36.052123+0000 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: min_mon_release 19 (squid) 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: election_strategy: 1 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: 2: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: fsmap 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:16:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: mgrmap e13: x(active, since 54s) 2024-09-12T12:16:29.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: overall HEALTH_OK 2024-09-12T12:16:29.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:29.266 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:28 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2171926749' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:29.509 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T12:16:29.509 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:16:29.509 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:16:29.569 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:16:29.569 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:29.666 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:16:29.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:16:29.695 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:16:29.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:29.761 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:16:29.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:16:29.794 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:16:29.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:29.863 INFO:tasks.cephadm:Adding mgr.x on smithi038 2024-09-12T12:16:29.864 INFO:tasks.cephadm:Adding mgr.y on smithi071 2024-09-12T12:16:29.864 INFO:tasks.cephadm:Adding mgr.z on smithi154 2024-09-12T12:16:29.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi038=x;smithi071=y;smithi154=z' 2024-09-12T12:16:30.016 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: Updating smithi071:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: Updating smithi038:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.017 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:30.018 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:30.135 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: Updating smithi071:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: Updating smithi038:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.136 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.137 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.137 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:30.137 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:30.137 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:30.137 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:30.146 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:16:30.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:30.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: Updating smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: Updating smithi071:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: Updating smithi038:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:30.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:30.402 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:16:30.134+0000 7f6c1f200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T12:16:30.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.554+0000 7f2d28ae7640 1 -- 172.21.15.154:0/3982744459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d241005f0 msgr2=0x7f2d241009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.554+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/3982744459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d241005f0 0x7f2d241009f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009880 tx=0x7f2d1402a5d0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.554+0000 7f2d28ae7640 1 -- 172.21.15.154:0/3982744459 shutdown_connections 2024-09-12T12:16:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.554+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/3982744459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d241005f0 0x7f2d241009f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.554+0000 7f2d28ae7640 1 -- 172.21.15.154:0/3982744459 >> 172.21.15.154:0/3982744459 conn(0x7f2d240fbda0 msgr2=0x7f2d240fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.554+0000 7f2d28ae7640 1 -- 172.21.15.154:0/3982744459 shutdown_connections 2024-09-12T12:16:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.554+0000 7f2d28ae7640 1 -- 172.21.15.154:0/3982744459 wait complete. 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 Processor -- start 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 -- start start 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d241005f0 0x7f2d2406af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d24199d30 0x7f2d2419c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d2419c660 0x7f2d2419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2d241066e0 con 0x7f2d2419c660 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24106560 con 0x7f2d24199d30 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d28ae7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24106860 con 0x7f2d241005f0 2024-09-12T12:16:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d2259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d241005f0 0x7f2d2406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d2259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d241005f0 0x7f2d2406af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58122/0 (socket says 172.21.15.154:58122) 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.555+0000 7f2d2259c640 1 -- 172.21.15.154:0/2305308983 learned_addr learned my addr 172.21.15.154:0/2305308983 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d22d9d640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d2419c660 0x7f2d2419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d21d9b640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d24199d30 0x7f2d2419c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d2259c640 1 -- 172.21.15.154:0/2305308983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d24199d30 msgr2=0x7f2d2419c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d2259c640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d24199d30 0x7f2d2419c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d2259c640 1 -- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d2419c660 msgr2=0x7f2d2419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d2259c640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d2419c660 0x7f2d2419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d2259c640 1 -- 172.21.15.154:0/2305308983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2419f430 con 0x7f2d241005f0 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d2259c640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d241005f0 0x7f2d2406af90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2d14031610 tx=0x7f2d140043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d137fe640 1 -- 172.21.15.154:0/2305308983 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1403f030 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d24195b10 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d137fe640 1 -- 172.21.15.154:0/2305308983 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d14003ce0 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d137fe640 1 -- 172.21.15.154:0/2305308983 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14035070 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.556+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d24196070 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.557+0000 7f2d137fe640 1 -- 172.21.15.154:0/2305308983 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2d14042030 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.557+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2418f4a0 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.557+0000 7f2d137fe640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d0c0394f0 0x7f2d0c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.557+0000 7f2d137fe640 1 -- 172.21.15.154:0/2305308983 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2d1406cbf0 con 0x7f2d241005f0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.558+0000 7f2d21d9b640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d0c0394f0 0x7f2d0c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.558+0000 7f2d21d9b640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d0c0394f0 0x7f2d0c03b9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d2406b510 tx=0x7f2d18009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.562+0000 7f2d137fe640 1 -- 172.21.15.154:0/2305308983 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d1403ac70 con 0x7f2d241005f0 2024-09-12T12:16:30.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.738+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi038=x;smithi071=y;smithi154=z", "target": ["mon-mgr", ""]}) -- 0x7f2d24197550 con 0x7f2d0c0394f0 2024-09-12T12:16:30.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.745+0000 7f2d137fe640 1 -- 172.21.15.154:0/2305308983 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2d24197550 con 0x7f2d0c0394f0 2024-09-12T12:16:30.745 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mgr update... 2024-09-12T12:16:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d0c0394f0 msgr2=0x7f2d0c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d0c0394f0 0x7f2d0c03b9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d2406b510 tx=0x7f2d18009190 comp rx=0 tx=0).stop 2024-09-12T12:16:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d241005f0 msgr2=0x7f2d2406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d241005f0 0x7f2d2406af90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2d14031610 tx=0x7f2d140043c0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 shutdown_connections 2024-09-12T12:16:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d0c0394f0 0x7f2d0c03b9b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d2419c660 0x7f2d2419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d24199d30 0x7f2d2419c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 --2- 172.21.15.154:0/2305308983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d241005f0 0x7f2d2406af90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 >> 172.21.15.154:0/2305308983 conn(0x7f2d240fbda0 msgr2=0x7f2d240fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 shutdown_connections 2024-09-12T12:16:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:16:30.747+0000 7f2d28ae7640 1 -- 172.21.15.154:0/2305308983 wait complete. 2024-09-12T12:16:30.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:16:30.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: Reconfiguring daemon mon.a on smithi038 2024-09-12T12:16:30.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:30.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:30.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:30.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:31.234 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:16:31.234 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: Reconfiguring daemon mon.a on smithi038 2024-09-12T12:16:31.234 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:31.235 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:31.235 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:31.235 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:31.235 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:31.235 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:31.261 DEBUG:teuthology.orchestra.run.smithi071:mgr.y> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T12:16:31.264 DEBUG:teuthology.orchestra.run.smithi154:mgr.z> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: Reconfiguring daemon mon.a on smithi038 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:31.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:31.267 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T12:16:31.268 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:16:31.268 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:16:31.304 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:16:31.304 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-12 12:15:46.862357100 +0000 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-12 12:11:26.972031961 +0000 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-12 12:11:26.972031961 +0000 2024-09-12T12:16:31.380 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-12 12:11:26.972031961 +0000 2024-09-12T12:16:31.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:16:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-12T12:16:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-12T12:16:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000361191 s, 1.4 MB/s 2024-09-12T12:16:31.482 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:16:31.519 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2024-09-12T12:16:31.595 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-12 12:15:46.905356298 +0000 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-12 12:11:27.471022610 +0000 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-12 12:11:27.471022610 +0000 2024-09-12T12:16:31.596 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-12 12:11:27.471022610 +0000 2024-09-12T12:16:31.596 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:16:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-12T12:16:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-12T12:16:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000404628 s, 1.3 MB/s 2024-09-12T12:16:31.692 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:16:31.730 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2024-09-12T12:16:31.805 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:16:31.805 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:31.805 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-12T12:16:31.806 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:31.806 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:31.806 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-12 12:15:46.948355496 +0000 2024-09-12T12:16:31.806 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-12 12:11:27.961013428 +0000 2024-09-12T12:16:31.806 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-12 12:11:27.961013428 +0000 2024-09-12T12:16:31.806 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-12 12:11:27.961013428 +0000 2024-09-12T12:16:31.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:16:31.900 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-12T12:16:31.900 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-12T12:16:31.900 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000337687 s, 1.5 MB/s 2024-09-12T12:16:31.902 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:16:31.939 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-12 12:15:46.994354639 +0000 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-12 12:11:28.461004059 +0000 2024-09-12T12:16:32.016 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-12 12:11:28.461004059 +0000 2024-09-12T12:16:32.017 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-12 12:11:28.461004059 +0000 2024-09-12T12:16:32.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:16:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-12T12:16:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-12T12:16:32.110 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000591132 s, 866 kB/s 2024-09-12T12:16:32.112 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:16:32.149 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-12T12:16:32.149 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:16:32.170 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:16:32.170 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-12T12:16:32.196 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:31 smithi038 ceph-mon[30810]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:32.196 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:31 smithi038 ceph-mon[30810]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi038=x;smithi071=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:32.196 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:31 smithi038 ceph-mon[30810]: Saving service mgr spec with placement smithi038=x;smithi071=y;smithi154=z;count:3 2024-09-12T12:16:32.196 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:31 smithi038 ceph-mon[30810]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:16:32.196 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:31 smithi038 ceph-mon[30810]: Reconfiguring daemon mgr.x on smithi038 2024-09-12T12:16:32.228 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 12:16:20.552549713 +0000 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 12:10:58.876221991 +0000 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 12:10:58.876221991 +0000 2024-09-12T12:16:32.229 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 12:10:58.876221991 +0000 2024-09-12T12:16:32.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:16:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:31 smithi071 ceph-mon[34859]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:31 smithi071 ceph-mon[34859]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi038=x;smithi071=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:31 smithi071 ceph-mon[34859]: Saving service mgr spec with placement smithi038=x;smithi071=y;smithi154=z;count:3 2024-09-12T12:16:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:31 smithi071 ceph-mon[34859]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:16:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:31 smithi071 ceph-mon[34859]: Reconfiguring daemon mgr.x on smithi038 2024-09-12T12:16:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T12:16:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T12:16:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000290229 s, 1.8 MB/s 2024-09-12T12:16:32.292 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:16:32.352 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 12:16:20.553549696 +0000 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 12:10:59.255215289 +0000 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 12:10:59.255215289 +0000 2024-09-12T12:16:32.411 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 12:10:59.255215289 +0000 2024-09-12T12:16:32.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:16:32.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:31 smithi154 ceph-mon[35578]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:32.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:31 smithi154 ceph-mon[35578]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi038=x;smithi071=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:32.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:31 smithi154 ceph-mon[35578]: Saving service mgr spec with placement smithi038=x;smithi071=y;smithi154=z;count:3 2024-09-12T12:16:32.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:31 smithi154 ceph-mon[35578]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:16:32.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:31 smithi154 ceph-mon[35578]: Reconfiguring daemon mgr.x on smithi038 2024-09-12T12:16:32.478 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T12:16:32.479 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T12:16:32.479 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00021602 s, 2.4 MB/s 2024-09-12T12:16:32.480 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:16:32.540 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-12T12:16:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 12:16:20.553549696 +0000 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 12:10:59.602209153 +0000 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 12:10:59.602209153 +0000 2024-09-12T12:16:32.598 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 12:10:59.602209153 +0000 2024-09-12T12:16:32.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000183069 s, 2.8 MB/s 2024-09-12T12:16:32.664 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:16:32.720 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-12T12:16:32.776 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:16:32.776 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T12:16:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:32.776 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-12 12:16:20.553549696 +0000 2024-09-12T12:16:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-12 12:10:59.971202627 +0000 2024-09-12T12:16:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-12 12:10:59.971202627 +0000 2024-09-12T12:16:32.777 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-12 12:10:59.971202627 +0000 2024-09-12T12:16:32.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:16:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-12T12:16:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-12T12:16:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000179743 s, 2.8 MB/s 2024-09-12T12:16:32.843 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:16:32.899 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T12:16:32.899 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:16:32.919 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:16:32.919 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-12T12:16:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:16:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:32.978 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-12T12:16:32.978 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:32.978 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:32.978 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 12:16:11.169171829 +0000 2024-09-12T12:16:32.979 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 12:10:52.393197219 +0000 2024-09-12T12:16:32.979 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 12:10:52.393197219 +0000 2024-09-12T12:16:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-12 12:10:52.393197219 +0000 2024-09-12T12:16:32.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:16:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T12:16:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T12:16:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000207328 s, 2.5 MB/s 2024-09-12T12:16:33.046 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:16:33.106 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-12T12:16:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:16:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:33.162 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T12:16:33.162 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:33.162 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:33.163 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 12:16:11.169171829 +0000 2024-09-12T12:16:33.163 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 12:10:52.718188350 +0000 2024-09-12T12:16:33.163 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 12:10:52.718188350 +0000 2024-09-12T12:16:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-12 12:10:52.718188350 +0000 2024-09-12T12:16:33.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:16:33.228 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T12:16:33.228 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T12:16:33.228 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000206815 s, 2.5 MB/s 2024-09-12T12:16:33.229 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:16:33.287 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 12:16:11.169171829 +0000 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 12:10:53.032179781 +0000 2024-09-12T12:16:33.343 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 12:10:53.032179781 +0000 2024-09-12T12:16:33.344 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-12 12:10:53.032179781 +0000 2024-09-12T12:16:33.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:16:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T12:16:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T12:16:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000264395 s, 1.9 MB/s 2024-09-12T12:16:33.408 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:16:33.465 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-12T12:16:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:16:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:16:33.521 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T12:16:33.521 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:33.521 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:16:33.521 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 12:16:11.170171802 +0000 2024-09-12T12:16:33.522 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 12:10:53.344171267 +0000 2024-09-12T12:16:33.522 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 12:10:53.344171267 +0000 2024-09-12T12:16:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-12 12:10:53.344171267 +0000 2024-09-12T12:16:33.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:16:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T12:16:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T12:16:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000217211 s, 2.4 MB/s 2024-09-12T12:16:33.587 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:16:33.644 INFO:tasks.cephadm:Deploying osd.0 on smithi038 with /dev/vg_nvme/lv_4... 2024-09-12T12:16:33.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:16:33.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:33.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:33.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:33.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:16:33.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:33.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:33.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:33.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:33 smithi154 ceph-mon[35578]: Reconfiguring daemon mon.b on smithi071 2024-09-12T12:16:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:16:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:33.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:33.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:33 smithi038 ceph-mon[30810]: Reconfiguring daemon mon.b on smithi071 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:33.983 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:33 smithi071 ceph-mon[34859]: Reconfiguring daemon mon.b on smithi071 2024-09-12T12:16:34.018 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:35.123 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:35.124 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:35.124 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:34 smithi038 ceph-mon[30810]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:16:35.124 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:35.124 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:35.124 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:35.124 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:34 smithi038 ceph-mon[30810]: Reconfiguring daemon mon.c on smithi154 2024-09-12T12:16:35.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:34 smithi154 ceph-mon[35578]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:16:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:34 smithi154 ceph-mon[35578]: Reconfiguring daemon mon.c on smithi154 2024-09-12T12:16:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:34 smithi071 ceph-mon[34859]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:16:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:16:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:16:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:35.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:34 smithi071 ceph-mon[34859]: Reconfiguring daemon mon.c on smithi154 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:36.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:16:36.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:36.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:36.208 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:36.208 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.208 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.208 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:36.208 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:36.209 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:36.209 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.209 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:36.209 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:16:36.209 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:36.209 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:36.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:36.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:36.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:16:36.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:36.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:36.914 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:16:36.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:36 smithi154 ceph-mon[35578]: Deploying daemon mgr.z on smithi154 2024-09-12T12:16:36.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_4 2024-09-12T12:16:37.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:36 smithi038 ceph-mon[30810]: Deploying daemon mgr.z on smithi154 2024-09-12T12:16:37.255 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 podman[37373]: 2024-09-12 12:16:37.252743336 +0000 UTC m=+0.362023458 container init 3fda7892dadd77a2f9795ae1e3f76ea17079c0c770a2bfe50a6b8b77cf8acb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:16:37.255 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 podman[37373]: 2024-09-12 12:16:37.25577621 +0000 UTC m=+0.365056334 container start 3fda7892dadd77a2f9795ae1e3f76ea17079c0c770a2bfe50a6b8b77cf8acb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T12:16:37.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:36 smithi071 ceph-mon[34859]: Deploying daemon mgr.z on smithi154 2024-09-12T12:16:37.311 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:37.601 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mgr[37392]: -- 172.21.15.154:0/3144733797 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fac3090e0 con 0x563fac2e7400 2024-09-12T12:16:37.602 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 bash[37373]: 3fda7892dadd77a2f9795ae1e3f76ea17079c0c770a2bfe50a6b8b77cf8acb8f 2024-09-12T12:16:37.602 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 systemd[1]: Started Ceph mgr.z for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:37.602 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:37.380+0000 7f709f897040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:37.602 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:37.453+0000 7f709f897040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:37.602 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:37.601+0000 7f709f897040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.861+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2136128290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4105810 msgr2=0x7f3ec410c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.861+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2136128290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4105810 0x7f3ec410c0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009ca0 tx=0x7f3ebc02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2136128290 shutdown_connections 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2136128290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4105810 0x7f3ec410c0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2136128290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4104e50 0x7f3ec41052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2136128290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec4103c50 0x7f3ec4104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2136128290 >> 172.21.15.38:0/2136128290 conn(0x7f3ec40ff3e0 msgr2=0x7f3ec4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2136128290 shutdown_connections 2024-09-12T12:16:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2136128290 wait complete. 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.862+0000 7f3ec9e00640 1 Processor -- start 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9e00640 1 -- start start 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4103c50 0x7f3ec4199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4104e50 0x7f3ec419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec4105810 0x7f3ec41a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410f8d0 con 0x7f3ec4103c50 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410f750 con 0x7f3ec4105810 2024-09-12T12:16:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410fa50 con 0x7f3ec4104e50 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4103c50 0x7f3ec4199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4103c50 0x7f3ec4199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43796/0 (socket says 172.21.15.38:43796) 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec8a00640 1 -- 172.21.15.38:0/2800672445 learned_addr learned my addr 172.21.15.38:0/2800672445 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec3e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4104e50 0x7f3ec419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.863+0000 7f3ec9400640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec4105810 0x7f3ec41a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec3e00640 1 -- 172.21.15.38:0/2800672445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec4105810 msgr2=0x7f3ec41a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec3e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec4105810 0x7f3ec41a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec3e00640 1 -- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4103c50 msgr2=0x7f3ec4199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec3e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4103c50 0x7f3ec4199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec3e00640 1 -- 172.21.15.38:0/2800672445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec41a1ad0 con 0x7f3ec4104e50 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec8a00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4103c50 0x7f3ec4199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec3e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4104e50 0x7f3ec419a3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000e9f0 tx=0x7f3eb000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000ccc0 con 0x7f3ec4104e50 2024-09-12T12:16:37.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3eb0005020 con 0x7f3ec4104e50 2024-09-12T12:16:37.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00049e0 con 0x7f3ec4104e50 2024-09-12T12:16:37.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec41a1dc0 con 0x7f3ec4104e50 2024-09-12T12:16:37.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.864+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec41a2220 con 0x7f3ec4104e50 2024-09-12T12:16:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.865+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3eb0005560 con 0x7f3ec4104e50 2024-09-12T12:16:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.865+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec410af80 con 0x7f3ec4104e50 2024-09-12T12:16:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.866+0000 7f3ec1600640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3eac0392c0 0x7f3eac03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.866+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3eb004c370 con 0x7f3ec4104e50 2024-09-12T12:16:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.866+0000 7f3ec8a00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3eac0392c0 0x7f3eac03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.867+0000 7f3ec8a00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3eac0392c0 0x7f3eac03b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80104e0 tx=0x7f3eb800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:37.871+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3eb00051d0 con 0x7f3ec4104e50 2024-09-12T12:16:37.872 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:37.668+0000 7f709f897040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:37.872 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:37.815+0000 7f709f897040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:38.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:38.066+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3ec4062630 con 0x7f3eac0392c0 2024-09-12T12:16:38.067 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:38.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:38.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:16:38.069 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:38.069 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:38.167 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:37.956+0000 7f709f897040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:38.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:16:38.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:38.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:16:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:16:38.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:16:38.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:38.520 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:38.270+0000 7f709f897040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:38.521 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:38.330+0000 7f709f897040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:38.878 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:38.520+0000 7f709f897040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:38.940 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:38 smithi071 ceph-mon[34859]: Deploying daemon mgr.y on smithi071 2024-09-12T12:16:38.940 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:38 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:16:38.940 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:38 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:16:38.940 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:38 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:38.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:38 smithi038 ceph-mon[30810]: Deploying daemon mgr.y on smithi071 2024-09-12T12:16:38.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:38 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:16:38.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:38 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:16:38.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:38 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:39.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:38 smithi154 ceph-mon[35578]: Deploying daemon mgr.y on smithi071 2024-09-12T12:16:39.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:38 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:16:39.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:38 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:16:39.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:38 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:39.264 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 systemd[1]: Starting Ceph mgr.y for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:16:39.574 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 podman[36214]: 2024-09-12 12:16:39.310891709 +0000 UTC m=+0.104489504 container create 7e7c795f14dc2f045c7c97b186b9e81b5f011e538487a1dc01b7fc5bf7e56eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T12:16:39.574 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 podman[36214]: 2024-09-12 12:16:39.222163582 +0000 UTC m=+0.015761391 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:16:39.574 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 podman[36214]: 2024-09-12 12:16:39.446271272 +0000 UTC m=+0.239869076 container init 7e7c795f14dc2f045c7c97b186b9e81b5f011e538487a1dc01b7fc5bf7e56eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:16:39.574 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 podman[36214]: 2024-09-12 12:16:39.448892881 +0000 UTC m=+0.242490676 container start 7e7c795f14dc2f045c7c97b186b9e81b5f011e538487a1dc01b7fc5bf7e56eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T12:16:39.574 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mgr[36235]: -- 172.21.15.71:0/741324596 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6b64210e0 con 0x55d6b63ff400 2024-09-12T12:16:39.574 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 bash[36214]: 7e7c795f14dc2f045c7c97b186b9e81b5f011e538487a1dc01b7fc5bf7e56eee 2024-09-12T12:16:39.575 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 systemd[1]: Started Ceph mgr.y for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:39.575 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:39.573+0000 7fa01d992040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:39.858 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:39.637+0000 7fa01d992040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:39.858 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:39.788+0000 7fa01d992040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:39.859 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:39.858+0000 7fa01d992040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:39.880 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:39.451+0000 7f709f897040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:39.880 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:39.521+0000 7f709f897040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:40.112 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:39 smithi038 ceph-mon[30810]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:40.113 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:39 smithi038 ceph-mon[30810]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:40.113 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:39 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.113 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:39 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.113 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:39 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.113 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:39 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.113 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:39 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-mon[35578]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-mon[35578]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:39 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:40 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:40.015+0000 7fa01d992040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:40 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:40.176+0000 7fa01d992040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mon[34859]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mon[34859]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:40.177 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:39 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:40.558 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:40.288+0000 7f709f897040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:40.558 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:40.411+0000 7f709f897040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:40.746 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:40 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:40.501+0000 7fa01d992040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:40.746 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:40 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:40.561+0000 7fa01d992040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:40.843 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:40.558+0000 7f709f897040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:40.843 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:40.619+0000 7f709f897040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:40.844 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:40.774+0000 7f709f897040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:40.844 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:40.843+0000 7f709f897040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:41.014 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:40 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:40.746+0000 7fa01d992040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:41.129 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:40.904+0000 7f709f897040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:41.130 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:41.065+0000 7f709f897040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:41.130 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:41.129+0000 7f709f897040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:41.399 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:41.199+0000 7f709f897040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:41.399 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:41.281+0000 7f709f897040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:41.399 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:41.340+0000 7f709f897040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:41.399 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:41.398+0000 7f709f897040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:42.014 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:41.650+0000 7fa01d992040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:42.014 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:41.716+0000 7fa01d992040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1069227628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]: dispatch 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]: dispatch 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]': finished 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:16:42.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1069227628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]: dispatch 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]: dispatch 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]': finished 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:16:42.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:16:42.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:42.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:42.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:42.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1069227628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]: dispatch 2024-09-12T12:16:42.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]: dispatch 2024-09-12T12:16:42.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9e11e86-b488-441c-a706-882110e30bc3"}]': finished 2024-09-12T12:16:42.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:16:42.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:16:42.666 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:16:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z[37388]: 2024-09-12T12:16:42.179+0000 7f709f897040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:42.683 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:42.428+0000 7fa01d992040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:42.683 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:42.542+0000 7fa01d992040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:42.683 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:42.683+0000 7fa01d992040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:42.802+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f3eb000acf0 con 0x7f3ec4104e50 2024-09-12T12:16:42.961 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/4282370808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:16:42.961 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-mon[34859]: Standby manager daemon z started 2024-09-12T12:16:42.961 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:16:42.961 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:42.961 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:16:42.961 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:42.961 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:42.743+0000 7fa01d992040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:42.962 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:42.893+0000 7fa01d992040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:42.962 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:42.960+0000 7fa01d992040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:42 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/4282370808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:16:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:42 smithi154 ceph-mon[35578]: Standby manager daemon z started 2024-09-12T12:16:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:42 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:16:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:42 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:42 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:16:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:42 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:43.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:42 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/4282370808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:16:43.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:42 smithi038 ceph-mon[30810]: Standby manager daemon z started 2024-09-12T12:16:43.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:42 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:16:43.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:42 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:43.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:42 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:16:43.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:42 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.154:0/2837514608' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:43.240 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:43.020+0000 7fa01d992040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:43.240 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:43.175+0000 7fa01d992040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:43.240 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:43.240+0000 7fa01d992040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:43.506 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:43.306+0000 7fa01d992040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:43.506 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:43.387+0000 7fa01d992040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:43.506 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:43.446+0000 7fa01d992040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:43.506 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:43.506+0000 7fa01d992040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:43 smithi154 ceph-mon[35578]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:43 smithi154 ceph-mon[35578]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-12T12:16:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:16:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:43 smithi038 ceph-mon[30810]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:43 smithi038 ceph-mon[30810]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-12T12:16:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:16:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-mon[34859]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-mon[34859]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-12T12:16:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:16:44.764 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:16:44 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y[36231]: 2024-09-12T12:16:44.291+0000 7fa01d992040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:45.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:16:45.057+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mon.1 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f3eb0020440 con 0x7f3ec4104e50 2024-09-12T12:16:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:45 smithi154 ceph-mon[35578]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:45 smithi154 ceph-mon[35578]: Standby manager daemon y started 2024-09-12T12:16:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:45 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:16:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:45 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:45 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:16:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:45 smithi154 ceph-mon[35578]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:45.455 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:45 smithi038 ceph-mon[30810]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:45.455 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:45.455 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:45 smithi038 ceph-mon[30810]: Standby manager daemon y started 2024-09-12T12:16:45.455 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:45 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:16:45.456 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:45 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:45.456 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:45 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:16:45.456 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:45 smithi038 ceph-mon[30810]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:45 smithi071 ceph-mon[34859]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:45 smithi071 ceph-mon[34859]: Standby manager daemon y started 2024-09-12T12:16:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:45 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:16:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:45 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:45 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:16:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:45 smithi071 ceph-mon[34859]: from='mgr.? 172.21.15.71:0/1980936812' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:46.218 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:46 smithi038 ceph-mon[30810]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-12T12:16:46.218 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:46 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:16:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:46 smithi154 ceph-mon[35578]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-12T12:16:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:46 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:16:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:46 smithi071 ceph-mon[34859]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-12T12:16:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:46 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:16:47.405 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:47 smithi038 ceph-mon[30810]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:47.415 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:47 smithi071 ceph-mon[34859]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:47.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:47 smithi154 ceph-mon[35578]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:49.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:49 smithi038 ceph-mon[30810]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:49.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:49 smithi154 ceph-mon[35578]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:49 smithi071 ceph-mon[34859]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:50.415 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:16:50.416 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:50.416 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:50 smithi038 ceph-mon[30810]: Deploying daemon osd.0 on smithi038 2024-09-12T12:16:50.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:16:50.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:50.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:50 smithi154 ceph-mon[35578]: Deploying daemon osd.0 on smithi038 2024-09-12T12:16:50.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:16:50.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:50.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:50 smithi071 ceph-mon[34859]: Deploying daemon osd.0 on smithi038 2024-09-12T12:16:51.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:51 smithi154 ceph-mon[35578]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:51.420 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:51 smithi038 ceph-mon[30810]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:51.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:51 smithi071 ceph-mon[34859]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:53.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:53 smithi154 ceph-mon[35578]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:53.466 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:53 smithi038 ceph-mon[30810]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:53 smithi071 ceph-mon[34859]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:55.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:55 smithi154 ceph-mon[35578]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:55.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:55 smithi038 ceph-mon[30810]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:55.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:55 smithi071 ceph-mon[34859]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:57.208 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:57 smithi038 ceph-mon[30810]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:57.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:57 smithi154 ceph-mon[35578]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:57.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:57 smithi071 ceph-mon[34859]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:16:58.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:58 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:58.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:58 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:58.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:58 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:58 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:58 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:58 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:58 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:58 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:16:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:58 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:00.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:16:59 smithi154 ceph-mon[35578]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:00.201 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:16:59 smithi038 ceph-mon[30810]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:16:59 smithi071 ceph-mon[34859]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:01 smithi154 ceph-mon[35578]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:01 smithi038 ceph-mon[30810]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:01 smithi071 ceph-mon[34859]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.749 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 0 on host 'smithi038' 2024-09-12T12:17:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.749+0000 7f3ec1600640 1 -- 172.21.15.38:0/2800672445 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3ec4062630 con 0x7f3eac0392c0 2024-09-12T12:17:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3eac0392c0 msgr2=0x7f3eac03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3eac0392c0 0x7f3eac03b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80104e0 tx=0x7f3eb800b410 comp rx=0 tx=0).stop 2024-09-12T12:17:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4104e50 msgr2=0x7f3ec419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4104e50 0x7f3ec419a3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000e9f0 tx=0x7f3eb000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 shutdown_connections 2024-09-12T12:17:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3eac0392c0 0x7f3eac03b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec4105810 0x7f3ec41a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4104e50 0x7f3ec419a3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 --2- 172.21.15.38:0/2800672445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec4103c50 0x7f3ec4199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 >> 172.21.15.38:0/2800672445 conn(0x7f3ec40ff3e0 msgr2=0x7f3ec4108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 shutdown_connections 2024-09-12T12:17:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:02.751+0000 7f3ec9e00640 1 -- 172.21.15.38:0/2800672445 wait complete. 2024-09-12T12:17:02.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:02.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:02.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:03.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:03.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:03.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:03.477 DEBUG:teuthology.orchestra.run.smithi038:osd.0> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T12:17:03.481 INFO:tasks.cephadm:Deploying osd.1 on smithi071 with /dev/vg_nvme/lv_4... 2024-09-12T12:17:03.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:17:03.730 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:17:03.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:03 smithi038 ceph-mon[30810]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:04.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:03 smithi071 ceph-mon[34859]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:04.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:03 smithi154 ceph-mon[35578]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:04.719 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:17:04 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0[44794]: 2024-09-12T12:17:04.320+0000 7f08dd041640 -1 osd.0 0 log_to_monitors true 2024-09-12T12:17:05.131 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:04 smithi038 ceph-mon[30810]: from='osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:17:05.131 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:04 smithi038 ceph-mon[30810]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:17:05.237 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:04 smithi071 ceph-mon[34859]: from='osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:17:05.237 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:04 smithi071 ceph-mon[34859]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:17:05.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:04 smithi154 ceph-mon[35578]: from='osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:17:05.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:04 smithi154 ceph-mon[35578]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:17:05.803 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:17:05.827 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-09-12T12:17:06.067 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:17:06.188 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:05 smithi071 ceph-mon[34859]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:06.188 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:05 smithi071 ceph-mon[34859]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:17:06.189 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:05 smithi071 ceph-mon[34859]: from='osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:17:06.189 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:05 smithi071 ceph-mon[34859]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:17:06.189 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:05 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:06.189 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:05 smithi071 ceph-mon[34859]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:17:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-mon[30810]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-mon[30810]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:17:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-mon[30810]: from='osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:17:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-mon[30810]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:17:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:06.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-mon[30810]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:17:06.220 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0[44794]: 2024-09-12T12:17:05.946+0000 7f08d7c00640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T12:17:06.221 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:17:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0[44794]: 2024-09-12T12:17:05.950+0000 7f08d2c00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:17:06.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:05 smithi154 ceph-mon[35578]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:05 smithi154 ceph-mon[35578]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:17:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:05 smithi154 ceph-mon[35578]: from='osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:17:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:05 smithi154 ceph-mon[35578]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:17:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:05 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:05 smithi154 ceph-mon[35578]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:17:06.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 -- 172.21.15.71:0/3765723672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 msgr2=0x7f4584100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 --2- 172.21.15.71:0/3765723672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584100ef0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4574009860 tx=0x7f457402a340 comp rx=0 tx=0).stop 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 -- 172.21.15.71:0/3765723672 shutdown_connections 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 --2- 172.21.15.71:0/3765723672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841026b0 0x7f4584108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 --2- 172.21.15.71:0/3765723672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4584101cf0 0x7f4584102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 --2- 172.21.15.71:0/3765723672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584100ef0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 -- 172.21.15.71:0/3765723672 >> 172.21.15.71:0/3765723672 conn(0x7f45840fc280 msgr2=0x7f45840fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 -- 172.21.15.71:0/3765723672 shutdown_connections 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 -- 172.21.15.71:0/3765723672 wait complete. 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.514+0000 7f458a562640 1 Processor -- start 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f458a562640 1 -- start start 2024-09-12T12:17:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f458a562640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584104a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f458a562640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4584101cf0 0x7f45841030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f458a562640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841026b0 0x7f4584103610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f458a562640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f458410c770 con 0x7f45841026b0 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f458a562640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f458410c5f0 con 0x7f4584100af0 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f458a562640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f458410c8f0 con 0x7f4584101cf0 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584104a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38504/0 (socket says 172.21.15.71:38504) 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 -- 172.21.15.71:0/2555046782 learned_addr learned my addr 172.21.15.71:0/2555046782 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4588aff640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841026b0 0x7f4584103610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f45837fe640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4584101cf0 0x7f45841030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 -- 172.21.15.71:0/2555046782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4584101cf0 msgr2=0x7f45841030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4584101cf0 0x7f45841030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 -- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841026b0 msgr2=0x7f4584103610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841026b0 0x7f4584103610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f4583fff640 1 -- 172.21.15.71:0/2555046782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4584103ed0 con 0x7f4584100af0 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.515+0000 7f45837fe640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4584101cf0 0x7f45841030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.516+0000 7f4583fff640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584104a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45740305b0 tx=0x7f4574033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.516+0000 7f45817fa640 1 -- 172.21.15.71:0/2555046782 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457403f020 con 0x7f4584100af0 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.516+0000 7f45817fa640 1 -- 172.21.15.71:0/2555046782 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4574030850 con 0x7f4584100af0 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.516+0000 7f45817fa640 1 -- 172.21.15.71:0/2555046782 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574037040 con 0x7f4584100af0 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.516+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45841a2080 con 0x7f4584100af0 2024-09-12T12:17:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.516+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45841a24e0 con 0x7f4584100af0 2024-09-12T12:17:06.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.517+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45841a2710 con 0x7f4584100af0 2024-09-12T12:17:06.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.518+0000 7f45817fa640 1 -- 172.21.15.71:0/2555046782 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f4574042020 con 0x7f4584100af0 2024-09-12T12:17:06.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.518+0000 7f45817fa640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45700a2af0 0x7f45700a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.519+0000 7f45817fa640 1 -- 172.21.15.71:0/2555046782 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f45740ed830 con 0x7f4584100af0 2024-09-12T12:17:06.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.519+0000 7f45837fe640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45700a2af0 0x7f45700a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.519+0000 7f45837fe640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45700a2af0 0x7f45700a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4584104800 tx=0x7f456c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.523+0000 7f45817fa640 1 -- 172.21.15.71:0/2555046782 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4574049020 con 0x7f4584100af0 2024-09-12T12:17:06.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:06.704+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f458406af10 con 0x7f45700a2af0 2024-09-12T12:17:07.116 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:06 smithi071 ceph-mon[34859]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:17:07.116 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:06 smithi071 ceph-mon[34859]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:17:07.116 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:07.116 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:07.117 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:07.117 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:07.117 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:06 smithi038 ceph-mon[30810]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:17:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:06 smithi038 ceph-mon[30810]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:17:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:06 smithi154 ceph-mon[35578]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:17:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:06 smithi154 ceph-mon[35578]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:17:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:08.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:17:08.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:17:08.045 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] boot 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:08.046 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:17:08.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:17:08.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] boot 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:08.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:08.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: osd.0 [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] boot 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:09.211 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:08 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi038 2024-09-12T12:17:09.212 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:08 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi038 to 17094M 2024-09-12T12:17:09.212 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:08 smithi071 ceph-mon[34859]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T12:17:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:08 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi038 2024-09-12T12:17:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:08 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi038 to 17094M 2024-09-12T12:17:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:08 smithi038 ceph-mon[30810]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T12:17:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:08 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi038 2024-09-12T12:17:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:08 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi038 to 17094M 2024-09-12T12:17:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:08 smithi154 ceph-mon[35578]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T12:17:10.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:09 smithi038 ceph-mon[30810]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:10.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:09 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/184030843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]: dispatch 2024-09-12T12:17:10.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:09 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]: dispatch 2024-09-12T12:17:10.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:09 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]': finished 2024-09-12T12:17:10.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:09 smithi038 ceph-mon[30810]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:17:10.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:09 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:10.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:09 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/3024232560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:10.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:09 smithi071 ceph-mon[34859]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:10.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:09 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/184030843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]: dispatch 2024-09-12T12:17:10.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:09 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]: dispatch 2024-09-12T12:17:10.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:09 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]': finished 2024-09-12T12:17:10.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:09 smithi071 ceph-mon[34859]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:17:10.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:09 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:10.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:09 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/3024232560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:09 smithi154 ceph-mon[35578]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:09 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/184030843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]: dispatch 2024-09-12T12:17:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:09 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]: dispatch 2024-09-12T12:17:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:09 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6df2c3be-ea85-414e-b78a-93ea2e8a6594"}]': finished 2024-09-12T12:17:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:09 smithi154 ceph-mon[35578]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:17:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:09 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:09 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/3024232560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:11 smithi038 ceph-mon[30810]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:11 smithi071 ceph-mon[34859]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:11 smithi154 ceph-mon[35578]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:14.219 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:13 smithi154 ceph-mon[35578]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:14.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:13 smithi038 ceph-mon[30810]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:14.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:13 smithi071 ceph-mon[34859]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:15 smithi071 ceph-mon[34859]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:16.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:15 smithi154 ceph-mon[35578]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:16.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:15 smithi038 ceph-mon[30810]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:17.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:17:17.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:17.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:17:17.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:17.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:17:17.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:18.117 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:17 smithi071 ceph-mon[34859]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:18.117 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:17 smithi071 ceph-mon[34859]: Deploying daemon osd.1 on smithi071 2024-09-12T12:17:18.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:17 smithi154 ceph-mon[35578]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:17 smithi154 ceph-mon[35578]: Deploying daemon osd.1 on smithi071 2024-09-12T12:17:18.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:17 smithi038 ceph-mon[30810]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:18.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:17 smithi038 ceph-mon[30810]: Deploying daemon osd.1 on smithi071 2024-09-12T12:17:20.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:19 smithi071 ceph-mon[34859]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:20.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:19 smithi154 ceph-mon[35578]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:20.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:19 smithi038 ceph-mon[30810]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:22 smithi071 ceph-mon[34859]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:22.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:22 smithi154 ceph-mon[35578]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:22.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:22 smithi038 ceph-mon[30810]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:23.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:23 smithi071 ceph-mon[34859]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:23.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:23.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:23.222 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:23.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:23 smithi154 ceph-mon[35578]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:23.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:23.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:23.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:23 smithi038 ceph-mon[30810]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:25.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:25 smithi071 ceph-mon[34859]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:25.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:25 smithi154 ceph-mon[35578]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:25.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:25 smithi038 ceph-mon[30810]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:26.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:26 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:26 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:26 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:26.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:26 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:26.251 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:26 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.371 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.371 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.371 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:26.371 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:26.371 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:26.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:26.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.543+0000 7f45817fa640 1 -- 172.21.15.71:0/2555046782 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f458406af10 con 0x7f45700a2af0 2024-09-12T12:17:26.543 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 1 on host 'smithi071' 2024-09-12T12:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45700a2af0 msgr2=0x7f45700a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45700a2af0 0x7f45700a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4584104800 tx=0x7f456c005f90 comp rx=0 tx=0).stop 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 msgr2=0x7f4584104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584104a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45740305b0 tx=0x7f4574033d90 comp rx=0 tx=0).stop 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 shutdown_connections 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45700a2af0 0x7f45700a4fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841026b0 0x7f4584103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4584101cf0 0x7f45841030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 --2- 172.21.15.71:0/2555046782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4584100af0 0x7f4584104a80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 >> 172.21.15.71:0/2555046782 conn(0x7f45840fc280 msgr2=0x7f458406a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 shutdown_connections 2024-09-12T12:17:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:17:26.545+0000 7f458a562640 1 -- 172.21.15.71:0/2555046782 wait complete. 2024-09-12T12:17:27.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:27 smithi071 ceph-mon[34859]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:27.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:27.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:27.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:27.130 DEBUG:teuthology.orchestra.run.smithi071:osd.1> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T12:17:27.132 INFO:tasks.cephadm:Deploying osd.2 on smithi154 with /dev/vg_nvme/lv_4... 2024-09-12T12:17:27.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:17:27.389 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:27 smithi038 ceph-mon[30810]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:27.389 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:27.389 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:27.389 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:27.390 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:17:27.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:27 smithi154 ceph-mon[35578]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:28.871 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:17:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1[39345]: 2024-09-12T12:17:28.560+0000 7f46a9c91640 -1 osd.1 0 log_to_monitors true 2024-09-12T12:17:29.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:29 smithi038 ceph-mon[30810]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:29.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:29 smithi038 ceph-mon[30810]: from='osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:17:29.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:29 smithi038 ceph-mon[30810]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:17:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:29 smithi071 ceph-mon[34859]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:29 smithi071 ceph-mon[34859]: from='osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:17:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:29 smithi071 ceph-mon[34859]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:17:29.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:29 smithi154 ceph-mon[35578]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:29.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:29 smithi154 ceph-mon[35578]: from='osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:17:29.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:29 smithi154 ceph-mon[35578]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:17:29.827 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:17:29.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-09-12T12:17:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi071 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-12T12:17:30.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:30.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:30.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:17:30.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi071 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:30.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.514 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1[39345]: 2024-09-12T12:17:30.127+0000 7f46a5c14640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T12:17:30.514 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1[39345]: 2024-09-12T12:17:30.130+0000 7f46a1a3c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:17:30.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi071 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/65788323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04101c00 msgr2=0x7f2e04102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/65788323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04101c00 0x7f2e04102000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009900 tx=0x7f2e0002a410 comp rx=0 tx=0).stop 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/65788323 shutdown_connections 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/65788323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e041037c0 0x7f2e0410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/65788323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e04102e00 0x7f2e04103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/65788323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04101c00 0x7f2e04102000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/65788323 >> 172.21.15.154:0/65788323 conn(0x7f2e040fd390 msgr2=0x7f2e040ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/65788323 shutdown_connections 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.529+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/65788323 wait complete. 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 Processor -- start 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 -- start start 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e04101c00 0x7f2e04197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04102e00 0x7f2e04198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e041037c0 0x7f2e0419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0410d860 con 0x7f2e041037c0 2024-09-12T12:17:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0410d6e0 con 0x7f2e04101c00 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0b2d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0410d9e0 con 0x7f2e04102e00 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04102e00 0x7f2e04198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04102e00 0x7f2e04198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47058/0 (socket says 172.21.15.154:47058) 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 -- 172.21.15.154:0/2521611232 learned_addr learned my addr 172.21.15.154:0/2521611232 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0906d640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e04101c00 0x7f2e04197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0986e640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e041037c0 0x7f2e0419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 -- 172.21.15.154:0/2521611232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e04101c00 msgr2=0x7f2e04197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e04101c00 0x7f2e04197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 -- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e041037c0 msgr2=0x7f2e0419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e041037c0 0x7f2e0419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 -- 172.21.15.154:0/2521611232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0419fb40 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.530+0000 7f2e0886c640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04102e00 0x7f2e04198450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d950 tx=0x7f2df400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.531+0000 7f2dfa7fc640 1 -- 172.21.15.154:0/2521611232 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4017030 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.531+0000 7f2dfa7fc640 1 -- 172.21.15.154:0/2521611232 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2df4004020 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.531+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0419fe30 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.531+0000 7f2dfa7fc640 1 -- 172.21.15.154:0/2521611232 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df40047a0 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.531+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e041a02e0 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.532+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e04109050 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.533+0000 7f2dfa7fc640 1 -- 172.21.15.154:0/2521611232 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f2df40041d0 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.533+0000 7f2dfa7fc640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2df00a2b20 0x7f2df00a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.533+0000 7f2dfa7fc640 1 -- 172.21.15.154:0/2521611232 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f2df40cd0f0 con 0x7f2e04102e00 2024-09-12T12:17:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.533+0000 7f2e0906d640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2df00a2b20 0x7f2df00a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.534+0000 7f2e0906d640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2df00a2b20 0x7f2df00a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e00005ab0 tx=0x7f2e00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.538+0000 7f2dfa7fc640 1 -- 172.21.15.154:0/2521611232 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2df409b9c0 con 0x7f2e04102e00 2024-09-12T12:17:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:30.711+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2e04062630 con 0x7f2df00a2b20 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:31.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:17:31.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T12:17:31.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:31.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:31.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:31.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:31.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:31.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:32.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:32 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:17:32.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:32 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:17:32.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:32 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:32.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:32 smithi154 ceph-mon[35578]: osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] boot 2024-09-12T12:17:32.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:32 smithi154 ceph-mon[35578]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:17:32.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:32 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:32.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:32 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:17:32.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:32 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:17:32.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:32 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:32.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:32 smithi038 ceph-mon[30810]: osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] boot 2024-09-12T12:17:32.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:32 smithi038 ceph-mon[30810]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:17:32.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:32 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:32 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:17:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:32 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:17:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:32 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:32 smithi071 ceph-mon[34859]: osd.1 [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] boot 2024-09-12T12:17:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:32 smithi071 ceph-mon[34859]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:17:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:32 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:17:33.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:33 smithi154 ceph-mon[35578]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:33.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:33 smithi154 ceph-mon[35578]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T12:17:33.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:33 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/1124962249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]: dispatch 2024-09-12T12:17:33.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:33 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]: dispatch 2024-09-12T12:17:33.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:33 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]': finished 2024-09-12T12:17:33.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:33 smithi154 ceph-mon[35578]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:17:33.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:33.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:33 smithi038 ceph-mon[30810]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:33.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:33 smithi038 ceph-mon[30810]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T12:17:33.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:33 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/1124962249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]: dispatch 2024-09-12T12:17:33.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:33 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]: dispatch 2024-09-12T12:17:33.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:33 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]': finished 2024-09-12T12:17:33.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:33 smithi038 ceph-mon[30810]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:17:33.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:33 smithi071 ceph-mon[34859]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:17:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:33 smithi071 ceph-mon[34859]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T12:17:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:33 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/1124962249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]: dispatch 2024-09-12T12:17:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:33 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]: dispatch 2024-09-12T12:17:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:33 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b506f93-8b23-4b61-91ef-853f291ff271"}]': finished 2024-09-12T12:17:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:33 smithi071 ceph-mon[34859]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:17:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:34.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:34 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/1128646974' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:34.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:34 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/1128646974' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:34 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/1128646974' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:35.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:35 smithi154 ceph-mon[35578]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:35.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:35 smithi038 ceph-mon[30810]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:35 smithi071 ceph-mon[34859]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:37.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:37 smithi154 ceph-mon[35578]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:37.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:37 smithi038 ceph-mon[30810]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:37.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:37 smithi071 ceph-mon[34859]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:39.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:39 smithi154 ceph-mon[35578]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:39.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:39 smithi038 ceph-mon[30810]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:39.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:39 smithi071 ceph-mon[34859]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:41.248 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:41 smithi154 ceph-mon[35578]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:41.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:41 smithi038 ceph-mon[30810]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:41.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:41 smithi071 ceph-mon[34859]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:42.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:42 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:17:42.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:42 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:42.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:42 smithi154 ceph-mon[35578]: Deploying daemon osd.2 on smithi154 2024-09-12T12:17:42.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:42 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:17:42.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:42 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:42.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:42 smithi038 ceph-mon[30810]: Deploying daemon osd.2 on smithi154 2024-09-12T12:17:42.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:42 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:17:42.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:42 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:42.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:42 smithi071 ceph-mon[34859]: Deploying daemon osd.2 on smithi154 2024-09-12T12:17:43.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:43 smithi154 ceph-mon[35578]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:43.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:43 smithi038 ceph-mon[30810]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:43.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:43 smithi071 ceph-mon[34859]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:45.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:45 smithi038 ceph-mon[30810]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:45 smithi071 ceph-mon[34859]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:45.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:45 smithi154 ceph-mon[35578]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:47.296 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:47 smithi154 ceph-mon[35578]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:47.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:47 smithi038 ceph-mon[30810]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:47 smithi071 ceph-mon[34859]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:48.231 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:48 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:48.231 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:48 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:48.231 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:48 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:48.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:48 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:48.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:48 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:48.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:48 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:48 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:48 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:48 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:49.843 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:49 smithi154 ceph-mon[35578]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:49.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:49 smithi038 ceph-mon[30810]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:49 smithi071 ceph-mon[34859]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:51.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:51.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:51.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.658+0000 7f2dfa7fc640 1 -- 172.21.15.154:0/2521611232 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2e04062630 con 0x7f2df00a2b20 2024-09-12T12:17:51.658 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 2 on host 'smithi154' 2024-09-12T12:17:51.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2df00a2b20 msgr2=0x7f2df00a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2df00a2b20 0x7f2df00a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e00005ab0 tx=0x7f2e00000bc0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04102e00 msgr2=0x7f2e04198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04102e00 0x7f2e04198450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d950 tx=0x7f2df400de10 comp rx=0 tx=0).stop 2024-09-12T12:17:51.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 shutdown_connections 2024-09-12T12:17:51.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2df00a2b20 0x7f2df00a4fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e041037c0 0x7f2e0419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e04102e00 0x7f2e04198450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 --2- 172.21.15.154:0/2521611232 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e04101c00 0x7f2e04197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 >> 172.21.15.154:0/2521611232 conn(0x7f2e040fd390 msgr2=0x7f2e04106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:51.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 shutdown_connections 2024-09-12T12:17:51.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:17:51.660+0000 7f2e0b2d1640 1 -- 172.21.15.154:0/2521611232 wait complete. 2024-09-12T12:17:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:51 smithi154 ceph-mon[35578]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:52.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:51 smithi038 ceph-mon[30810]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:52.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:52.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:52.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:51 smithi071 ceph-mon[34859]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:52.326 DEBUG:teuthology.orchestra.run.smithi154:osd.2> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T12:17:52.328 INFO:tasks.cephadm:Deploying osd.3 on smithi038 with /dev/vg_nvme/lv_3... 2024-09-12T12:17:52.328 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:17:52.709 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:53.743 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:17:53 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2[40560]: 2024-09-12T12:17:53.548+0000 7f73c5f00640 -1 osd.2 0 log_to_monitors true 2024-09-12T12:17:54.017 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:53 smithi038 ceph-mon[30810]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:54.017 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:53 smithi038 ceph-mon[30810]: from='osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:17:54.017 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:53 smithi038 ceph-mon[30810]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:17:54.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:53 smithi154 ceph-mon[35578]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:54.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:53 smithi154 ceph-mon[35578]: from='osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:17:54.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:53 smithi154 ceph-mon[35578]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:17:54.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:53 smithi071 ceph-mon[34859]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:54.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:53 smithi071 ceph-mon[34859]: from='osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:17:54.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:53 smithi071 ceph-mon[34859]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: from='osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T12:17:55.088 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: from='osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T12:17:55.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:54 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:55.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:17:55.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:17:55.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: from='osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:17:55.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:55.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:17:55.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:17:55.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T12:17:55.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:54 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:55.836 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2[40560]: 2024-09-12T12:17:55.483+0000 7f73c1e83640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T12:17:55.836 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2[40560]: 2024-09-12T12:17:55.490+0000 7f73b9ca3640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:17:55.982 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:17:56.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_3 2024-09-12T12:17:56.067 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:56.067 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:56.067 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='osd.2 ' entity='osd.2' 2024-09-12T12:17:56.068 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='osd.2 ' entity='osd.2' 2024-09-12T12:17:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:56.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:17:56.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='osd.2 ' entity='osd.2' 2024-09-12T12:17:56.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:56.388 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:56.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 -- 172.21.15.38:0/1156643873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 msgr2=0x7fa424104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 --2- 172.21.15.38:0/1156643873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa424104200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa414009900 tx=0x7fa41402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 -- 172.21.15.38:0/1156643873 shutdown_connections 2024-09-12T12:17:56.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 --2- 172.21.15.38:0/1156643873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa424105920 0x7fa42410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 --2- 172.21.15.38:0/1156643873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa424104f60 0x7fa4241053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 --2- 172.21.15.38:0/1156643873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa424104200 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 -- 172.21.15.38:0/1156643873 >> 172.21.15.38:0/1156643873 conn(0x7fa4240ff5b0 msgr2=0x7fa4241019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:56.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 -- 172.21.15.38:0/1156643873 shutdown_connections 2024-09-12T12:17:56.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.978+0000 7fa429a00640 1 -- 172.21.15.38:0/1156643873 wait complete. 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 Processor -- start 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 -- start start 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa42419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa424104f60 0x7fa42419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa424105920 0x7fa4241a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa42410fab0 con 0x7fa424103e00 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa42410f930 con 0x7fa424105920 2024-09-12T12:17:56.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.979+0000 7fa429a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa42410fc30 con 0x7fa424104f60 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa422a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa42419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa41be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa424104f60 0x7fa42419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa422a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa42419a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54590/0 (socket says 172.21.15.38:54590) 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa422a00640 1 -- 172.21.15.38:0/3746503384 learned_addr learned my addr 172.21.15.38:0/3746503384 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa423400640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa424105920 0x7fa4241a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa41be00640 1 -- 172.21.15.38:0/3746503384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa424105920 msgr2=0x7fa4241a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa41be00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa424105920 0x7fa4241a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa41be00640 1 -- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 msgr2=0x7fa42419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa41be00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa42419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa41be00640 1 -- 172.21.15.38:0/3746503384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4241a1d20 con 0x7fa424104f60 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa422a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa42419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:56.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.980+0000 7fa41be00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa424104f60 0x7fa42419a630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa424103b30 tx=0x7fa40c00dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:56.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.981+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c017070 con 0x7fa424104f60 2024-09-12T12:17:56.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.981+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa40c010460 con 0x7fa424104f60 2024-09-12T12:17:56.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.981+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4241a1fb0 con 0x7fa424104f60 2024-09-12T12:17:56.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.981+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c00f620 con 0x7fa424104f60 2024-09-12T12:17:56.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.981+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4241a2470 con 0x7fa424104f60 2024-09-12T12:17:56.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.982+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa42410b190 con 0x7fa424104f60 2024-09-12T12:17:56.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.984+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fa40c01a070 con 0x7fa424104f60 2024-09-12T12:17:56.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.985+0000 7fa41b400640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4080a2b20 0x7fa4080a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.985+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fa40c0cd330 con 0x7fa424104f60 2024-09-12T12:17:56.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.985+0000 7fa422a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4080a2b20 0x7fa4080a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.986+0000 7fa422a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4080a2b20 0x7fa4080a4fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa414031440 tx=0x7fa4140315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:56.989+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa40c09b1d0 con 0x7fa424104f60 2024-09-12T12:17:57.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:56 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:17:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:56 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:17:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:56 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi154 2024-09-12T12:17:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:56 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-12T12:17:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:56 smithi154 ceph-mon[35578]: osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] boot 2024-09-12T12:17:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:56 smithi154 ceph-mon[35578]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:17:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:56 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:57.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:17:57.187+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa424062630 con 0x7fa4080a2b20 2024-09-12T12:17:57.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:56 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:17:57.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:56 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:17:57.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:56 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi154 2024-09-12T12:17:57.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:56 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-12T12:17:57.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:56 smithi038 ceph-mon[30810]: osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] boot 2024-09-12T12:17:57.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:56 smithi038 ceph-mon[30810]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:17:57.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:56 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:56 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:17:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:56 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:17:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:56 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi154 2024-09-12T12:17:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:56 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-12T12:17:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:56 smithi071 ceph-mon[34859]: osd.2 [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] boot 2024-09-12T12:17:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:56 smithi071 ceph-mon[34859]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:17:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:56 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:17:57.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:57 smithi154 ceph-mon[35578]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:57.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:57 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:57.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:57 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:57.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:57 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:58.070 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:57 smithi038 ceph-mon[30810]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:58.070 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:58.071 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:58.071 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:58.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:57 smithi071 ceph-mon[34859]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:17:58.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:57 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:58.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:57 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:58.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:57 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:59.016 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:58 smithi038 ceph-mon[30810]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:59.016 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:58 smithi038 ceph-mon[30810]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T12:17:59.017 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:58 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:17:59.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:58 smithi154 ceph-mon[35578]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:59.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:58 smithi154 ceph-mon[35578]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T12:17:59.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:58 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:17:59.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:58 smithi071 ceph-mon[34859]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:59.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:58 smithi071 ceph-mon[34859]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T12:17:59.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:58 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:18:00.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:59 smithi154 ceph-mon[35578]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:00.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:59 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:18:00.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:59 smithi154 ceph-mon[35578]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T12:18:00.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:17:59 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:18:00.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:59 smithi038 ceph-mon[30810]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:00.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:59 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:18:00.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:59 smithi038 ceph-mon[30810]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T12:18:00.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:17:59 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:18:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:59 smithi071 ceph-mon[34859]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:59 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:18:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:59 smithi071 ceph-mon[34859]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T12:18:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:17:59 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:18:00.871 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:00 smithi038 sudo[49204]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:18:00.871 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:00 smithi038 sudo[49204]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:00.871 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:00 smithi038 sudo[49204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:00.871 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:00 smithi038 sudo[49204]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:00.883+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa40c097840 con 0x7fa424104f60 2024-09-12T12:18:01.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:00 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:18:01.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:00 smithi154 ceph-mon[35578]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T12:18:01.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:00 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1024454405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cff00379-25cc-49a9-affe-2a92479e3a6b"}]: dispatch 2024-09-12T12:18:01.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:00 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1024454405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cff00379-25cc-49a9-affe-2a92479e3a6b"}]': finished 2024-09-12T12:18:01.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:00 smithi154 ceph-mon[35578]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:18:01.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:00 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:01.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:00 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:18:01.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:00 smithi038 ceph-mon[30810]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T12:18:01.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:00 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1024454405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cff00379-25cc-49a9-affe-2a92479e3a6b"}]: dispatch 2024-09-12T12:18:01.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:00 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1024454405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cff00379-25cc-49a9-affe-2a92479e3a6b"}]': finished 2024-09-12T12:18:01.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:00 smithi038 ceph-mon[30810]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:18:01.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:00 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:01.220 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:01 smithi038 sudo[49248]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:18:01.220 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:01 smithi038 sudo[49248]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:01.220 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:01 smithi038 sudo[49248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:01.220 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:18:01 smithi038 sudo[49248]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:00 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:18:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:00 smithi071 ceph-mon[34859]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T12:18:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:00 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1024454405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cff00379-25cc-49a9-affe-2a92479e3a6b"}]: dispatch 2024-09-12T12:18:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:00 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1024454405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cff00379-25cc-49a9-affe-2a92479e3a6b"}]': finished 2024-09-12T12:18:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:00 smithi071 ceph-mon[34859]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:18:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:00 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:01.629 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43167]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:18:01.629 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43167]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:01.629 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:01.629 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43167]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:01.882 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43170]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:18:01.882 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43170]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:01.882 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:01.882 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:18:01 smithi071 sudo[43170]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:02.160 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:01 smithi154 ceph-mon[35578]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:02.160 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:01 smithi154 ceph-mon[35578]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:18:02.160 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:01 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3091588802' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:02.161 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:02.161 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:01 smithi154 sudo[44189]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:18:02.161 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:01 smithi154 sudo[44189]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:02.161 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:01 smithi154 sudo[44189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:02.161 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:01 smithi154 sudo[44189]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:01 smithi038 ceph-mon[30810]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:01 smithi038 ceph-mon[30810]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:18:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:01 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3091588802' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:01 smithi071 ceph-mon[34859]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:01 smithi071 ceph-mon[34859]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:18:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:01 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3091588802' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:02.416 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:02 smithi154 sudo[44192]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:18:02.417 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:02 smithi154 sudo[44192]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:02.417 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:02 smithi154 sudo[44192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:02.417 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:18:02 smithi154 sudo[44192]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:03.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:02 smithi038 sudo[49659]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:18:03.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:02 smithi038 sudo[49659]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:03.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:02 smithi038 sudo[49659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:03.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:02 smithi038 sudo[49659]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:03.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:03 smithi038 sudo[49669]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:18:03.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:03 smithi038 sudo[49669]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:03.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:03 smithi038 sudo[49669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:03.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:03 smithi038 sudo[49669]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:03.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:03.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:03 smithi038 ceph-mon[30810]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:03.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:03.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:03 smithi071 ceph-mon[34859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:03.804 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44195]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:18:03.804 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44195]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:03.804 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:03.805 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44195]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44198]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:18:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44198]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 sudo[44198]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:03 smithi154 ceph-mon[35578]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:04.302 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:18:04.302 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:04.302 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:04.302 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43173]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:04 smithi154 ceph-mon[35578]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:04 smithi038 ceph-mon[30810]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43176]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43176]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 sudo[43176]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:04.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:18:04.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:18:04.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:18:04.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:18:04.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:04 smithi071 ceph-mon[34859]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:18:05.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:05 smithi154 ceph-mon[35578]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:05.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:05 smithi038 ceph-mon[30810]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:05.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:05 smithi071 ceph-mon[34859]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:07.624 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:07 smithi038 ceph-mon[30810]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:07.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:07 smithi154 ceph-mon[35578]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:07.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:07 smithi071 ceph-mon[34859]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:09.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:09 smithi154 ceph-mon[35578]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-12T12:18:09.701 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:09 smithi038 ceph-mon[30810]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-12T12:18:09.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:09 smithi071 ceph-mon[34859]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-12T12:18:10.605 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:10 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:18:10.605 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:10 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:10.605 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:10 smithi038 ceph-mon[30810]: Deploying daemon osd.3 on smithi038 2024-09-12T12:18:10.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:10 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:18:10.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:10 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:10.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:10 smithi154 ceph-mon[35578]: Deploying daemon osd.3 on smithi038 2024-09-12T12:18:10.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:10 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:18:10.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:10 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:10.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:10 smithi071 ceph-mon[34859]: Deploying daemon osd.3 on smithi038 2024-09-12T12:18:11.382 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:11 smithi038 ceph-mon[30810]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-12T12:18:11.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:11 smithi154 ceph-mon[35578]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-12T12:18:11.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:11 smithi071 ceph-mon[34859]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-12T12:18:13.400 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:13 smithi038 ceph-mon[30810]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-12T12:18:13.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:13 smithi154 ceph-mon[35578]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-12T12:18:13.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:13 smithi071 ceph-mon[34859]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-12T12:18:15.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:15 smithi038 ceph-mon[30810]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-12T12:18:15.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:15 smithi154 ceph-mon[35578]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-12T12:18:15.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:15 smithi071 ceph-mon[34859]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-12T12:18:17.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:17 smithi038 ceph-mon[30810]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T12:18:17.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:17.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:17.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:17.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:17 smithi154 ceph-mon[35578]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T12:18:17.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:17.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:17.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:17.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:17 smithi071 ceph-mon[34859]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T12:18:17.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:17 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:17.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:17 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:17.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:17 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:19.464 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:19 smithi038 ceph-mon[30810]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T12:18:19.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:19 smithi154 ceph-mon[35578]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T12:18:19.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:19 smithi071 ceph-mon[34859]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T12:18:21.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:21 smithi038 ceph-mon[30810]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:21.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:21.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:21.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:21 smithi154 ceph-mon[35578]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:21.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:21.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:21.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:21 smithi071 ceph-mon[34859]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:21.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:21.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:21.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:21.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.869+0000 7fa41b400640 1 -- 172.21.15.38:0/3746503384 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa424062630 con 0x7fa4080a2b20 2024-09-12T12:18:21.870 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 3 on host 'smithi038' 2024-09-12T12:18:21.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.872+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4080a2b20 msgr2=0x7fa4080a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.872+0000 7fa429a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4080a2b20 0x7fa4080a4fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa414031440 tx=0x7fa4140315b0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.872+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa424104f60 msgr2=0x7fa42419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.872+0000 7fa429a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa424104f60 0x7fa42419a630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa424103b30 tx=0x7fa40c00dbb0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 shutdown_connections 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4080a2b20 0x7fa4080a4fe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa424105920 0x7fa4241a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa424104f60 0x7fa42419a630 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 --2- 172.21.15.38:0/3746503384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa424103e00 0x7fa42419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 >> 172.21.15.38:0/3746503384 conn(0x7fa4240ff5b0 msgr2=0x7fa424108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 shutdown_connections 2024-09-12T12:18:21.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:18:21.873+0000 7fa429a00640 1 -- 172.21.15.38:0/3746503384 wait complete. 2024-09-12T12:18:22.552 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:22 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:22.552 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:22 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:22.552 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:22 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:22.591 DEBUG:teuthology.orchestra.run.smithi038:osd.3> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T12:18:22.595 INFO:tasks.cephadm:Deploying osd.4 on smithi071 with /dev/vg_nvme/lv_3... 2024-09-12T12:18:22.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:18:22.623 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:22 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:22.623 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:22 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:22.623 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:22 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:22.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:22 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:22.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:22 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:22.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:22 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:22.845 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:18:23.469 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:18:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:18:23.300+0000 7f4e6b51f640 -1 osd.3 0 log_to_monitors true 2024-09-12T12:18:23.942 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:23 smithi038 ceph-mon[30810]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:23.942 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:23 smithi038 ceph-mon[30810]: from='osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:18:23.942 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:23 smithi038 ceph-mon[30810]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:18:24.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:23 smithi071 ceph-mon[34859]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:24.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:23 smithi071 ceph-mon[34859]: from='osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:18:24.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:23 smithi071 ceph-mon[34859]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:18:24.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:23 smithi154 ceph-mon[35578]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:24.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:23 smithi154 ceph-mon[35578]: from='osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:18:24.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:23 smithi154 ceph-mon[35578]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:18:25.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:24 smithi154 ceph-mon[35578]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:18:25.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:24 smithi154 ceph-mon[35578]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T12:18:25.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:24 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:25.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:24 smithi154 ceph-mon[35578]: from='osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:18:25.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:24 smithi154 ceph-mon[35578]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:18:25.182 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:24 smithi071 ceph-mon[34859]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:18:25.183 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:24 smithi071 ceph-mon[34859]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T12:18:25.183 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:24 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:25.183 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:24 smithi071 ceph-mon[34859]: from='osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:18:25.183 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:24 smithi071 ceph-mon[34859]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:18:25.185 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:18:25.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-09-12T12:18:25.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:24 smithi038 ceph-mon[30810]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:18:25.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:24 smithi038 ceph-mon[30810]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T12:18:25.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:24 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:25.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:24 smithi038 ceph-mon[30810]: from='osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:18:25.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:24 smithi038 ceph-mon[30810]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:18:25.220 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:18:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:18:24.905+0000 7f4e65600640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T12:18:25.220 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:18:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:18:24.911+0000 7f4e60600640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:18:25.507 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.963+0000 7ff0d588e640 1 -- 172.21.15.71:0/3933706459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0101cd0 msgr2=0x7ff0d0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.963+0000 7ff0d588e640 1 --2- 172.21.15.71:0/3933706459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0101cd0 0x7ff0d0102150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009900 tx=0x7ff0b802a410 comp rx=0 tx=0).stop 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- 172.21.15.71:0/3933706459 shutdown_connections 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 --2- 172.21.15.71:0/3933706459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0d0102690 0x7ff0d0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 --2- 172.21.15.71:0/3933706459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0101cd0 0x7ff0d0102150 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 --2- 172.21.15.71:0/3933706459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d0100ad0 0x7ff0d0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- 172.21.15.71:0/3933706459 >> 172.21.15.71:0/3933706459 conn(0x7ff0d00fc280 msgr2=0x7ff0d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- 172.21.15.71:0/3933706459 shutdown_connections 2024-09-12T12:18:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- 172.21.15.71:0/3933706459 wait complete. 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 Processor -- start 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- start start 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0100ad0 0x7ff0d0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0d0101cd0 0x7ff0d0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d0102690 0x7ff0d019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d010c730 con 0x7ff0d0101cd0 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d010c5b0 con 0x7ff0d0100ad0 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0d588e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d010c8b0 con 0x7ff0d0102690 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0ceffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0100ad0 0x7ff0d0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.964+0000 7ff0ceffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0100ad0 0x7ff0d0197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54422/0 (socket says 172.21.15.71:54422) 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0ceffd640 1 -- 172.21.15.71:0/2280025738 learned_addr learned my addr 172.21.15.71:0/2280025738 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T12:18:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0cf7fe640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d0102690 0x7ff0d019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0ceffd640 1 -- 172.21.15.71:0/2280025738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d0102690 msgr2=0x7ff0d019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0ceffd640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d0102690 0x7ff0d019f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0ceffd640 1 -- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0d0101cd0 msgr2=0x7ff0d0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0ceffd640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0d0101cd0 0x7ff0d0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0ceffd640 1 -- 172.21.15.71:0/2280025738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d019fb30 con 0x7ff0d0100ad0 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0ceffd640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0100ad0 0x7ff0d0197f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000c970 tx=0x7ff0c000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0d488c640 1 -- 172.21.15.71:0/2280025738 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0004220 con 0x7ff0d0100ad0 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0d488c640 1 -- 172.21.15.71:0/2280025738 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0c00043c0 con 0x7ff0d0100ad0 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d019fe20 con 0x7ff0d0100ad0 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0d488c640 1 -- 172.21.15.71:0/2280025738 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000f450 con 0x7ff0d0100ad0 2024-09-12T12:18:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.965+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d01a02d0 con 0x7ff0d0100ad0 2024-09-12T12:18:25.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.967+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d01a0560 con 0x7ff0d0100ad0 2024-09-12T12:18:25.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.967+0000 7ff0d488c640 1 -- 172.21.15.71:0/2280025738 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff0c00079b0 con 0x7ff0d0100ad0 2024-09-12T12:18:25.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.968+0000 7ff0d488c640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff0bc0a2bb0 0x7ff0bc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.968+0000 7ff0d488c640 1 -- 172.21.15.71:0/2280025738 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7ff0c00cdc10 con 0x7ff0d0100ad0 2024-09-12T12:18:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.968+0000 7ff0c7fff640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff0bc0a2bb0 0x7ff0bc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.969+0000 7ff0c7fff640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff0bc0a2bb0 0x7ff0bc0a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80096c0 tx=0x7ff0b8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:25.973+0000 7ff0d488c640 1 -- 172.21.15.71:0/2280025738 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0c0014030 con 0x7ff0d0100ad0 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] boot 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T12:18:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.100 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:26.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:18:26.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T12:18:26.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] boot 2024-09-12T12:18:26.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T12:18:26.101 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:18:26.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:18:26.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T12:18:26.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: osd.3 [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] boot 2024-09-12T12:18:26.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T12:18:26.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:18:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:26.169+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff0d01a0730 con 0x7ff0bc0a2bb0 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi038 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:27.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi038 to 8547M 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:27.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:27 smithi154 ceph-mon[35578]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T12:18:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:18:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:18:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi038 2024-09-12T12:18:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi038 to 8547M 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:27.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:27 smithi038 ceph-mon[30810]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T12:18:27.485 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi038 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi038 to 8547M 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:27.486 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:27.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:27.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:27.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:27.487 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:27 smithi071 ceph-mon[34859]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T12:18:28.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:28 smithi154 ceph-mon[35578]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T12:18:28.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:28 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/925302357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]: dispatch 2024-09-12T12:18:28.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:28 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]: dispatch 2024-09-12T12:18:28.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:28 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]': finished 2024-09-12T12:18:28.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:28 smithi154 ceph-mon[35578]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:18:28.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:28 smithi038 ceph-mon[30810]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T12:18:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:28 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/925302357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]: dispatch 2024-09-12T12:18:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:28 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]: dispatch 2024-09-12T12:18:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:28 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]': finished 2024-09-12T12:18:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:28 smithi038 ceph-mon[30810]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:18:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:29.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:28 smithi071 ceph-mon[34859]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T12:18:29.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:28 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/925302357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]: dispatch 2024-09-12T12:18:29.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:28 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]: dispatch 2024-09-12T12:18:29.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:28 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8"}]': finished 2024-09-12T12:18:29.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:28 smithi071 ceph-mon[34859]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:18:29.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:29.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:29 smithi154 ceph-mon[35578]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:29.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:29 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/2094379308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:29.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:29 smithi154 ceph-mon[35578]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:18:29.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:29 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:29.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:29 smithi038 ceph-mon[30810]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:29.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:29 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/2094379308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:29.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:29 smithi038 ceph-mon[30810]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:18:29.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:29 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:30.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:29 smithi071 ceph-mon[34859]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:30.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:29 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/2094379308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:30.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:29 smithi071 ceph-mon[34859]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:18:30.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:29 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:31.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:31 smithi154 ceph-mon[35578]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:31 smithi038 ceph-mon[30810]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:32.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:31 smithi071 ceph-mon[34859]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:33.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:33 smithi154 ceph-mon[35578]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:33.928 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:33 smithi071 ceph-mon[34859]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:33 smithi038 ceph-mon[30810]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:35.830 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:35 smithi071 ceph-mon[34859]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T12:18:35.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:35 smithi154 ceph-mon[35578]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T12:18:35.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:35 smithi038 ceph-mon[30810]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T12:18:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:37 smithi154 ceph-mon[35578]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:18:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:18:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:37 smithi154 ceph-mon[35578]: Deploying daemon osd.4 on smithi071 2024-09-12T12:18:37.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:37 smithi038 ceph-mon[30810]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:18:37.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:18:37.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:37.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:37 smithi038 ceph-mon[30810]: Deploying daemon osd.4 on smithi071 2024-09-12T12:18:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:37 smithi071 ceph-mon[34859]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:18:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:18:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:37 smithi071 ceph-mon[34859]: Deploying daemon osd.4 on smithi071 2024-09-12T12:18:39.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:39 smithi154 ceph-mon[35578]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T12:18:39.934 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:39 smithi071 ceph-mon[34859]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T12:18:39.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:39 smithi038 ceph-mon[30810]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-12T12:18:41.830 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:41 smithi071 ceph-mon[34859]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T12:18:41.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:41 smithi154 ceph-mon[35578]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T12:18:41.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:41 smithi038 ceph-mon[30810]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T12:18:43.698 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:43 smithi071 ceph-mon[34859]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:18:43.699 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:43.699 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:43.699 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:43.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:43 smithi154 ceph-mon[35578]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:18:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:43 smithi038 ceph-mon[30810]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:18:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:45 smithi071 ceph-mon[34859]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:18:45.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:45.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:45.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:45 smithi154 ceph-mon[35578]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:18:45.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:45.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:45.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:45 smithi038 ceph-mon[30810]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:18:45.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:45.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:45.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:45.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:46.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.840+0000 7ff0d488c640 1 -- 172.21.15.71:0/2280025738 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff0d01a0730 con 0x7ff0bc0a2bb0 2024-09-12T12:18:46.842 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 4 on host 'smithi071' 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.842+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff0bc0a2bb0 msgr2=0x7ff0bc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.842+0000 7ff0d588e640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff0bc0a2bb0 0x7ff0bc0a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80096c0 tx=0x7ff0b8031400 comp rx=0 tx=0).stop 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0100ad0 msgr2=0x7ff0d0197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0100ad0 0x7ff0d0197f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000c970 tx=0x7ff0c000ce30 comp rx=0 tx=0).stop 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 shutdown_connections 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff0bc0a2bb0 0x7ff0bc0a5070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d0102690 0x7ff0d019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0d0101cd0 0x7ff0d0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 --2- 172.21.15.71:0/2280025738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0d0100ad0 0x7ff0d0197f00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 >> 172.21.15.71:0/2280025738 conn(0x7ff0d00fc280 msgr2=0x7ff0d0069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 shutdown_connections 2024-09-12T12:18:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:18:46.843+0000 7ff0d588e640 1 -- 172.21.15.71:0/2280025738 wait complete. 2024-09-12T12:18:47.428 DEBUG:teuthology.orchestra.run.smithi071:osd.4> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T12:18:47.430 INFO:tasks.cephadm:Deploying osd.5 on smithi154 with /dev/vg_nvme/lv_3... 2024-09-12T12:18:47.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:18:47.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:47 smithi071 ceph-mon[34859]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:47.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:47.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:47.673 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:47.687 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:18:47.808 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:47 smithi154 ceph-mon[35578]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:47.808 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:47.808 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:47.808 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:47.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:47 smithi038 ceph-mon[30810]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:47.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:47.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:47.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:49.179 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:18:49 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4[45914]: 2024-09-12T12:18:49.036+0000 7f43561b7640 -1 osd.4 0 log_to_monitors true 2024-09-12T12:18:49.899 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:49 smithi154 ceph-mon[35578]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:49.899 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:49 smithi154 ceph-mon[35578]: from='osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:18:49.899 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:49 smithi154 ceph-mon[35578]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:18:49.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:49 smithi038 ceph-mon[30810]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:49.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:49 smithi038 ceph-mon[30810]: from='osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:18:49.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:49 smithi038 ceph-mon[30810]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:18:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:49 smithi071 ceph-mon[34859]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:49 smithi071 ceph-mon[34859]: from='osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:18:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:49 smithi071 ceph-mon[34859]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:18:50.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:18:50.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-09-12T12:18:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:18:50.756 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:50.757 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.758 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:50.758 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:50.758 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:18:50.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:18:50.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T12:18:50.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:50.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:50.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 -- 172.21.15.154:0/4066112075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 msgr2=0x7fe0b4108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:50.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/4066112075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b4108f50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009900 tx=0x7fe0ac02a410 comp rx=0 tx=0).stop 2024-09-12T12:18:50.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 -- 172.21.15.154:0/4066112075 shutdown_connections 2024-09-12T12:18:50.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/4066112075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b4108f50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:50.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/4066112075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0b4101d00 0x7fe0b4102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/4066112075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b4100b00 0x7fe0b4100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 -- 172.21.15.154:0/4066112075 >> 172.21.15.154:0/4066112075 conn(0x7fe0b40fc270 msgr2=0x7fe0b40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 -- 172.21.15.154:0/4066112075 shutdown_connections 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.972+0000 7fe0b8f84640 1 -- 172.21.15.154:0/4066112075 wait complete. 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 Processor -- start 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 -- start start 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b4100b00 0x7fe0b410b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0b4101d00 0x7fe0b4109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b410a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b410d8b0 con 0x7fe0b4101d00 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b410d730 con 0x7fe0b4100b00 2024-09-12T12:18:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b8f84640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b410da30 con 0x7fe0b41026c0 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b410a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b4100b00 0x7fe0b410b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b410a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46078/0 (socket says 172.21.15.154:46078) 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b2d9d640 1 -- 172.21.15.154:0/3149601603 learned_addr learned my addr 172.21.15.154:0/3149601603 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b1d9b640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0b4101d00 0x7fe0b4109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b259c640 1 -- 172.21.15.154:0/3149601603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 msgr2=0x7fe0b410a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b259c640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b410a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b259c640 1 -- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0b4101d00 msgr2=0x7fe0b4109ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b259c640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0b4101d00 0x7fe0b4109ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b259c640 1 -- 172.21.15.154:0/3149601603 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b410a8d0 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b2d9d640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b410a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.973+0000 7fe0b1d9b640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0b4101d00 0x7fe0b4109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.974+0000 7fe0b259c640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b4100b00 0x7fe0b410b480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4005fd0 tx=0x7fe0a400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.974+0000 7fe0ab7fe640 1 -- 172.21.15.154:0/3149601603 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4003970 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.974+0000 7fe0ab7fe640 1 -- 172.21.15.154:0/3149601603 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a4004020 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.974+0000 7fe0ab7fe640 1 -- 172.21.15.154:0/3149601603 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40107b0 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.974+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b41a2100 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.974+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b41a25c0 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.975+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b4107fc0 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.976+0000 7fe0ab7fe640 1 -- 172.21.15.154:0/3149601603 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe0a40041d0 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.977+0000 7fe0ab7fe640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe0a00a2b80 0x7fe0a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.977+0000 7fe0ab7fe640 1 -- 172.21.15.154:0/3149601603 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7fe0a40ce740 con 0x7fe0b4100b00 2024-09-12T12:18:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.977+0000 7fe0b1d9b640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe0a00a2b80 0x7fe0a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:50.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.978+0000 7fe0b1d9b640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe0a00a2b80 0x7fe0a00a5040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b410b200 tx=0x7fe09c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:50.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:50.980+0000 7fe0ab7fe640 1 -- 172.21.15.154:0/3149601603 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0a409c790 con 0x7fe0b4100b00 2024-09-12T12:18:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:18:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:18:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T12:18:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:18:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:51.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:51.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:51.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:51.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:51.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:51.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:18:51.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:18:51.157+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe0b4062630 con 0x7fe0a00a2b80 2024-09-12T12:18:51.650 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4[45914]: 2024-09-12T12:18:51.324+0000 7f435294e640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T12:18:51.650 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4[45914]: 2024-09-12T12:18:51.329+0000 7f4349f5a640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi071 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:51.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:51.800 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:51.800 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:51 smithi154 ceph-mon[35578]: from='osd.4 ' entity='osd.4' 2024-09-12T12:18:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi071 2024-09-12T12:18:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-12T12:18:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:18:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T12:18:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:51 smithi038 ceph-mon[30810]: from='osd.4 ' entity='osd.4' 2024-09-12T12:18:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi071 2024-09-12T12:18:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-12T12:18:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:18:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T12:18:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:51 smithi071 ceph-mon[34859]: from='osd.4 ' entity='osd.4' 2024-09-12T12:18:52.865 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:52 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:18:52.865 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:52 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:18:52.865 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:52 smithi154 ceph-mon[35578]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:52.866 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:52 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:52.866 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:52 smithi154 ceph-mon[35578]: osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] boot 2024-09-12T12:18:52.866 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:52 smithi154 ceph-mon[35578]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T12:18:52.866 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:52 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:52.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:52 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:18:52.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:52 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:18:52.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:52 smithi038 ceph-mon[30810]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:52.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:52 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:52.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:52 smithi038 ceph-mon[30810]: osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] boot 2024-09-12T12:18:52.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:52 smithi038 ceph-mon[30810]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T12:18:52.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:52 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:53.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:52 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:18:53.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:52 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:18:53.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:52 smithi071 ceph-mon[34859]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:53.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:52 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:53.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:52 smithi071 ceph-mon[34859]: osd.4 [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] boot 2024-09-12T12:18:53.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:52 smithi071 ceph-mon[34859]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T12:18:53.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:52 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:18:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:53 smithi154 ceph-mon[35578]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:53 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/2435342736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]: dispatch 2024-09-12T12:18:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:53 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]: dispatch 2024-09-12T12:18:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:53 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]': finished 2024-09-12T12:18:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:53 smithi154 ceph-mon[35578]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:18:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:53 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:18:53.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:53 smithi038 ceph-mon[30810]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:53.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:53 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/2435342736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]: dispatch 2024-09-12T12:18:53.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:53 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]: dispatch 2024-09-12T12:18:53.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:53 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]': finished 2024-09-12T12:18:53.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:53 smithi038 ceph-mon[30810]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:18:53.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:53 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:18:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:53 smithi071 ceph-mon[34859]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:18:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:53 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/2435342736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]: dispatch 2024-09-12T12:18:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:53 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]: dispatch 2024-09-12T12:18:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:53 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4"}]': finished 2024-09-12T12:18:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:53 smithi071 ceph-mon[34859]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:18:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:53 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:18:54.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:54 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/3608003034' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:55.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:54 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/3608003034' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:55.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:54 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/3608003034' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:55.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:55 smithi038 ceph-mon[30810]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:18:56.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:55 smithi071 ceph-mon[34859]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:18:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:55 smithi154 ceph-mon[35578]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:18:57.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:57 smithi038 ceph-mon[30810]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:18:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:57 smithi071 ceph-mon[34859]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:18:58.139 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:57 smithi154 ceph-mon[35578]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:18:59.864 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:18:59 smithi154 ceph-mon[35578]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:18:59.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:18:59 smithi038 ceph-mon[30810]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:00.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:18:59 smithi071 ceph-mon[34859]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:01.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:01 smithi154 ceph-mon[35578]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:01.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:01 smithi038 ceph-mon[30810]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:02.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:01 smithi071 ceph-mon[34859]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:02.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:19:02.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:02.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:02 smithi154 ceph-mon[35578]: Deploying daemon osd.5 on smithi154 2024-09-12T12:19:02.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:19:02.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:02.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:02 smithi038 ceph-mon[30810]: Deploying daemon osd.5 on smithi154 2024-09-12T12:19:03.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:19:03.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:03.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:02 smithi071 ceph-mon[34859]: Deploying daemon osd.5 on smithi154 2024-09-12T12:19:03.967 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:03 smithi154 ceph-mon[35578]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:03.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:03 smithi038 ceph-mon[30810]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:04.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:03 smithi071 ceph-mon[34859]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:05.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:05 smithi154 ceph-mon[35578]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:05.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:05 smithi038 ceph-mon[30810]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:06.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:05 smithi071 ceph-mon[34859]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:07.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:07 smithi154 ceph-mon[35578]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:07.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:07 smithi038 ceph-mon[30810]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:08.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:07 smithi071 ceph-mon[34859]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:08.946 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:08.946 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:08.946 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:09.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:09.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:09.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:09.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:09 smithi154 ceph-mon[35578]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:10.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:09 smithi071 ceph-mon[34859]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:10.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:09 smithi038 ceph-mon[30810]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:11 smithi071 ceph-mon[34859]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.052 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:11 smithi154 ceph-mon[35578]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:12.052 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.052 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.052 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:12.052 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:12.052 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:11 smithi038 ceph-mon[30810]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:12.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:12.479 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 5 on host 'smithi154' 2024-09-12T12:19:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.479+0000 7fe0ab7fe640 1 -- 172.21.15.154:0/3149601603 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe0b4062630 con 0x7fe0a00a2b80 2024-09-12T12:19:12.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe0a00a2b80 msgr2=0x7fe0a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe0a00a2b80 0x7fe0a00a5040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b410b200 tx=0x7fe09c005e50 comp rx=0 tx=0).stop 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b4100b00 msgr2=0x7fe0b410b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b4100b00 0x7fe0b410b480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4005fd0 tx=0x7fe0a400ef90 comp rx=0 tx=0).stop 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 shutdown_connections 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe0a00a2b80 0x7fe0a00a5040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b41026c0 0x7fe0b410a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0b4101d00 0x7fe0b4109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 --2- 172.21.15.154:0/3149601603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b4100b00 0x7fe0b410b480 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.481+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 >> 172.21.15.154:0/3149601603 conn(0x7fe0b40fc270 msgr2=0x7fe0b4105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.482+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 shutdown_connections 2024-09-12T12:19:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:19:12.482+0000 7fe0b8f84640 1 -- 172.21.15.154:0/3149601603 wait complete. 2024-09-12T12:19:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:13.157 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:13.157 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:13.157 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:13.187 DEBUG:teuthology.orchestra.run.smithi154:osd.5> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T12:19:13.189 INFO:tasks.cephadm:Deploying osd.6 on smithi038 with /dev/vg_nvme/lv_2... 2024-09-12T12:19:13.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:19:13.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:13.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:13.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:13.570 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:13.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:13 smithi038 ceph-mon[30810]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:14.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:13 smithi071 ceph-mon[34859]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:14.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:13 smithi154 ceph-mon[35578]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:14.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:14 smithi154 ceph-mon[35578]: from='osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:19:14.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:14 smithi154 ceph-mon[35578]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:19:14.785 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:19:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:19:14.503+0000 7f0f4261c640 -1 osd.5 0 log_to_monitors true 2024-09-12T12:19:14.940 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:14 smithi038 ceph-mon[30810]: from='osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:19:14.941 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:14 smithi038 ceph-mon[30810]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:19:15.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:14 smithi071 ceph-mon[34859]: from='osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:19:15.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:14 smithi071 ceph-mon[34859]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:19:15.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:15 smithi038 ceph-mon[30810]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:15.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:15 smithi038 ceph-mon[30810]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:19:15.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:15 smithi038 ceph-mon[30810]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T12:19:15.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:15.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:15 smithi038 ceph-mon[30810]: from='osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:19:15.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:15 smithi038 ceph-mon[30810]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:19:15.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:15 smithi154 ceph-mon[35578]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:15.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:15 smithi154 ceph-mon[35578]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:19:15.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:15 smithi154 ceph-mon[35578]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T12:19:15.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:15.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:15 smithi154 ceph-mon[35578]: from='osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:19:15.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:15 smithi154 ceph-mon[35578]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:19:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:15 smithi071 ceph-mon[34859]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:15 smithi071 ceph-mon[34859]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:19:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:15 smithi071 ceph-mon[34859]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T12:19:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:15 smithi071 ceph-mon[34859]: from='osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:19:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:15 smithi071 ceph-mon[34859]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:19:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:19:16.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_2 2024-09-12T12:19:16.666 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:19:16.414+0000 7f0f3e59f640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T12:19:16.667 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:19:16.419+0000 7f0f363bf640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:19:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:19:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T12:19:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi154 2024-09-12T12:19:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:16 smithi071 ceph-mon[34859]: from='osd.5 ' entity='osd.5' 2024-09-12T12:19:17.058 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi154 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:17.060 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:17.060 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.060 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:16 smithi038 ceph-mon[30810]: from='osd.5 ' entity='osd.5' 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi154 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:17.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-12T12:19:17.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:17.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:17.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:17.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:16 smithi154 ceph-mon[35578]: from='osd.5 ' entity='osd.5' 2024-09-12T12:19:17.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 -- 172.21.15.38:0/1454083535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 msgr2=0x7ff8b8079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:17.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 --2- 172.21.15.38:0/1454083535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 0x7ff8b8079030 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009ca0 tx=0x7ff8b002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:19:17.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 -- 172.21.15.38:0/1454083535 shutdown_connections 2024-09-12T12:19:17.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 --2- 172.21.15.38:0/1454083535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 0x7ff8b8079030 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:17.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 --2- 172.21.15.38:0/1454083535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b8077df0 0x7ff8b8078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:17.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 --2- 172.21.15.38:0/1454083535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 0x7ff8b8076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:17.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 -- 172.21.15.38:0/1454083535 >> 172.21.15.38:0/1454083535 conn(0x7ff8b80ff3e0 msgr2=0x7ff8b8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:17.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 -- 172.21.15.38:0/1454083535 shutdown_connections 2024-09-12T12:19:17.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.530+0000 7ff8bca00640 1 -- 172.21.15.38:0/1454083535 wait complete. 2024-09-12T12:19:17.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.531+0000 7ff8bca00640 1 Processor -- start 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8bca00640 1 -- start start 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8bca00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 0x7ff8b819e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8bca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b8077df0 0x7ff8b819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8bca00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 0x7ff8b81a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8bca00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8113d60 con 0x7ff8b8078790 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8bca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8113be0 con 0x7ff8b8077df0 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8bca00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8113ee0 con 0x7ff8b8076ba0 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8b6800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 0x7ff8b819e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8b6800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 0x7ff8b819e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:45986/0 (socket says 172.21.15.38:45986) 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8b6800640 1 -- 172.21.15.38:0/823975238 learned_addr learned my addr 172.21.15.38:0/823975238 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:19:17.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8b7200640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 0x7ff8b81a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.532+0000 7ff8b5e00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b8077df0 0x7ff8b819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8b6800640 1 -- 172.21.15.38:0/823975238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b8077df0 msgr2=0x7ff8b819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8b6800640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b8077df0 0x7ff8b819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8b6800640 1 -- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 msgr2=0x7ff8b81a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8b6800640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 0x7ff8b81a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8b6800640 1 -- 172.21.15.38:0/823975238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b81a5f00 con 0x7ff8b8076ba0 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8b7200640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 0x7ff8b81a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:17.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8b6800640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 0x7ff8b819e2d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800e9f0 tx=0x7ff8a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:17.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8af400640 1 -- 172.21.15.38:0/823975238 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800cd80 con 0x7ff8b8076ba0 2024-09-12T12:19:17.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b81a61f0 con 0x7ff8b8076ba0 2024-09-12T12:19:17.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8af400640 1 -- 172.21.15.38:0/823975238 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8a8005500 con 0x7ff8b8076ba0 2024-09-12T12:19:17.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8af400640 1 -- 172.21.15.38:0/823975238 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8010690 con 0x7ff8b8076ba0 2024-09-12T12:19:17.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.533+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b81a66e0 con 0x7ff8b8076ba0 2024-09-12T12:19:17.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.534+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b81105d0 con 0x7ff8b8076ba0 2024-09-12T12:19:17.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.536+0000 7ff8af400640 1 -- 172.21.15.38:0/823975238 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff8a80046c0 con 0x7ff8b8076ba0 2024-09-12T12:19:17.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.537+0000 7ff8af400640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff89c0a2bb0 0x7ff89c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:17.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.538+0000 7ff8af400640 1 -- 172.21.15.38:0/823975238 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7ff8a80ce750 con 0x7ff8b8076ba0 2024-09-12T12:19:17.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.538+0000 7ff8b5e00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff89c0a2bb0 0x7ff89c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:17.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.538+0000 7ff8b5e00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff89c0a2bb0 0x7ff89c0a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8b819f7f0 tx=0x7ff8a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:17.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.542+0000 7ff8af400640 1 -- 172.21.15.38:0/823975238 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8a809c4b0 con 0x7ff8b8076ba0 2024-09-12T12:19:17.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:17.735+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff8b8062630 con 0x7ff89c0a2bb0 2024-09-12T12:19:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:19:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:19:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] boot 2024-09-12T12:19:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:19:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:18.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:18.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:17 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:18.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:19:18.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:19:18.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:18.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] boot 2024-09-12T12:19:18.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:19:18.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:18.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:18.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:18.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:17 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: osd.5 [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] boot 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:18.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:17 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:18.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:18 smithi038 ceph-mon[30810]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:18.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:18 smithi038 ceph-mon[30810]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T12:19:19.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:18 smithi071 ceph-mon[34859]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:19.128 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:18 smithi071 ceph-mon[34859]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T12:19:19.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:18 smithi154 ceph-mon[35578]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:19.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:18 smithi154 ceph-mon[35578]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T12:19:19.814 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:19 smithi038 ceph-mon[30810]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:19.814 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:19 smithi038 ceph-mon[30810]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T12:19:20.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:19 smithi154 ceph-mon[35578]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:20.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:19 smithi154 ceph-mon[35578]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T12:19:20.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:19 smithi071 ceph-mon[34859]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:20.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:19 smithi071 ceph-mon[34859]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T12:19:21.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:20 smithi154 ceph-mon[35578]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T12:19:21.171 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:20 smithi038 ceph-mon[30810]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T12:19:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:20 smithi071 ceph-mon[34859]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T12:19:21.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:21 smithi038 ceph-mon[30810]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:21.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:21 smithi038 ceph-mon[30810]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T12:19:21.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:21 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2207553430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61f54b73-d6fd-452a-b38f-0968bd646803"}]: dispatch 2024-09-12T12:19:21.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:21 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2207553430' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61f54b73-d6fd-452a-b38f-0968bd646803"}]': finished 2024-09-12T12:19:21.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:21 smithi038 ceph-mon[30810]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T12:19:21.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:21.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:21 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3382309870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:21 smithi154 ceph-mon[35578]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:21 smithi154 ceph-mon[35578]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T12:19:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:21 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2207553430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61f54b73-d6fd-452a-b38f-0968bd646803"}]: dispatch 2024-09-12T12:19:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:21 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2207553430' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61f54b73-d6fd-452a-b38f-0968bd646803"}]': finished 2024-09-12T12:19:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:21 smithi154 ceph-mon[35578]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T12:19:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:21 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3382309870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:21 smithi071 ceph-mon[34859]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:21 smithi071 ceph-mon[34859]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T12:19:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2207553430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61f54b73-d6fd-452a-b38f-0968bd646803"}]: dispatch 2024-09-12T12:19:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2207553430' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61f54b73-d6fd-452a-b38f-0968bd646803"}]': finished 2024-09-12T12:19:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:21 smithi071 ceph-mon[34859]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T12:19:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:22.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3382309870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:24.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:23 smithi154 ceph-mon[35578]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:24.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:23 smithi038 ceph-mon[30810]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:24.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:23 smithi071 ceph-mon[34859]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:26.084 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:25 smithi038 ceph-mon[30810]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-12T12:19:26.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:25 smithi154 ceph-mon[35578]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-12T12:19:26.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:25 smithi071 ceph-mon[34859]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-12T12:19:27.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:27 smithi038 ceph-mon[30810]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T12:19:28.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:27 smithi154 ceph-mon[35578]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T12:19:28.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:27 smithi071 ceph-mon[34859]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T12:19:30.130 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:29 smithi038 ceph-mon[30810]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:19:30.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:29 smithi154 ceph-mon[35578]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:19:30.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:29 smithi071 ceph-mon[34859]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:19:31.058 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:19:31.059 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:31.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:19:31.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:31.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:19:31.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:32.046 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:31 smithi038 ceph-mon[30810]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T12:19:32.046 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:31 smithi038 ceph-mon[30810]: Deploying daemon osd.6 on smithi038 2024-09-12T12:19:32.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:31 smithi154 ceph-mon[35578]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T12:19:32.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:31 smithi154 ceph-mon[35578]: Deploying daemon osd.6 on smithi038 2024-09-12T12:19:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:31 smithi071 ceph-mon[34859]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T12:19:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:31 smithi071 ceph-mon[34859]: Deploying daemon osd.6 on smithi038 2024-09-12T12:19:33.948 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:33 smithi038 ceph-mon[30810]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T12:19:34.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:33 smithi154 ceph-mon[35578]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T12:19:34.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:33 smithi071 ceph-mon[34859]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T12:19:35.950 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:35 smithi038 ceph-mon[30810]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:19:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:35 smithi154 ceph-mon[35578]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:19:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:35 smithi071 ceph-mon[34859]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:19:38.121 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:37 smithi038 ceph-mon[30810]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:38.121 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:38.121 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:38.121 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:38.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:37 smithi154 ceph-mon[35578]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:37 smithi071 ceph-mon[34859]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:40.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:39 smithi154 ceph-mon[35578]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:40.198 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:39 smithi038 ceph-mon[30810]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:40.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:39 smithi071 ceph-mon[34859]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:41.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:41 smithi038 ceph-mon[30810]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:41.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:41.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:41.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:41.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:41.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:41 smithi071 ceph-mon[34859]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.139+0000 7ff8af400640 1 -- 172.21.15.38:0/823975238 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff8b8062630 con 0x7ff89c0a2bb0 2024-09-12T12:19:42.140 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 6 on host 'smithi038' 2024-09-12T12:19:42.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.141+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff89c0a2bb0 msgr2=0x7ff89c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:42.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.141+0000 7ff8bca00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff89c0a2bb0 0x7ff89c0a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8b819f7f0 tx=0x7ff8a4005f90 comp rx=0 tx=0).stop 2024-09-12T12:19:42.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.141+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 msgr2=0x7ff8b819e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:42.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.141+0000 7ff8bca00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 0x7ff8b819e2d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800e9f0 tx=0x7ff8a800edf0 comp rx=0 tx=0).stop 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 shutdown_connections 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff89c0a2bb0 0x7ff89c0a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b8078790 0x7ff8b81a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b8077df0 0x7ff8b819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 --2- 172.21.15.38:0/823975238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b8076ba0 0x7ff8b819e2d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 >> 172.21.15.38:0/823975238 conn(0x7ff8b80ff3e0 msgr2=0x7ff8b8100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 shutdown_connections 2024-09-12T12:19:42.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:19:42.142+0000 7ff8bca00640 1 -- 172.21.15.38:0/823975238 wait complete. 2024-09-12T12:19:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:41 smithi154 ceph-mon[35578]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.966 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:42 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:42.966 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:42 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:42.967 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:42 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:43.003 DEBUG:teuthology.orchestra.run.smithi038:osd.6> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T12:19:43.007 INFO:tasks.cephadm:Deploying osd.7 on smithi071 with /dev/vg_nvme/lv_2... 2024-09-12T12:19:43.007 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:19:43.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:42 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:43.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:42 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:43.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:42 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:42 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:42 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:43.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:42 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:19:43.469 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:19:43 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:19:43.464+0000 7f402d233640 -1 osd.6 0 log_to_monitors true 2024-09-12T12:19:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:43 smithi038 ceph-mon[30810]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:43 smithi038 ceph-mon[30810]: from='osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:19:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:43 smithi038 ceph-mon[30810]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:19:44.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:43 smithi071 ceph-mon[34859]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:44.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:43 smithi071 ceph-mon[34859]: from='osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:19:44.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:43 smithi071 ceph-mon[34859]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:19:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:43 smithi154 ceph-mon[35578]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:43 smithi154 ceph-mon[35578]: from='osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:19:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:43 smithi154 ceph-mon[35578]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:19:44.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:44 smithi071 ceph-mon[34859]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:19:44.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:44 smithi071 ceph-mon[34859]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T12:19:44.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:44 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:44.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:44 smithi071 ceph-mon[34859]: from='osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:19:44.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:44 smithi071 ceph-mon[34859]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:19:44.887 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:44 smithi038 ceph-mon[30810]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:19:44.888 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:44 smithi038 ceph-mon[30810]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T12:19:44.888 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:44 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:44.888 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:44 smithi038 ceph-mon[30810]: from='osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:19:44.888 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:44 smithi038 ceph-mon[30810]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:19:45.068 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:44 smithi154 ceph-mon[35578]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:19:45.068 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:44 smithi154 ceph-mon[35578]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T12:19:45.068 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:44 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:45.068 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:44 smithi154 ceph-mon[35578]: from='osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:19:45.068 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:44 smithi154 ceph-mon[35578]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:19:45.804 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-mon[30810]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:45.804 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-mon[30810]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:19:45.804 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-mon[30810]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T12:19:45.804 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:45.804 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:45.804 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-mon[30810]: from='osd.6 ' entity='osd.6' 2024-09-12T12:19:45.805 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:19:45.538+0000 7f4028400640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T12:19:45.805 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:19:45 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:19:45.561+0000 7f401da00640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:19:45.903 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:45 smithi071 ceph-mon[34859]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:45.904 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:45 smithi071 ceph-mon[34859]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:19:45.904 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:45 smithi071 ceph-mon[34859]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T12:19:45.904 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:45.904 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:45.904 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:45 smithi071 ceph-mon[34859]: from='osd.6 ' entity='osd.6' 2024-09-12T12:19:45.906 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:19:45.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-09-12T12:19:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:45 smithi154 ceph-mon[35578]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:45 smithi154 ceph-mon[35578]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:19:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:45 smithi154 ceph-mon[35578]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T12:19:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:45 smithi154 ceph-mon[35578]: from='osd.6 ' entity='osd.6' 2024-09-12T12:19:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:19:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 -- 172.21.15.71:0/2692069927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 msgr2=0x7f9e881018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/2692069927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e881018f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009900 tx=0x7f9e7002a410 comp rx=0 tx=0).stop 2024-09-12T12:19:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 -- 172.21.15.71:0/2692069927 shutdown_connections 2024-09-12T12:19:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/2692069927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88101e30 0x7f9e881086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/2692069927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e881018f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/2692069927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e88100270 0x7f9e88100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 -- 172.21.15.71:0/2692069927 >> 172.21.15.71:0/2692069927 conn(0x7f9e880fba40 msgr2=0x7f9e880fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 -- 172.21.15.71:0/2692069927 shutdown_connections 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.766+0000 7f9e8db7b640 1 -- 172.21.15.71:0/2692069927 wait complete. 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 Processor -- start 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 -- start start 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88100270 0x7f9e88197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e88198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e88101e30 0x7f9e8819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810bf10 con 0x7f9e88101e30 2024-09-12T12:19:46.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810bd90 con 0x7f9e88101470 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e8db7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810c090 con 0x7f9e88100270 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e7ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e88198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e7ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e88198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38430/0 (socket says 172.21.15.71:38430) 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e7ffff640 1 -- 172.21.15.71:0/109916673 learned_addr learned my addr 172.21.15.71:0/109916673 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e87fff640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e88101e30 0x7f9e8819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e877fe640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88100270 0x7f9e88197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e7ffff640 1 -- 172.21.15.71:0/109916673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88100270 msgr2=0x7f9e88197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e7ffff640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88100270 0x7f9e88197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.767+0000 7f9e7ffff640 1 -- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e88101e30 msgr2=0x7f9e8819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e7ffff640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e88101e30 0x7f9e8819f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e7ffff640 1 -- 172.21.15.71:0/109916673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8819fa80 con 0x7f9e88101470 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e87fff640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e88101e30 0x7f9e8819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:46.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e877fe640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88100270 0x7f9e88197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e7ffff640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e88198390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009230 tx=0x7f9e70004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e857fa640 1 -- 172.21.15.71:0/109916673 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7003f030 con 0x7f9e88101470 2024-09-12T12:19:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e857fa640 1 -- 172.21.15.71:0/109916673 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70003ce0 con 0x7f9e88101470 2024-09-12T12:19:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8819fd10 con 0x7f9e88101470 2024-09-12T12:19:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e857fa640 1 -- 172.21.15.71:0/109916673 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70035070 con 0x7f9e88101470 2024-09-12T12:19:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.768+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881a01a0 con 0x7f9e88101470 2024-09-12T12:19:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.769+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e881a0490 con 0x7f9e88101470 2024-09-12T12:19:46.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.770+0000 7f9e857fa640 1 -- 172.21.15.71:0/109916673 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9e70042030 con 0x7f9e88101470 2024-09-12T12:19:46.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.771+0000 7f9e857fa640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9e740a2bb0 0x7f9e740a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:46.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.771+0000 7f9e857fa640 1 -- 172.21.15.71:0/109916673 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f9e700eeb10 con 0x7f9e88101470 2024-09-12T12:19:46.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.771+0000 7f9e877fe640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9e740a2bb0 0x7f9e740a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:46.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.772+0000 7f9e877fe640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9e740a2bb0 0x7f9e740a5070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e881012d0 tx=0x7f9e78005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:46.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.775+0000 7f9e857fa640 1 -- 172.21.15.71:0/109916673 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e700bc780 con 0x7f9e88101470 2024-09-12T12:19:46.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:19:46.951+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9e881078c0 con 0x7f9e740a2bb0 2024-09-12T12:19:46.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:46 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:19:46.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:46 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:19:46.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:46 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:46.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:46 smithi071 ceph-mon[34859]: osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] boot 2024-09-12T12:19:46.953 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:46 smithi071 ceph-mon[34859]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T12:19:46.954 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:46 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:46.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:46 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:19:46.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:46 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:19:46.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:46 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:46.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:46 smithi038 ceph-mon[30810]: osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] boot 2024-09-12T12:19:46.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:46 smithi038 ceph-mon[30810]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T12:19:46.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:46 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:47.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:46 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:19:47.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:46 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:19:47.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:46 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:47.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:46 smithi154 ceph-mon[35578]: osd.6 [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] boot 2024-09-12T12:19:47.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:46 smithi154 ceph-mon[35578]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T12:19:47.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:46 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:19:48.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:48.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:48.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:48.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:48.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:48.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:48.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:19:48.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:48.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:48.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:19:48.984 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:48 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi038 2024-09-12T12:19:48.984 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:48 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi038 to 5698M 2024-09-12T12:19:48.984 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:48 smithi071 ceph-mon[34859]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T12:19:49.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:48 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi038 2024-09-12T12:19:49.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:48 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi038 to 5698M 2024-09-12T12:19:49.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:48 smithi154 ceph-mon[35578]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T12:19:49.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:48 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi038 2024-09-12T12:19:49.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:48 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi038 to 5698M 2024-09-12T12:19:49.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:48 smithi038 ceph-mon[30810]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T12:19:49.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:49 smithi071 ceph-mon[34859]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:49.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:49 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/1107968610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]: dispatch 2024-09-12T12:19:49.877 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:49 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]: dispatch 2024-09-12T12:19:49.878 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:49 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]': finished 2024-09-12T12:19:49.878 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:49 smithi071 ceph-mon[34859]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T12:19:49.878 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:19:50.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:49 smithi154 ceph-mon[35578]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:50.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:49 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/1107968610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]: dispatch 2024-09-12T12:19:50.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:49 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]: dispatch 2024-09-12T12:19:50.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:49 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]': finished 2024-09-12T12:19:50.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:49 smithi154 ceph-mon[35578]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T12:19:50.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:19:50.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:49 smithi038 ceph-mon[30810]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:50.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:49 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/1107968610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]: dispatch 2024-09-12T12:19:50.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:49 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]: dispatch 2024-09-12T12:19:50.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:49 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b272e86-3a25-40df-b8f4-1f41cb6a4bf7"}]': finished 2024-09-12T12:19:50.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:49 smithi038 ceph-mon[30810]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T12:19:50.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:19:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:50 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/240593033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:51.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:50 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/240593033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:51.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:50 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/240593033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:51 smithi071 ceph-mon[34859]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:52.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:51 smithi154 ceph-mon[35578]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:52.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:51 smithi038 ceph-mon[30810]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:53 smithi071 ceph-mon[34859]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:54.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:53 smithi154 ceph-mon[35578]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:54.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:53 smithi038 ceph-mon[30810]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:55.931 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:55 smithi071 ceph-mon[34859]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:56.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:55 smithi154 ceph-mon[35578]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:56.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:55 smithi038 ceph-mon[30810]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:58.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:57 smithi071 ceph-mon[34859]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:58.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:57 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:19:58.040 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:57 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:58.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:57 smithi038 ceph-mon[30810]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:58.125 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:19:58.126 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:57 smithi154 ceph-mon[35578]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:19:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:57 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:19:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:57 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:58.890 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:58 smithi071 ceph-mon[34859]: Deploying daemon osd.7 on smithi071 2024-09-12T12:19:59.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:58 smithi154 ceph-mon[35578]: Deploying daemon osd.7 on smithi071 2024-09-12T12:19:59.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:58 smithi038 ceph-mon[30810]: Deploying daemon osd.7 on smithi071 2024-09-12T12:20:00.074 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:19:59 smithi071 ceph-mon[34859]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:00.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:19:59 smithi154 ceph-mon[35578]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:00.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:19:59 smithi038 ceph-mon[30810]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:01.037 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:00 smithi071 ceph-mon[34859]: overall HEALTH_OK 2024-09-12T12:20:01.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:00 smithi154 ceph-mon[35578]: overall HEALTH_OK 2024-09-12T12:20:01.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:00 smithi038 ceph-mon[30810]: overall HEALTH_OK 2024-09-12T12:20:02.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:01 smithi154 ceph-mon[35578]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:02.189 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:01 smithi071 ceph-mon[34859]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:01 smithi038 ceph-mon[30810]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:04.091 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:03 smithi071 ceph-mon[34859]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:04.091 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:04.091 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:04.091 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:04.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:03 smithi154 ceph-mon[35578]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:03 smithi038 ceph-mon[30810]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:05.887 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:05 smithi071 ceph-mon[34859]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:06.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:05 smithi154 ceph-mon[35578]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:05 smithi038 ceph-mon[30810]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:07.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.099+0000 7f9e857fa640 1 -- 172.21.15.71:0/109916673 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9e881078c0 con 0x7f9e740a2bb0 2024-09-12T12:20:07.100 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 7 on host 'smithi071' 2024-09-12T12:20:07.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9e740a2bb0 msgr2=0x7f9e740a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9e740a2bb0 0x7f9e740a5070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e881012d0 tx=0x7f9e78005d30 comp rx=0 tx=0).stop 2024-09-12T12:20:07.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 msgr2=0x7f9e88198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e88198390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009230 tx=0x7f9e70004430 comp rx=0 tx=0).stop 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 shutdown_connections 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9e740a2bb0 0x7f9e740a5070 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e88101e30 0x7f9e8819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e88101470 0x7f9e88198390 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 --2- 172.21.15.71:0/109916673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88100270 0x7f9e88197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 >> 172.21.15.71:0/109916673 conn(0x7f9e880fba40 msgr2=0x7f9e880fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 shutdown_connections 2024-09-12T12:20:07.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:20:07.101+0000 7f9e8db7b640 1 -- 172.21.15.71:0/109916673 wait complete. 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.420 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:07.420 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.420 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.420 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:07.420 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:07.420 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.420 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:07.421 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.421 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:07.730 DEBUG:teuthology.orchestra.run.smithi071:osd.7> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T12:20:07.733 INFO:tasks.cephadm:Deploying osd.8 on smithi154 with /dev/vg_nvme/lv_2... 2024-09-12T12:20:07.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:20:07.991 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:20:09.342 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:09 smithi154 ceph-mon[35578]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:09.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:09 smithi038 ceph-mon[30810]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:09.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:09 smithi071 ceph-mon[34859]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:09.515 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:20:09 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:20:09.229+0000 7fe69af25640 -1 osd.7 0 log_to_monitors true 2024-09-12T12:20:10.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:10 smithi071 ceph-mon[34859]: from='osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:20:10.262 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:10 smithi071 ceph-mon[34859]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:20:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:10 smithi154 ceph-mon[35578]: from='osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:20:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:10 smithi154 ceph-mon[35578]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:20:10.456 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:20:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:10 smithi038 ceph-mon[30810]: from='osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:20:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:10 smithi038 ceph-mon[30810]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:20:10.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-09-12T12:20:10.735 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:20:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.191+0000 7fc16dde0640 1 -- 172.21.15.154:0/2994626802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168101cd0 msgr2=0x7fc168102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.191+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2994626802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168101cd0 0x7fc168102150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009900 tx=0x7fc15c02a410 comp rx=0 tx=0).stop 2024-09-12T12:20:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.191+0000 7fc16dde0640 1 -- 172.21.15.154:0/2994626802 shutdown_connections 2024-09-12T12:20:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.191+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2994626802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc168102690 0x7fc168108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.191+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2994626802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168101cd0 0x7fc168102150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.191+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2994626802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 0x7fc168100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.191+0000 7fc16dde0640 1 -- 172.21.15.154:0/2994626802 >> 172.21.15.154:0/2994626802 conn(0x7fc1680fc280 msgr2=0x7fc1680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.192+0000 7fc16dde0640 1 -- 172.21.15.154:0/2994626802 shutdown_connections 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.192+0000 7fc16dde0640 1 -- 172.21.15.154:0/2994626802 wait complete. 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.192+0000 7fc16dde0640 1 Processor -- start 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.192+0000 7fc16dde0640 1 -- start start 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.192+0000 7fc16dde0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 0x7fc168196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.192+0000 7fc16dde0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc168101cd0 0x7fc1681972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc16dde0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168102690 0x7fc16819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc16dde0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc16810c750 con 0x7fc168101cd0 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc16dde0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc16810c5d0 con 0x7fc168100ad0 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc16dde0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc16810c8d0 con 0x7fc168102690 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc1677fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 0x7fc168196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc167fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168102690 0x7fc16819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc1677fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 0x7fc168196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.154:53886/0 (socket says 172.21.15.154:53886) 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc1677fe640 1 -- 172.21.15.154:0/2196959000 learned_addr learned my addr 172.21.15.154:0/2196959000 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc166ffd640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc168101cd0 0x7fc1681972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc167fff640 1 -- 172.21.15.154:0/2196959000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 msgr2=0x7fc168196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc167fff640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 0x7fc168196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc167fff640 1 -- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc168101cd0 msgr2=0x7fc1681972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc167fff640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc168101cd0 0x7fc1681972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc167fff640 1 -- 172.21.15.154:0/2196959000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16819e9e0 con 0x7fc168102690 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc1677fe640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 0x7fc168196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc166ffd640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc168101cd0 0x7fc1681972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc167fff640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168102690 0x7fc16819e370 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e940 tx=0x7fc16000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc164ff9640 1 -- 172.21.15.154:0/2196959000 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160004d20 con 0x7fc168102690 2024-09-12T12:20:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16819ecd0 con 0x7fc168102690 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.193+0000 7fc164ff9640 1 -- 172.21.15.154:0/2196959000 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc160005020 con 0x7fc168102690 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.194+0000 7fc164ff9640 1 -- 172.21.15.154:0/2196959000 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1600116b0 con 0x7fc168102690 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.194+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16819f190 con 0x7fc168102690 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.194+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc168107ec0 con 0x7fc168102690 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.196+0000 7fc164ff9640 1 -- 172.21.15.154:0/2196959000 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc1600054d0 con 0x7fc168102690 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.196+0000 7fc164ff9640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc1500a2bb0 0x7fc1500a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.197+0000 7fc164ff9640 1 -- 172.21.15.154:0/2196959000 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7fc1600ce8a0 con 0x7fc168102690 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.197+0000 7fc1677fe640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc1500a2bb0 0x7fc1500a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.198+0000 7fc1677fe640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc1500a2bb0 0x7fc1500a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1580058c0 tx=0x7fc158005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:11.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.204+0000 7fc164ff9640 1 -- 172.21.15.154:0/2196959000 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc160016030 con 0x7fc168102690 2024-09-12T12:20:11.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:11.387+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc168062630 con 0x7fc1500a2bb0 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi071 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.390 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-12T12:20:11.390 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.390 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:11.390 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:11.390 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:11.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:20:11.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:20:11.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T12:20:11.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi071 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:11.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:20:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:20:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T12:20:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:20:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi071 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:11.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:12.190 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:20:11.838+0000 7fe6976bc640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T12:20:12.190 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:20:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:20:11.850+0000 7fe68ecc8640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:20:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:20:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T12:20:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:12.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:12.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='osd.7 ' entity='osd.7' 2024-09-12T12:20:12.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] boot 2024-09-12T12:20:12.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T12:20:12.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:20:12.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='osd.7 ' entity='osd.7' 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] boot 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T12:20:12.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:20:12.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T12:20:12.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='osd.7 ' entity='osd.7' 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: osd.7 [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] boot 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T12:20:12.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:13.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:13 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:20:13.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:13 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:20:13.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:13 smithi154 ceph-mon[35578]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:13.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:13 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:20:13.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:13 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:20:13.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:13 smithi038 ceph-mon[30810]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:13.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:13 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:20:13.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:13 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:20:13.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:13 smithi071 ceph-mon[34859]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:14.397 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:14 smithi154 ceph-mon[35578]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T12:20:14.397 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:14 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/850832070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]: dispatch 2024-09-12T12:20:14.397 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:14 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]: dispatch 2024-09-12T12:20:14.397 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:14 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]': finished 2024-09-12T12:20:14.397 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:14 smithi154 ceph-mon[35578]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:20:14.397 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:14 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:14 smithi038 ceph-mon[30810]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T12:20:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:14 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/850832070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]: dispatch 2024-09-12T12:20:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:14 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]: dispatch 2024-09-12T12:20:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:14 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]': finished 2024-09-12T12:20:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:14 smithi038 ceph-mon[30810]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:20:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:14 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:14 smithi071 ceph-mon[34859]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T12:20:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:14 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/850832070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]: dispatch 2024-09-12T12:20:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:14 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]: dispatch 2024-09-12T12:20:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:14 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7556a43c-35d1-4404-8ff1-3e12d177d45b"}]': finished 2024-09-12T12:20:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:14 smithi071 ceph-mon[34859]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:20:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:14 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:15.479 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:15 smithi038 ceph-mon[30810]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:15.479 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:15 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/3667364501' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:15.479 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:15 smithi038 ceph-mon[30810]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T12:20:15.479 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:15.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:15 smithi071 ceph-mon[34859]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:15.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:15 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/3667364501' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:15.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:15 smithi071 ceph-mon[34859]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T12:20:15.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:15.585 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:15 smithi154 ceph-mon[35578]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:15.586 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:15 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/3667364501' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:15.586 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:15 smithi154 ceph-mon[35578]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T12:20:15.586 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:17.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:16 smithi154 ceph-mon[35578]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T12:20:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:17.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:16 smithi038 ceph-mon[30810]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T12:20:17.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:17.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:16 smithi071 ceph-mon[34859]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T12:20:17.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:18.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:17 smithi154 ceph-mon[35578]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:18.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:17 smithi154 ceph-mon[35578]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T12:20:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:17 smithi038 ceph-mon[30810]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:18.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:17 smithi038 ceph-mon[30810]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T12:20:18.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:17 smithi071 ceph-mon[34859]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:18.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:17 smithi071 ceph-mon[34859]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T12:20:19.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:18 smithi154 ceph-mon[35578]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T12:20:19.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:18 smithi154 ceph-mon[35578]: Cluster is now healthy 2024-09-12T12:20:19.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:18 smithi038 ceph-mon[30810]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T12:20:19.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:18 smithi038 ceph-mon[30810]: Cluster is now healthy 2024-09-12T12:20:19.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:18 smithi071 ceph-mon[34859]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T12:20:19.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:18 smithi071 ceph-mon[34859]: Cluster is now healthy 2024-09-12T12:20:20.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:19 smithi154 ceph-mon[35578]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:20.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:19 smithi038 ceph-mon[30810]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:20.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:19 smithi071 ceph-mon[34859]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:21 smithi154 ceph-mon[35578]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:20:22.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:21 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:22.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:21 smithi038 ceph-mon[30810]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:22.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:20:22.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:21 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:21 smithi071 ceph-mon[34859]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:20:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:21 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:22.944 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:22 smithi154 ceph-mon[35578]: Deploying daemon osd.8 on smithi154 2024-09-12T12:20:23.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:22 smithi038 ceph-mon[30810]: Deploying daemon osd.8 on smithi154 2024-09-12T12:20:23.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:22 smithi071 ceph-mon[34859]: Deploying daemon osd.8 on smithi154 2024-09-12T12:20:24.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:23 smithi038 ceph-mon[30810]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:24.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:23 smithi071 ceph-mon[34859]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:24.288 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:23 smithi154 ceph-mon[35578]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:26.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:25 smithi038 ceph-mon[30810]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:26.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:25 smithi071 ceph-mon[34859]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:26.401 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:25 smithi154 ceph-mon[35578]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:28.201 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:27 smithi154 ceph-mon[35578]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:28.202 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:28.202 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:28.202 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:28.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:27 smithi038 ceph-mon[30810]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:28.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:28.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:28.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:28.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:27 smithi071 ceph-mon[34859]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:28.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:28.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:28.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:30.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:29 smithi038 ceph-mon[30810]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:30.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:29 smithi154 ceph-mon[35578]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:30.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:29 smithi071 ceph-mon[34859]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:31.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.538+0000 7fc164ff9640 1 -- 172.21.15.154:0/2196959000 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc168062630 con 0x7fc1500a2bb0 2024-09-12T12:20:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 8 on host 'smithi154' 2024-09-12T12:20:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc1500a2bb0 msgr2=0x7fc1500a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc1500a2bb0 0x7fc1500a5070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1580058c0 tx=0x7fc158005f90 comp rx=0 tx=0).stop 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168102690 msgr2=0x7fc16819e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168102690 0x7fc16819e370 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e940 tx=0x7fc16000ee00 comp rx=0 tx=0).stop 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 shutdown_connections 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc1500a2bb0 0x7fc1500a5070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc168102690 0x7fc16819e370 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc168101cd0 0x7fc1681972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 --2- 172.21.15.154:0/2196959000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc168100ad0 0x7fc168196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 >> 172.21.15.154:0/2196959000 conn(0x7fc1680fc280 msgr2=0x7fc168105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 shutdown_connections 2024-09-12T12:20:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:20:31.540+0000 7fc16dde0640 1 -- 172.21.15.154:0/2196959000 wait complete. 2024-09-12T12:20:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:31 smithi071 ceph-mon[34859]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.915 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:31 smithi154 ceph-mon[35578]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:31.915 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.915 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:31.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:31.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:31 smithi038 ceph-mon[30810]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:32.243 DEBUG:teuthology.orchestra.run.smithi154:osd.8> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T12:20:32.245 INFO:tasks.cephadm:Deploying osd.9 on smithi038 with /dev/vg_nvme/lv_1... 2024-09-12T12:20:32.245 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:20:32.629 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:20:32.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:32 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:32.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:32 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:32.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:32 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:32.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:32 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:32.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:32 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:32.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:32 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:32.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:32 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:32.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:32 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:32.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:32 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:33.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:33 smithi154 ceph-mon[35578]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:33.821 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:33 smithi038 ceph-mon[30810]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:33 smithi071 ceph-mon[34859]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:34.167 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:20:33 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:20:33.728+0000 7f796e9cb640 -1 osd.8 0 log_to_monitors true 2024-09-12T12:20:34.578 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:34 smithi038 ceph-mon[30810]: from='osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:20:34.578 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:34 smithi038 ceph-mon[30810]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:20:34.805 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:34 smithi154 ceph-mon[35578]: from='osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:20:34.806 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:34 smithi154 ceph-mon[35578]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:20:35.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:34 smithi071 ceph-mon[34859]: from='osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:20:35.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:34 smithi071 ceph-mon[34859]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:35.870 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:35.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:35.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:35.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:35.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:35.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:35.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:35.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:20:35.561+0000 7f796a94e640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T12:20:35.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:20:35.588+0000 7f7966776640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:20:35.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:35.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:20:35.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:20:35.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T12:20:35.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:35.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:35.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:20:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:20:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T12:20:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:36.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:36.044 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:20:36.076 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_1 2024-09-12T12:20:36.467 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:20:36.815 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi154 2024-09-12T12:20:36.815 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-12T12:20:36.816 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:20:36.816 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T12:20:36.816 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:36.816 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T12:20:36.816 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:36.816 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:36 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi154 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:36.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:36 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi154 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:36 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 -- 172.21.15.38:0/1366218323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0103e00 msgr2=0x7f35a0104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 --2- 172.21.15.38:0/1366218323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0103e00 0x7f35a0104200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3594009900 tx=0x7f359402a410 comp rx=0 tx=0).stop 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 -- 172.21.15.38:0/1366218323 shutdown_connections 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 --2- 172.21.15.38:0/1366218323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a0105920 0x7f35a010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 --2- 172.21.15.38:0/1366218323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0104f60 0x7f35a01053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 --2- 172.21.15.38:0/1366218323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0103e00 0x7f35a0104200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 -- 172.21.15.38:0/1366218323 >> 172.21.15.38:0/1366218323 conn(0x7f35a00ff5b0 msgr2=0x7f35a01019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 -- 172.21.15.38:0/1366218323 shutdown_connections 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.072+0000 7f35a7c00640 1 -- 172.21.15.38:0/1366218323 wait complete. 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.073+0000 7f35a7c00640 1 Processor -- start 2024-09-12T12:20:37.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.073+0000 7f35a7c00640 1 -- start start 2024-09-12T12:20:37.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a7c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0103e00 0x7f35a019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a7c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0104f60 0x7f35a019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a7c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a0105920 0x7f35a01a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a7c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f35a010fab0 con 0x7f35a0104f60 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a7c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35a010f930 con 0x7f35a0103e00 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a7c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35a010fc30 con 0x7f35a0105920 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0104f60 0x7f35a019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a5200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0103e00 0x7f35a019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0104f60 0x7f35a019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54302/0 (socket says 172.21.15.38:54302) 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 -- 172.21.15.38:0/3447873139 learned_addr learned my addr 172.21.15.38:0/3447873139 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f35a5c00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a0105920 0x7f35a01a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:37.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 -- 172.21.15.38:0/3447873139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a0105920 msgr2=0x7f35a01a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a0105920 0x7f35a01a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 -- 172.21.15.38:0/3447873139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0103e00 msgr2=0x7f35a019a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0103e00 0x7f35a019a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.074+0000 7f359fe00640 1 -- 172.21.15.38:0/3447873139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a01a1cd0 con 0x7f35a0104f60 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.075+0000 7f359fe00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0104f60 0x7f35a019a5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e9c0 tx=0x7f358c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.075+0000 7f359d600640 1 -- 172.21.15.38:0/3447873139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c00cde0 con 0x7f35a0104f60 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.075+0000 7f359d600640 1 -- 172.21.15.38:0/3447873139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f358c010910 con 0x7f35a0104f60 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.075+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a01a1fc0 con 0x7f35a0104f60 2024-09-12T12:20:37.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.075+0000 7f359d600640 1 -- 172.21.15.38:0/3447873139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c018a00 con 0x7f35a0104f60 2024-09-12T12:20:37.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.076+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a01a2470 con 0x7f35a0104f60 2024-09-12T12:20:37.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.077+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a010b1a0 con 0x7f35a0104f60 2024-09-12T12:20:37.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.078+0000 7f359d600640 1 -- 172.21.15.38:0/3447873139 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f358c01f020 con 0x7f35a0104f60 2024-09-12T12:20:37.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.080+0000 7f359d600640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f35880a2bb0 0x7f35880a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:37.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.081+0000 7f359d600640 1 -- 172.21.15.38:0/3447873139 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5862+0+0 (secure 0 0 0) 0x7f358c0ce800 con 0x7f35a0104f60 2024-09-12T12:20:37.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.081+0000 7f35a5200640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f35880a2bb0 0x7f35880a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:37.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.081+0000 7f35a5200640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f35880a2bb0 0x7f35880a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35940314e0 tx=0x7f3594000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:37.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.085+0000 7f359d600640 1 -- 172.21.15.38:0/3447873139 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f358c09c0f0 con 0x7f35a0104f60 2024-09-12T12:20:37.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:20:37.278+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f35a0062630 con 0x7f35880a2bb0 2024-09-12T12:20:37.875 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:20:37.875 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:20:37.875 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:37.875 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.875 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] boot 2024-09-12T12:20:37.875 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T12:20:37.876 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.876 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:37.876 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:37.876 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] boot 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:20:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:20:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:20:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: osd.8 [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] boot 2024-09-12T12:20:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T12:20:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:20:38.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:38.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:38.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:38.902 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:38 smithi038 ceph-mon[30810]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:38.902 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:38 smithi038 ceph-mon[30810]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T12:20:38.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:38 smithi154 ceph-mon[35578]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:38.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:38 smithi154 ceph-mon[35578]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T12:20:39.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:38 smithi071 ceph-mon[34859]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:39.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:38 smithi071 ceph-mon[34859]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T12:20:39.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:39 smithi154 ceph-mon[35578]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:39.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:39 smithi154 ceph-mon[35578]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T12:20:39.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:39 smithi038 ceph-mon[30810]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:39.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:39 smithi038 ceph-mon[30810]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T12:20:40.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:39 smithi071 ceph-mon[34859]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:40.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:39 smithi071 ceph-mon[34859]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T12:20:40.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:40 smithi154 ceph-mon[35578]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T12:20:40.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:40 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3325444961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "193a9b75-c4f8-4a7f-b8a3-9b1566e43f00"}]: dispatch 2024-09-12T12:20:40.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:40 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3325444961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "193a9b75-c4f8-4a7f-b8a3-9b1566e43f00"}]': finished 2024-09-12T12:20:40.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:40 smithi154 ceph-mon[35578]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T12:20:40.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:40 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:20:40.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:40 smithi038 ceph-mon[30810]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T12:20:40.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:40 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3325444961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "193a9b75-c4f8-4a7f-b8a3-9b1566e43f00"}]: dispatch 2024-09-12T12:20:40.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:40 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3325444961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "193a9b75-c4f8-4a7f-b8a3-9b1566e43f00"}]': finished 2024-09-12T12:20:40.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:40 smithi038 ceph-mon[30810]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T12:20:40.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:40 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:20:41.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:40 smithi071 ceph-mon[34859]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T12:20:41.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:40 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3325444961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "193a9b75-c4f8-4a7f-b8a3-9b1566e43f00"}]: dispatch 2024-09-12T12:20:41.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:40 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3325444961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "193a9b75-c4f8-4a7f-b8a3-9b1566e43f00"}]': finished 2024-09-12T12:20:41.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:40 smithi071 ceph-mon[34859]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T12:20:41.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:40 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:20:41.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:41 smithi154 ceph-mon[35578]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:41 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2111880471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:41.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:41 smithi038 ceph-mon[30810]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:41.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:41 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2111880471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:41 smithi071 ceph-mon[34859]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:41 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2111880471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:43 smithi154 ceph-mon[35578]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:43 smithi038 ceph-mon[30810]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:44.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:43 smithi071 ceph-mon[34859]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:45 smithi038 ceph-mon[30810]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:20:45.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:45 smithi154 ceph-mon[35578]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:20:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:45 smithi071 ceph-mon[34859]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:20:47.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:47 smithi154 ceph-mon[35578]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:20:47.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:47 smithi038 ceph-mon[30810]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:20:48.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:47 smithi071 ceph-mon[34859]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:20:49.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:49 smithi154 ceph-mon[35578]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T12:20:49.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:49 smithi038 ceph-mon[30810]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T12:20:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:49 smithi071 ceph-mon[34859]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T12:20:50.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:20:50.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:50.943 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:20:50.944 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:20:51.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:51.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:51 smithi154 ceph-mon[35578]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:20:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:51 smithi154 ceph-mon[35578]: Deploying daemon osd.9 on smithi038 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:51 smithi038 ceph-mon[30810]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:51 smithi038 ceph-mon[30810]: Deploying daemon osd.9 on smithi038 2024-09-12T12:20:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:51 smithi071 ceph-mon[34859]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:20:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:51 smithi071 ceph-mon[34859]: Deploying daemon osd.9 on smithi038 2024-09-12T12:20:53.844 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:53 smithi038 ceph-mon[30810]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T12:20:53.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:53 smithi154 ceph-mon[35578]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T12:20:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:53 smithi071 ceph-mon[34859]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T12:20:55.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:55 smithi038 ceph-mon[30810]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:20:56.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:55 smithi071 ceph-mon[34859]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:20:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:55 smithi154 ceph-mon[35578]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:20:57.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:57 smithi154 ceph-mon[35578]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:57.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:57 smithi038 ceph-mon[30810]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:57 smithi071 ceph-mon[34859]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:20:58.968 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:58 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:58.968 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:58 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:58.968 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:58 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:59.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:58 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:59.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:58 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:59.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:58 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:59.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:58 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:59.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:58 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:59.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:58 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:20:59.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:20:59 smithi038 ceph-mon[30810]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:00.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:20:59 smithi071 ceph-mon[34859]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:00.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:20:59 smithi154 ceph-mon[35578]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.989+0000 7f359d600640 1 -- 172.21.15.38:0/3447873139 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f35a0062630 con 0x7f35880a2bb0 2024-09-12T12:21:01.990 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 9 on host 'smithi038' 2024-09-12T12:21:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f35880a2bb0 msgr2=0x7f35880a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f35880a2bb0 0x7f35880a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35940314e0 tx=0x7f3594000bc0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0104f60 msgr2=0x7f35a019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0104f60 0x7f35a019a5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e9c0 tx=0x7f358c00ee80 comp rx=0 tx=0).stop 2024-09-12T12:21:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 shutdown_connections 2024-09-12T12:21:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f35880a2bb0 0x7f35880a5070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a0105920 0x7f35a01a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35a0104f60 0x7f35a019a5e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 --2- 172.21.15.38:0/3447873139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0103e00 0x7f35a019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 >> 172.21.15.38:0/3447873139 conn(0x7f35a00ff5b0 msgr2=0x7f35a0108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 shutdown_connections 2024-09-12T12:21:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:01.992+0000 7f35a7c00640 1 -- 172.21.15.38:0/3447873139 wait complete. 2024-09-12T12:21:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:01 smithi154 ceph-mon[35578]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:01 smithi038 ceph-mon[30810]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:01 smithi071 ceph-mon[34859]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:02.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:02.910 DEBUG:teuthology.orchestra.run.smithi038:osd.9> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T12:21:02.915 INFO:tasks.cephadm:Deploying osd.10 on smithi071 with /dev/vg_nvme/lv_1... 2024-09-12T12:21:02.915 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:21:03.117 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:03.117 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:03.117 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:03.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:03.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:03.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:21:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:03.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:21:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:21:03.625+0000 7fcaa122c640 -1 osd.9 0 log_to_monitors true 2024-09-12T12:21:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:03 smithi038 ceph-mon[30810]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:03 smithi038 ceph-mon[30810]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:21:04.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:03 smithi071 ceph-mon[34859]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:04.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:03 smithi071 ceph-mon[34859]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:21:04.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:03 smithi154 ceph-mon[35578]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:04.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:03 smithi154 ceph-mon[35578]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:21:05.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:05 smithi071 ceph-mon[34859]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:21:05.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:05 smithi071 ceph-mon[34859]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T12:21:05.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:05 smithi071 ceph-mon[34859]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:21:05.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:05 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:05.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:05 smithi071 ceph-mon[34859]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:21:05.147 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:05 smithi071 ceph-mon[34859]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T12:21:05.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:05 smithi154 ceph-mon[35578]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:21:05.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:05 smithi154 ceph-mon[35578]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T12:21:05.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:05 smithi154 ceph-mon[35578]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:21:05.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:05 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:05.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:05 smithi154 ceph-mon[35578]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:21:05.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:05 smithi154 ceph-mon[35578]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T12:21:05.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-mon[30810]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:21:05.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-mon[30810]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T12:21:05.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-mon[30810]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-12T12:21:05.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:05.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-mon[30810]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-12T12:21:05.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-mon[30810]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T12:21:05.778 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-12T12:21:05.803 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-09-12T12:21:06.070 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:21:06.085 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:06 smithi038 ceph-mon[30810]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:06.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:06.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:06.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:06 smithi038 ceph-mon[30810]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' 2024-09-12T12:21:06.086 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:21:05.816+0000 7fca9ba00640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T12:21:06.086 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:21:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:21:05.847+0000 7fca91a00640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:21:06.197 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:06 smithi071 ceph-mon[34859]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:06.197 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:06.197 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:06.197 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:06 smithi071 ceph-mon[34859]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' 2024-09-12T12:21:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:06 smithi154 ceph-mon[35578]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:06.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:06.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:06 smithi154 ceph-mon[35578]: from='osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942]' entity='osd.9' 2024-09-12T12:21:06.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 -- 172.21.15.71:0/4044040748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334101d10 msgr2=0x7f0334102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 --2- 172.21.15.71:0/4044040748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334101d10 0x7f0334102190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0328009ca0 tx=0x7f032802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 -- 172.21.15.71:0/4044040748 shutdown_connections 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 --2- 172.21.15.71:0/4044040748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03341026d0 0x7f0334108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 --2- 172.21.15.71:0/4044040748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334101d10 0x7f0334102190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 --2- 172.21.15.71:0/4044040748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0334100b10 0x7f0334100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 -- 172.21.15.71:0/4044040748 >> 172.21.15.71:0/4044040748 conn(0x7f03340fc2a0 msgr2=0x7f03340fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 -- 172.21.15.71:0/4044040748 shutdown_connections 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.538+0000 7f033bded640 1 -- 172.21.15.71:0/4044040748 wait complete. 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 Processor -- start 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 -- start start 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334100b10 0x7f0334197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0334101d10 0x7f03341984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03341026d0 0x7f033419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f033410d930 con 0x7f03341026d0 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f033410d7b0 con 0x7f0334100b10 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033bded640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f033410dab0 con 0x7f0334101d10 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334100b10 0x7f0334197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334100b10 0x7f0334197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37908/0 (socket says 172.21.15.71:37908) 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 -- 172.21.15.71:0/2304563325 learned_addr learned my addr 172.21.15.71:0/2304563325 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339388640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0334101d10 0x7f03341984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033a38a640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03341026d0 0x7f033419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 -- 172.21.15.71:0/2304563325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0334101d10 msgr2=0x7f03341984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0334101d10 0x7f03341984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 -- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03341026d0 msgr2=0x7f033419f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03341026d0 0x7f033419f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 -- 172.21.15.71:0/2304563325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033419fbe0 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f033a38a640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03341026d0 0x7f033419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.539+0000 7f0339b89640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334100b10 0x7f0334197fb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f032400b450 tx=0x7f032400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.540+0000 7f0332ffd640 1 -- 172.21.15.71:0/2304563325 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324015020 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.540+0000 7f0332ffd640 1 -- 172.21.15.71:0/2304563325 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0324011d70 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.540+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033419fed0 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.540+0000 7f0332ffd640 1 -- 172.21.15.71:0/2304563325 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032400f340 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.540+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03341a0350 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.541+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0334107f30 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.542+0000 7f0332ffd640 1 -- 172.21.15.71:0/2304563325 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0324018020 con 0x7f0334100b10 2024-09-12T12:21:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.542+0000 7f0332ffd640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f031c0a2bb0 0x7f031c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.542+0000 7f0332ffd640 1 -- 172.21.15.71:0/2304563325 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7f03240ce700 con 0x7f0334100b10 2024-09-12T12:21:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.543+0000 7f0339388640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f031c0a2bb0 0x7f031c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.543+0000 7f0339388640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f031c0a2bb0 0x7f031c0a5070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03341994d0 tx=0x7f0328005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.546+0000 7f0332ffd640 1 -- 172.21.15.71:0/2304563325 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f032401f020 con 0x7f0334100b10 2024-09-12T12:21:06.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:06.721+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0334062630 con 0x7f031c0a2bb0 2024-09-12T12:21:07.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:21:07.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:21:07.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:07.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:07.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:07.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:07.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] boot 2024-09-12T12:21:07.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T12:21:07.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:07 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] boot 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T12:21:07.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:07 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:07.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:21:07.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:21:07.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:07.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:07.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:07.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: osd.9 [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] boot 2024-09-12T12:21:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T12:21:07.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:07 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:08.137 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:08.137 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:08.138 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:08.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:08.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:09.317 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:09 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi038 2024-09-12T12:21:09.317 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:09 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-12T12:21:09.317 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:09 smithi071 ceph-mon[34859]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T12:21:09.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:09 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi038 2024-09-12T12:21:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:09 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-12T12:21:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:09 smithi154 ceph-mon[35578]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T12:21:09.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:09 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi038 2024-09-12T12:21:09.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:09 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-12T12:21:09.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:09 smithi038 ceph-mon[30810]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T12:21:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:10 smithi154 ceph-mon[35578]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:10 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/913451784' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]: dispatch 2024-09-12T12:21:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:10 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]: dispatch 2024-09-12T12:21:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:10 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]': finished 2024-09-12T12:21:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:10 smithi154 ceph-mon[35578]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T12:21:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:10 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:10 smithi154 ceph-mon[35578]: from='client.? 172.21.15.71:0/3817696069' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:10 smithi038 ceph-mon[30810]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:10 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/913451784' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]: dispatch 2024-09-12T12:21:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:10 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]: dispatch 2024-09-12T12:21:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:10 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]': finished 2024-09-12T12:21:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:10 smithi038 ceph-mon[30810]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T12:21:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:10 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:10.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:10 smithi038 ceph-mon[30810]: from='client.? 172.21.15.71:0/3817696069' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:10 smithi071 ceph-mon[34859]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:10 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/913451784' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]: dispatch 2024-09-12T12:21:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:10 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]: dispatch 2024-09-12T12:21:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:10 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62aedf15-9d2c-46b9-bf26-83fe7c52ded1"}]': finished 2024-09-12T12:21:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:10 smithi071 ceph-mon[34859]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T12:21:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:10 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:10 smithi071 ceph-mon[34859]: from='client.? 172.21.15.71:0/3817696069' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:12 smithi154 ceph-mon[35578]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:12.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:12 smithi038 ceph-mon[30810]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:12.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:12 smithi071 ceph-mon[34859]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:14.333 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:14 smithi071 ceph-mon[34859]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:14.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:14 smithi154 ceph-mon[35578]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:14 smithi038 ceph-mon[30810]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:16.368 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:16 smithi071 ceph-mon[34859]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:16.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:16 smithi154 ceph-mon[35578]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:16.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:16 smithi038 ceph-mon[30810]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:17.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:17 smithi154 ceph-mon[35578]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:17.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:17 smithi038 ceph-mon[30810]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:17.488 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:17 smithi071 ceph-mon[34859]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:18 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:21:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:18 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:18 smithi154 ceph-mon[35578]: Deploying daemon osd.10 on smithi071 2024-09-12T12:21:18.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:18 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:21:18.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:18 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:18.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:18 smithi038 ceph-mon[30810]: Deploying daemon osd.10 on smithi071 2024-09-12T12:21:18.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:18 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:21:18.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:18 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:18.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:18 smithi071 ceph-mon[34859]: Deploying daemon osd.10 on smithi071 2024-09-12T12:21:19.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:19 smithi154 ceph-mon[35578]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:19.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:19 smithi038 ceph-mon[30810]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:19.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:19 smithi071 ceph-mon[34859]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:21 smithi071 ceph-mon[34859]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:21.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:21 smithi154 ceph-mon[35578]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:21.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:21 smithi038 ceph-mon[30810]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:23.403 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:23 smithi071 ceph-mon[34859]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:23.403 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:23.403 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:23.403 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:23.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:23 smithi154 ceph-mon[35578]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:23.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:23.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:23.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:23 smithi038 ceph-mon[30810]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:25.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:25 smithi071 ceph-mon[34859]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:25.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:25 smithi154 ceph-mon[35578]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:25.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:25 smithi038 ceph-mon[30810]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:26.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.285+0000 7f0332ffd640 1 -- 172.21.15.71:0/2304563325 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f0334062630 con 0x7f031c0a2bb0 2024-09-12T12:21:26.286 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 10 on host 'smithi071' 2024-09-12T12:21:26.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f031c0a2bb0 msgr2=0x7f031c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:26.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f031c0a2bb0 0x7f031c0a5070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03341994d0 tx=0x7f0328005f80 comp rx=0 tx=0).stop 2024-09-12T12:21:26.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334100b10 msgr2=0x7f0334197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334100b10 0x7f0334197fb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f032400b450 tx=0x7f032400b910 comp rx=0 tx=0).stop 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 shutdown_connections 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f031c0a2bb0 0x7f031c0a5070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03341026d0 0x7f033419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0334101d10 0x7f03341984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 --2- 172.21.15.71:0/2304563325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0334100b10 0x7f0334197fb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 >> 172.21.15.71:0/2304563325 conn(0x7f03340fc2a0 msgr2=0x7f0334105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 shutdown_connections 2024-09-12T12:21:26.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-12T12:21:26.288+0000 7f033bded640 1 -- 172.21.15.71:0/2304563325 wait complete. 2024-09-12T12:21:26.978 DEBUG:teuthology.orchestra.run.smithi071:osd.10> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T12:21:26.980 INFO:tasks.cephadm:Deploying osd.11 on smithi154 with /dev/vg_nvme/lv_1... 2024-09-12T12:21:26.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:21:27.234 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:21:27.597 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:27 smithi071 ceph-mon[34859]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:27.598 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.598 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.598 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.598 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:27 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:27 smithi154 ceph-mon[35578]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:27.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.616 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:27 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:27 smithi038 ceph-mon[30810]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:27.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:27.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:27 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:29.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:29 smithi154 ceph-mon[35578]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:29.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:29 smithi154 ceph-mon[35578]: from='osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:21:29.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:29 smithi154 ceph-mon[35578]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:21:29.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:29 smithi071 ceph-mon[34859]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:29.493 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:29 smithi071 ceph-mon[34859]: from='osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:21:29.494 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:29 smithi071 ceph-mon[34859]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:21:29.494 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:21:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:21:29.231+0000 7f25ec413640 -1 osd.10 0 log_to_monitors true 2024-09-12T12:21:29.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:29 smithi038 ceph-mon[30810]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:29.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:29 smithi038 ceph-mon[30810]: from='osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:21:29.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:29 smithi038 ceph-mon[30810]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:21:29.958 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T12:21:29.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-09-12T12:21:30.238 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:21:30.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:21:30.302+0000 7f25e8396640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T12:21:30.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:21:30.316+0000 7f25e41be640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:21:30.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:21:30.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:30.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:30.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:21:30.516 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:30 smithi071 ceph-mon[34859]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.562 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.563 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.563 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:30.563 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:30.563 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.563 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:21:30.563 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:30 smithi154 ceph-mon[35578]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T12:21:30.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:21:30.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:30.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:30.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:30.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-12T12:21:30.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:30 smithi038 ceph-mon[30810]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T12:21:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 -- 172.21.15.154:0/2992885214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01017a0 msgr2=0x7f5bc0109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 --2- 172.21.15.154:0/2992885214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01017a0 0x7f5bc0109040 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009ca0 tx=0x7f5bb802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:21:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 -- 172.21.15.154:0/2992885214 shutdown_connections 2024-09-12T12:21:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 --2- 172.21.15.154:0/2992885214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01017a0 0x7f5bc0109040 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 --2- 172.21.15.154:0/2992885214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bc0100de0 0x7f5bc0101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 --2- 172.21.15.154:0/2992885214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc01020a0 0x7f5bc01024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 -- 172.21.15.154:0/2992885214 >> 172.21.15.154:0/2992885214 conn(0x7f5bc00fba40 msgr2=0x7f5bc00fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 -- 172.21.15.154:0/2992885214 shutdown_connections 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.743+0000 7f5bc712d640 1 -- 172.21.15.154:0/2992885214 wait complete. 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 Processor -- start 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 -- start start 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0100de0 0x7f5bc0100830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bc01017a0 0x7f5bc019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01020a0 0x7f5bc019f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc010c780 con 0x7f5bc0100de0 2024-09-12T12:21:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc010c600 con 0x7f5bc01017a0 2024-09-12T12:21:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc712d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc010c900 con 0x7f5bc01020a0 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01020a0 0x7f5bc019f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01020a0 0x7f5bc019f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54150/0 (socket says 172.21.15.154:54150) 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 -- 172.21.15.154:0/4044976662 learned_addr learned my addr 172.21.15.154:0/4044976662 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc4ec9640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0100de0 0x7f5bc0100830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bbffff640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bc01017a0 0x7f5bc019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 -- 172.21.15.154:0/4044976662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bc01017a0 msgr2=0x7f5bc019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bc01017a0 0x7f5bc019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 -- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0100de0 msgr2=0x7f5bc0100830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0100de0 0x7f5bc0100830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.744+0000 7f5bc56ca640 1 -- 172.21.15.154:0/4044976662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc019fb10 con 0x7f5bc01020a0 2024-09-12T12:21:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.745+0000 7f5bc56ca640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01020a0 0x7f5bc019f200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8031ee0 tx=0x7f5bb8031f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.745+0000 7f5bbdffb640 1 -- 172.21.15.154:0/4044976662 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8003b70 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.745+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc019fd40 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.745+0000 7f5bbdffb640 1 -- 172.21.15.154:0/4044976662 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bb8003d10 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.745+0000 7f5bbdffb640 1 -- 172.21.15.154:0/4044976662 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb802fb70 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.745+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc01a0280 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.746+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc0107ff0 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.747+0000 7f5bbdffb640 1 -- 172.21.15.154:0/4044976662 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5bb802fd30 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.748+0000 7f5bbdffb640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5bb00a2b80 0x7f5bb00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.748+0000 7f5bbdffb640 1 -- 172.21.15.154:0/4044976662 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6727+0+0 (secure 0 0 0) 0x7f5bb80efc20 con 0x7f5bc01020a0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.748+0000 7f5bc4ec9640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5bb00a2b80 0x7f5bb00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.749+0000 7f5bc4ec9640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5bb00a2b80 0x7f5bb00a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006a510 tx=0x7f5bb400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.752+0000 7f5bbdffb640 1 -- 172.21.15.154:0/4044976662 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5bb80bd1b0 con 0x7f5bc01020a0 2024-09-12T12:21:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:30.930+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5bc0062630 con 0x7f5bb00a2b80 2024-09-12T12:21:31.630 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:31.630 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi071 2024-09-12T12:21:31.630 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-12T12:21:31.630 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.630 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] boot 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:31.631 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:31.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi071 2024-09-12T12:21:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-12T12:21:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:31.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] boot 2024-09-12T12:21:31.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T12:21:31.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:31.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:31.721 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:31.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:31.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:31.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:31.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:21:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi071 2024-09-12T12:21:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-12T12:21:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: osd.10 [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] boot 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:32.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:32 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:21:32.946 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:32 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:21:32.946 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:32 smithi154 ceph-mon[35578]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T12:21:32.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:32 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:21:32.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:32 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:21:32.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:32 smithi038 ceph-mon[30810]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T12:21:33.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:32 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:21:33.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:32 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:21:33.021 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:32 smithi071 ceph-mon[34859]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T12:21:33.875 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:33 smithi154 ceph-mon[35578]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:33.875 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:33 smithi154 ceph-mon[35578]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T12:21:33.875 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:33 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/1482858354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]: dispatch 2024-09-12T12:21:33.875 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:33 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]: dispatch 2024-09-12T12:21:33.875 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:33 smithi154 ceph-mon[35578]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]': finished 2024-09-12T12:21:33.876 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:33 smithi154 ceph-mon[35578]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T12:21:33.876 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:33 smithi038 ceph-mon[30810]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:33 smithi038 ceph-mon[30810]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T12:21:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:33 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/1482858354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]: dispatch 2024-09-12T12:21:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:33 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]: dispatch 2024-09-12T12:21:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:33 smithi038 ceph-mon[30810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]': finished 2024-09-12T12:21:33.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:33 smithi038 ceph-mon[30810]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T12:21:33.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:33 smithi071 ceph-mon[34859]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:33 smithi071 ceph-mon[34859]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T12:21:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:33 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/1482858354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]: dispatch 2024-09-12T12:21:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:33 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]: dispatch 2024-09-12T12:21:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:33 smithi071 ceph-mon[34859]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dee8442e-7be2-4078-869a-33a7f6b13a9a"}]': finished 2024-09-12T12:21:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:33 smithi071 ceph-mon[34859]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T12:21:34.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:34.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:34 smithi154 ceph-mon[35578]: from='client.? 172.21.15.154:0/2632166622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:34.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:34 smithi154 ceph-mon[35578]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T12:21:34.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:34.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:34 smithi038 ceph-mon[30810]: from='client.? 172.21.15.154:0/2632166622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:34.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:34 smithi038 ceph-mon[30810]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T12:21:34.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:35.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:34 smithi071 ceph-mon[34859]: from='client.? 172.21.15.154:0/2632166622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:35.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:34 smithi071 ceph-mon[34859]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T12:21:35.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:35.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:35 smithi154 ceph-mon[35578]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:35.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:35 smithi038 ceph-mon[30810]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:35 smithi071 ceph-mon[34859]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:37 smithi154 ceph-mon[35578]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:37.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:37 smithi038 ceph-mon[30810]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:37 smithi071 ceph-mon[34859]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:39.886 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:39 smithi154 ceph-mon[35578]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:21:39.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:39 smithi038 ceph-mon[30810]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:21:40.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:39 smithi071 ceph-mon[34859]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:21:41.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:41 smithi154 ceph-mon[35578]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:21:41.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:41 smithi038 ceph-mon[30810]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:21:42.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:41 smithi071 ceph-mon[34859]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:21:42.705 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:42 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:21:42.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:42 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:42.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:42 smithi154 ceph-mon[35578]: Deploying daemon osd.11 on smithi154 2024-09-12T12:21:42.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:42 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:21:42.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:42 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:42.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:42 smithi038 ceph-mon[30810]: Deploying daemon osd.11 on smithi154 2024-09-12T12:21:43.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:42 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:21:43.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:42 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:43.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:42 smithi071 ceph-mon[34859]: Deploying daemon osd.11 on smithi154 2024-09-12T12:21:43.794 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:43 smithi154 ceph-mon[35578]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T12:21:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:43 smithi038 ceph-mon[30810]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T12:21:44.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:43 smithi071 ceph-mon[34859]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T12:21:45.740 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:45 smithi154 ceph-mon[35578]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:21:45.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:45 smithi038 ceph-mon[30810]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:21:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:45 smithi071 ceph-mon[34859]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:21:47.857 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:47 smithi154 ceph-mon[35578]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T12:21:47.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:47 smithi038 ceph-mon[30810]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T12:21:48.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:47 smithi071 ceph-mon[34859]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T12:21:48.896 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:48 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:48.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:48 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:48.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:48 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:48.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:48 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:48.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:48 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:48.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:48 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:49.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:48 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:49.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:48 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:49.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:48 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:50.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:49 smithi154 ceph-mon[35578]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:21:50.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:49 smithi038 ceph-mon[30810]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:21:50.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:49 smithi071 ceph-mon[34859]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:21:51.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.466+0000 7f5bbdffb640 1 -- 172.21.15.154:0/4044976662 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5bc0062630 con 0x7f5bb00a2b80 2024-09-12T12:21:51.467 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 11 on host 'smithi154' 2024-09-12T12:21:51.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5bb00a2b80 msgr2=0x7f5bb00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:51.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5bb00a2b80 0x7f5bb00a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006a510 tx=0x7f5bb400b390 comp rx=0 tx=0).stop 2024-09-12T12:21:51.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01020a0 msgr2=0x7f5bc019f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01020a0 0x7f5bc019f200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8031ee0 tx=0x7f5bb8031f10 comp rx=0 tx=0).stop 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 shutdown_connections 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5bb00a2b80 0x7f5bb00a5040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bc01020a0 0x7f5bc019f200 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bc01017a0 0x7f5bc019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 --2- 172.21.15.154:0/4044976662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0100de0 0x7f5bc0100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 >> 172.21.15.154:0/4044976662 conn(0x7f5bc00fba40 msgr2=0x7f5bc01051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 shutdown_connections 2024-09-12T12:21:51.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:21:51.469+0000 7f5bc712d640 1 -- 172.21.15.154:0/4044976662 wait complete. 2024-09-12T12:21:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:51.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:52.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.023 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:52.062 DEBUG:teuthology.orchestra.run.smithi154:osd.11> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T12:21:52.064 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T12:21:52.064 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:21:52.448 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 -- 172.21.15.38:0/1827274388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534104e40 msgr2=0x7f75341052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 --2- 172.21.15.38:0/1827274388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534104e40 0x7f75341052c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7524009860 tx=0x7f752402a340 comp rx=0 tx=0).stop 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 -- 172.21.15.38:0/1827274388 shutdown_connections 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 --2- 172.21.15.38:0/1827274388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7534105800 0x7f753410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 --2- 172.21.15.38:0/1827274388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534104e40 0x7f75341052c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 --2- 172.21.15.38:0/1827274388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534103c40 0x7f7534104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 -- 172.21.15.38:0/1827274388 >> 172.21.15.38:0/1827274388 conn(0x7f75340ff3d0 msgr2=0x7f7534101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 -- 172.21.15.38:0/1827274388 shutdown_connections 2024-09-12T12:21:53.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.016+0000 7f753b200640 1 -- 172.21.15.38:0/1827274388 wait complete. 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 Processor -- start 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 -- start start 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534103c40 0x7f7534199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534104e40 0x7f753419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7534105800 0x7f75341a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f753410f8a0 con 0x7f7534104e40 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f753410f720 con 0x7f7534105800 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.017+0000 7f753b200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f753410fa20 con 0x7f7534103c40 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534104e40 0x7f753419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534103c40 0x7f7534199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534104e40 0x7f753419a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54192/0 (socket says 172.21.15.38:54192) 2024-09-12T12:21:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539400640 1 -- 172.21.15.38:0/2517412438 learned_addr learned my addr 172.21.15.38:0/2517412438 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534103c40 0x7f7534199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52604/0 (socket says 172.21.15.38:52604) 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f753a800640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7534105800 0x7f75341a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 -- 172.21.15.38:0/2517412438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7534105800 msgr2=0x7f75341a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7534105800 0x7f75341a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 -- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534104e40 msgr2=0x7f753419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534104e40 0x7f753419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 -- 172.21.15.38:0/2517412438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75341a1af0 con 0x7f7534103c40 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f753a800640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7534105800 0x7f75341a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539400640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534104e40 0x7f753419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.018+0000 7f7539e00640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534103c40 0x7f7534199ec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7534104ca0 tx=0x7f752800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.019+0000 7f752ea00640 1 -- 172.21.15.38:0/2517412438 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528004440 con 0x7f7534103c40 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.019+0000 7f752ea00640 1 -- 172.21.15.38:0/2517412438 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f752800cda0 con 0x7f7534103c40 2024-09-12T12:21:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.019+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75341a1de0 con 0x7f7534103c40 2024-09-12T12:21:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.019+0000 7f752ea00640 1 -- 172.21.15.38:0/2517412438 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280196e0 con 0x7f7534103c40 2024-09-12T12:21:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.019+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75341a2230 con 0x7f7534103c40 2024-09-12T12:21:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.020+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753410af90 con 0x7f7534103c40 2024-09-12T12:21:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.022+0000 7f752ea00640 1 -- 172.21.15.38:0/2517412438 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7528003780 con 0x7f7534103c40 2024-09-12T12:21:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.023+0000 7f752ea00640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f751c0a2bb0 0x7f751c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.023+0000 7f752ea00640 1 -- 172.21.15.38:0/2517412438 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f75280ceef0 con 0x7f7534103c40 2024-09-12T12:21:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.023+0000 7f7539400640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f751c0a2bb0 0x7f751c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.024+0000 7f7539400640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f751c0a2bb0 0x7f751c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f752402a930 tx=0x7f75240058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:53.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.027+0000 7f752ea00640 1 -- 172.21.15.38:0/2517412438 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f752809c390 con 0x7f7534103c40 2024-09-12T12:21:53.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.211+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7534062ef0 con 0x7f7534103c40 2024-09-12T12:21:53.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.211+0000 7f752ea00640 1 -- 172.21.15.38:0/2517412438 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f7528009510 con 0x7f7534103c40 2024-09-12T12:21:53.212 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.213+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f751c0a2bb0 msgr2=0x7f751c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.213+0000 7f753b200640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f751c0a2bb0 0x7f751c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f752402a930 tx=0x7f75240058b0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.213+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534103c40 msgr2=0x7f7534199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.213+0000 7f753b200640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534103c40 0x7f7534199ec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7534104ca0 tx=0x7f752800ee50 comp rx=0 tx=0).stop 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 shutdown_connections 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f751c0a2bb0 0x7f751c0a5070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7534105800 0x7f75341a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7534104e40 0x7f753419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 --2- 172.21.15.38:0/2517412438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7534103c40 0x7f7534199ec0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 >> 172.21.15.38:0/2517412438 conn(0x7f75340ff3d0 msgr2=0x7f7534108160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:53.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 shutdown_connections 2024-09-12T12:21:53.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:53.214+0000 7f753b200640 1 -- 172.21.15.38:0/2517412438 wait complete. 2024-09-12T12:21:53.915 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:53 smithi154 ceph-mon[35578]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:53.915 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:53 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2517412438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:21:53.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:53 smithi038 ceph-mon[30810]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:53.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:53 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2517412438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:21:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:53 smithi071 ceph-mon[34859]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:53 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2517412438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:21:54.166 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:21:53 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:21:53.914+0000 7fc8e6ccf640 -1 osd.11 0 log_to_monitors true 2024-09-12T12:21:54.188 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726143690,"num_in_osds":12,"osd_in_since":1726143693,"num_remapped_pgs":0} 2024-09-12T12:21:54.907 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:54 smithi154 ceph-mon[35578]: from='osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:21:54.907 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:54 smithi154 ceph-mon[35578]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:21:54.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:54 smithi038 ceph-mon[30810]: from='osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:21:54.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:54 smithi038 ceph-mon[30810]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:21:55.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:54 smithi071 ceph-mon[34859]: from='osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:21:55.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:54 smithi071 ceph-mon[34859]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:21:55.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:21:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:21:55.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:55.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:21:55.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T12:21:55.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:21:55.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:55.971 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:21:55.971 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: Detected new or changed devices on smithi154 2024-09-12T12:21:55.971 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:55.971 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:55.971 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:55.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:55.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:55.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:55.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-12T12:21:55.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:55.973 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:55.973 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:55.973 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:56.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:21:56.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T12:21:56.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: Detected new or changed devices on smithi154 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.016 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-12T12:21:56.016 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.016 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:56.016 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:56.016 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: Detected new or changed devices on smithi154 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:56.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 -- 172.21.15.38:0/1385773275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70105920 msgr2=0x7f7a7010c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 --2- 172.21.15.38:0/1385773275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70105920 0x7f7a7010c240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009ca0 tx=0x7f7a6802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 -- 172.21.15.38:0/1385773275 shutdown_connections 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 --2- 172.21.15.38:0/1385773275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70105920 0x7f7a7010c240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 --2- 172.21.15.38:0/1385773275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a70104f60 0x7f7a701053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 --2- 172.21.15.38:0/1385773275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a70103e00 0x7f7a70104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 -- 172.21.15.38:0/1385773275 >> 172.21.15.38:0/1385773275 conn(0x7f7a700ff5b0 msgr2=0x7f7a701019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 -- 172.21.15.38:0/1385773275 shutdown_connections 2024-09-12T12:21:56.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.284+0000 7f7a75400640 1 -- 172.21.15.38:0/1385773275 wait complete. 2024-09-12T12:21:56.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 Processor -- start 2024-09-12T12:21:56.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 -- start start 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70103e00 0x7f7a7019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a70104f60 0x7f7a7019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a70105920 0x7f7a701a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7010fb00 con 0x7f7a70104f60 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7010f980 con 0x7f7a70105920 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.285+0000 7f7a75400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7010fc80 con 0x7f7a70103e00 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70103e00 0x7f7a7019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70103e00 0x7f7a7019a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:35370/0 (socket says 172.21.15.38:35370) 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 -- 172.21.15.38:0/1409617137 learned_addr learned my addr 172.21.15.38:0/1409617137 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6de00640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a70104f60 0x7f7a7019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6f200640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a70105920 0x7f7a701a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 -- 172.21.15.38:0/1409617137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a70105920 msgr2=0x7f7a701a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a70105920 0x7f7a701a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 -- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a70104f60 msgr2=0x7f7a7019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a70104f60 0x7f7a7019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6e800640 1 -- 172.21.15.38:0/1409617137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a701a1ca0 con 0x7f7a70103e00 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.286+0000 7f7a6f200640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a70105920 0x7f7a701a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.287+0000 7f7a6e800640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70103e00 0x7f7a7019a070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000e9f0 tx=0x7f7a6000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.287+0000 7f7a67400640 1 -- 172.21.15.38:0/1409617137 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000cd80 con 0x7f7a70103e00 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.287+0000 7f7a67400640 1 -- 172.21.15.38:0/1409617137 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a60005500 con 0x7f7a70103e00 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.287+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a701a1f90 con 0x7f7a70103e00 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.287+0000 7f7a67400640 1 -- 172.21.15.38:0/1409617137 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60010690 con 0x7f7a70103e00 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.287+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a701a23e0 con 0x7f7a70103e00 2024-09-12T12:21:56.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.288+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a500052c0 con 0x7f7a70103e00 2024-09-12T12:21:56.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.290+0000 7f7a67400640 1 -- 172.21.15.38:0/1409617137 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7a600046c0 con 0x7f7a70103e00 2024-09-12T12:21:56.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.291+0000 7f7a67400640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7a540a2bb0 0x7f7a540a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.292+0000 7f7a67400640 1 -- 172.21.15.38:0/1409617137 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f7a600ceec0 con 0x7f7a70103e00 2024-09-12T12:21:56.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.292+0000 7f7a6de00640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7a540a2bb0 0x7f7a540a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.292+0000 7f7a6de00640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7a540a2bb0 0x7f7a540a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0095f0 tx=0x7f7a5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.298+0000 7f7a67400640 1 -- 172.21.15.38:0/1409617137 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a6009c340 con 0x7f7a70103e00 2024-09-12T12:21:56.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.486+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7a50005880 con 0x7f7a70103e00 2024-09-12T12:21:56.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.487+0000 7f7a67400640 1 -- 172.21.15.38:0/1409617137 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f7a6009bc40 con 0x7f7a70103e00 2024-09-12T12:21:56.488 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:21:56.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7a540a2bb0 msgr2=0x7f7a540a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7a540a2bb0 0x7f7a540a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0095f0 tx=0x7f7a5c005f90 comp rx=0 tx=0).stop 2024-09-12T12:21:56.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70103e00 msgr2=0x7f7a7019a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70103e00 0x7f7a7019a070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000e9f0 tx=0x7f7a6000edf0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 shutdown_connections 2024-09-12T12:21:56.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7a540a2bb0 0x7f7a540a5070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a70105920 0x7f7a701a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a70104f60 0x7f7a7019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 --2- 172.21.15.38:0/1409617137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a70103e00 0x7f7a7019a070 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 >> 172.21.15.38:0/1409617137 conn(0x7f7a700ff5b0 msgr2=0x7f7a701082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 shutdown_connections 2024-09-12T12:21:56.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:56.489+0000 7f7a75400640 1 -- 172.21.15.38:0/1409617137 wait complete. 2024-09-12T12:21:56.729 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:21:56.462+0000 7fc8e2c52640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T12:21:56.729 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:21:56.472+0000 7fc8daa72640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:21:56.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:56 smithi038 ceph-mon[30810]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:21:56.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:56 smithi038 ceph-mon[30810]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T12:21:56.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:56 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:56.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:56 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:56.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:56 smithi038 ceph-mon[30810]: from='osd.11 ' entity='osd.11' 2024-09-12T12:21:56.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:56 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1409617137' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:21:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:56 smithi071 ceph-mon[34859]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:21:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:56 smithi071 ceph-mon[34859]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T12:21:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:56 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:56 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:56 smithi071 ceph-mon[34859]: from='osd.11 ' entity='osd.11' 2024-09-12T12:21:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:56 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1409617137' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:21:57.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-mon[35578]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-12T12:21:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-mon[35578]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T12:21:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-mon[35578]: from='osd.11 ' entity='osd.11' 2024-09-12T12:21:57.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:56 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1409617137' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:21:57.429 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726143690,"num_in_osds":12,"osd_in_since":1726143693,"num_remapped_pgs":0} 2024-09-12T12:21:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:57 smithi071 ceph-mon[34859]: purged_snaps scrub starts 2024-09-12T12:21:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:57 smithi071 ceph-mon[34859]: purged_snaps scrub ok 2024-09-12T12:21:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:57 smithi071 ceph-mon[34859]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:58.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:57 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:58.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:57 smithi071 ceph-mon[34859]: osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] boot 2024-09-12T12:21:58.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:57 smithi071 ceph-mon[34859]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:21:58.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:57 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:57 smithi154 ceph-mon[35578]: purged_snaps scrub starts 2024-09-12T12:21:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:57 smithi154 ceph-mon[35578]: purged_snaps scrub ok 2024-09-12T12:21:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:57 smithi154 ceph-mon[35578]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:57 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:57 smithi154 ceph-mon[35578]: osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] boot 2024-09-12T12:21:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:57 smithi154 ceph-mon[35578]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:21:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:57 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:58.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:57 smithi038 ceph-mon[30810]: purged_snaps scrub starts 2024-09-12T12:21:58.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:57 smithi038 ceph-mon[30810]: purged_snaps scrub ok 2024-09-12T12:21:58.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:57 smithi038 ceph-mon[30810]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:21:58.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:58.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:57 smithi038 ceph-mon[30810]: osd.11 [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] boot 2024-09-12T12:21:58.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:57 smithi038 ceph-mon[30810]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:21:58.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:57 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:21:58.431 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:21:58.821 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:21:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 -- 172.21.15.38:0/1131845437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 msgr2=0x7f1908104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 --2- 172.21.15.38:0/1131845437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f1908104200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009900 tx=0x7f18f802a410 comp rx=0 tx=0).stop 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 -- 172.21.15.38:0/1131845437 shutdown_connections 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 --2- 172.21.15.38:0/1131845437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1908105920 0x7f190810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 --2- 172.21.15.38:0/1131845437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1908104f60 0x7f19081053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 --2- 172.21.15.38:0/1131845437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f1908104200 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 -- 172.21.15.38:0/1131845437 >> 172.21.15.38:0/1131845437 conn(0x7f19080ff5b0 msgr2=0x7f19081019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 -- 172.21.15.38:0/1131845437 shutdown_connections 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.451+0000 7f190e200640 1 -- 172.21.15.38:0/1131845437 wait complete. 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.452+0000 7f190e200640 1 Processor -- start 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.452+0000 7f190e200640 1 -- start start 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f190e200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f190819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f190e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1908104f60 0x7f190819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f190e200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1908105920 0x7f19081a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f190e200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f190810fb00 con 0x7f1908103e00 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f190e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f190810f980 con 0x7f1908104f60 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f190e200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f190810fc80 con 0x7f1908105920 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f190819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f190819a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57438/0 (socket says 172.21.15.38:57438) 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 -- 172.21.15.38:0/3790917128 learned_addr learned my addr 172.21.15.38:0/3790917128 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1906a00640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1908104f60 0x7f190819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907e00640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1908105920 0x7f19081a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 -- 172.21.15.38:0/3790917128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1908105920 msgr2=0x7f19081a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1908105920 0x7f19081a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 -- 172.21.15.38:0/3790917128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1908104f60 msgr2=0x7f190819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1908104f60 0x7f190819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.453+0000 7f1907400640 1 -- 172.21.15.38:0/3790917128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081a1d20 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.454+0000 7f1907400640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f190819a0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18f8031440 tx=0x7f18f8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.454+0000 7f18ffe00640 1 -- 172.21.15.38:0/3790917128 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f803f030 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.454+0000 7f18ffe00640 1 -- 172.21.15.38:0/3790917128 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f8003ce0 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.454+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19081a1fb0 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.454+0000 7f18ffe00640 1 -- 172.21.15.38:0/3790917128 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8035070 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.454+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19081a23b0 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.455+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f190810b120 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.457+0000 7f18ffe00640 1 -- 172.21.15.38:0/3790917128 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f18f8042030 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.458+0000 7f18ffe00640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18ec0a2bb0 0x7f18ec0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.459+0000 7f18ffe00640 1 -- 172.21.15.38:0/3790917128 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f18f80ef060 con 0x7f1908103e00 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.459+0000 7f1906a00640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18ec0a2bb0 0x7f18ec0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.459+0000 7f1906a00640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18ec0a2bb0 0x7f18ec0a5070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f190819b610 tx=0x7f18f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.463+0000 7f18ffe00640 1 -- 172.21.15.38:0/3790917128 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18f80bbd70 con 0x7f1908103e00 2024-09-12T12:21:59.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.653+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1908062f30 con 0x7f1908103e00 2024-09-12T12:21:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.653+0000 7f18ffe00640 1 -- 172.21.15.38:0/3790917128 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f18f80c0070 con 0x7f1908103e00 2024-09-12T12:21:59.654 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:21:59.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18ec0a2bb0 msgr2=0x7f18ec0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18ec0a2bb0 0x7f18ec0a5070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f190819b610 tx=0x7f18f4005f90 comp rx=0 tx=0).stop 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 msgr2=0x7f190819a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f190819a0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18f8031440 tx=0x7f18f8032ce0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 shutdown_connections 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f18ec0a2bb0 0x7f18ec0a5070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1908105920 0x7f19081a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1908104f60 0x7f190819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 --2- 172.21.15.38:0/3790917128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1908103e00 0x7f190819a0f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 >> 172.21.15.38:0/3790917128 conn(0x7f19080ff5b0 msgr2=0x7f19081082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 shutdown_connections 2024-09-12T12:21:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:21:59.656+0000 7f190e200640 1 -- 172.21.15.38:0/3790917128 wait complete. 2024-09-12T12:22:00.003 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:59 smithi038 ceph-mon[30810]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:00.004 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:59 smithi038 ceph-mon[30810]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:22:00.004 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:21:59 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3790917128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:00.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:59 smithi071 ceph-mon[34859]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:00.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:59 smithi071 ceph-mon[34859]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:22:00.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:21:59 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3790917128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:00.169 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:59 smithi154 ceph-mon[35578]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:00.170 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:59 smithi154 ceph-mon[35578]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:22:00.170 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:21:59 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3790917128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:00.501 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726143717,"num_in_osds":12,"osd_in_since":1726143693,"num_remapped_pgs":0} 2024-09-12T12:22:00.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:22:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:01.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 -- 172.21.15.38:0/3871874123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c109140 msgr2=0x7f724c110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 --2- 172.21.15.38:0/3871874123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c109140 0x7f724c110cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7244009ca0 tx=0x7f724402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 -- 172.21.15.38:0/3871874123 shutdown_connections 2024-09-12T12:22:01.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 --2- 172.21.15.38:0/3871874123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c109140 0x7f724c110cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 --2- 172.21.15.38:0/3871874123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724c1049c0 0x7f724c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 --2- 172.21.15.38:0/3871874123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 0x7f724c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 -- 172.21.15.38:0/3871874123 >> 172.21.15.38:0/3871874123 conn(0x7f724c0ffa50 msgr2=0x7f724c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:01.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 -- 172.21.15.38:0/3871874123 shutdown_connections 2024-09-12T12:22:01.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.571+0000 7f7253c00640 1 -- 172.21.15.38:0/3871874123 wait complete. 2024-09-12T12:22:01.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 Processor -- start 2024-09-12T12:22:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 -- start start 2024-09-12T12:22:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 0x7f724c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c1049c0 0x7f724c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724c109140 0x7f724c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f724c114170 con 0x7f724c1049c0 2024-09-12T12:22:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f724c113ff0 con 0x7f724c104010 2024-09-12T12:22:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.572+0000 7f7253c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f724c1142f0 con 0x7f724c109140 2024-09-12T12:22:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7243e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c1049c0 0x7f724c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 0x7f724c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 0x7f724c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:40194/0 (socket says 172.21.15.38:40194) 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 -- 172.21.15.38:0/2021234689 learned_addr learned my addr 172.21.15.38:0/2021234689 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251c00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724c109140 0x7f724c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 -- 172.21.15.38:0/2021234689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724c109140 msgr2=0x7f724c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724c109140 0x7f724c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 -- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c1049c0 msgr2=0x7f724c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c1049c0 0x7f724c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 -- 172.21.15.38:0/2021234689 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c19f5e0 con 0x7f724c104010 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.573+0000 7f7251200640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 0x7f724c19a630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f723c00ea60 tx=0x7f723c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.574+0000 7f724a000640 1 -- 172.21.15.38:0/2021234689 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c00cde0 con 0x7f724c104010 2024-09-12T12:22:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.574+0000 7f724a000640 1 -- 172.21.15.38:0/2021234689 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f723c0035f0 con 0x7f724c104010 2024-09-12T12:22:01.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.574+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c19f8d0 con 0x7f724c104010 2024-09-12T12:22:01.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.574+0000 7f724a000640 1 -- 172.21.15.38:0/2021234689 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c010670 con 0x7f724c104010 2024-09-12T12:22:01.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.574+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c1a71b0 con 0x7f724c104010 2024-09-12T12:22:01.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.575+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c1043f0 con 0x7f724c104010 2024-09-12T12:22:01.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.577+0000 7f724a000640 1 -- 172.21.15.38:0/2021234689 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f723c0037a0 con 0x7f724c104010 2024-09-12T12:22:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.578+0000 7f724a000640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f72300a2c00 0x7f72300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.578+0000 7f724a000640 1 -- 172.21.15.38:0/2021234689 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f723c0cef20 con 0x7f724c104010 2024-09-12T12:22:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.578+0000 7f7243e00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f72300a2c00 0x7f72300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.579+0000 7f7243e00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f72300a2c00 0x7f72300a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f724c10ab10 tx=0x7f7234005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.580+0000 7f724a000640 1 -- 172.21.15.38:0/2021234689 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f723c09c280 con 0x7f724c104010 2024-09-12T12:22:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.767+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f724c10c3e0 con 0x7f724c104010 2024-09-12T12:22:01.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.768+0000 7f724a000640 1 -- 172.21.15.38:0/2021234689 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18455 (secure 0 0 0) 0x7f723c09bb80 con 0x7f724c104010 2024-09-12T12:22:01.770 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:01.770 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:21:58.730972+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f72300a2c00 msgr2=0x7f72300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f72300a2c00 0x7f72300a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f724c10ab10 tx=0x7f7234005f90 comp rx=0 tx=0).stop 2024-09-12T12:22:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 msgr2=0x7f724c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 0x7f724c19a630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f723c00ea60 tx=0x7f723c00ef20 comp rx=0 tx=0).stop 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 shutdown_connections 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f72300a2c00 0x7f72300a50c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724c109140 0x7f724c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f724c1049c0 0x7f724c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 --2- 172.21.15.38:0/2021234689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f724c104010 0x7f724c19a630 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.771+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 >> 172.21.15.38:0/2021234689 conn(0x7f724c0ffa50 msgr2=0x7f724c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.772+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 shutdown_connections 2024-09-12T12:22:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:01.772+0000 7f7253c00640 1 -- 172.21.15.38:0/2021234689 wait complete. 2024-09-12T12:22:01.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:01 smithi038 ceph-mon[30810]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:02.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:01 smithi071 ceph-mon[34859]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:02.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:01 smithi154 ceph-mon[35578]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:02.571 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:17:58.604590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:22:02.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T12:22:02.941 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:02.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:02 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2021234689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:22:03.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:02 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2021234689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:22:03.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:02 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2021234689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:22:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 -- 172.21.15.38:0/1390731708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4112b90 msgr2=0x7f66f4114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 --2- 172.21.15.38:0/1390731708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4112b90 0x7f66f4114f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009860 tx=0x7f66ec02a3d0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 -- 172.21.15.38:0/1390731708 shutdown_connections 2024-09-12T12:22:03.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 --2- 172.21.15.38:0/1390731708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4112b90 0x7f66f4114f80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 --2- 172.21.15.38:0/1390731708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66f4074eb0 0x7f66f4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 --2- 172.21.15.38:0/1390731708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66f4074590 0x7f66f4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 -- 172.21.15.38:0/1390731708 >> 172.21.15.38:0/1390731708 conn(0x7f66f40fd8c0 msgr2=0x7f66f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:03.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 -- 172.21.15.38:0/1390731708 shutdown_connections 2024-09-12T12:22:03.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.508+0000 7f66faa00640 1 -- 172.21.15.38:0/1390731708 wait complete. 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 Processor -- start 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 -- start start 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66f4074590 0x7f66f419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4074eb0 0x7f66f419f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66f4112b90 0x7f66f41a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41185c0 con 0x7f66f4074eb0 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4118440 con 0x7f66f4112b90 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.509+0000 7f66faa00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4118740 con 0x7f66f4074590 2024-09-12T12:22:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4074eb0 0x7f66f419f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4074eb0 0x7f66f419f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57470/0 (socket says 172.21.15.38:57470) 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66f8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66f4112b90 0x7f66f41a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 -- 172.21.15.38:0/4243661855 learned_addr learned my addr 172.21.15.38:0/4243661855 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66f3e00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66f4074590 0x7f66f419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 -- 172.21.15.38:0/4243661855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66f4074590 msgr2=0x7f66f419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66f4074590 0x7f66f419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 -- 172.21.15.38:0/4243661855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66f4112b90 msgr2=0x7f66f41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66f4112b90 0x7f66f41a3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 -- 172.21.15.38:0/4243661855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f41a3b40 con 0x7f66f4074eb0 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66f8a00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66f4112b90 0x7f66f41a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.510+0000 7f66eb400640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4074eb0 0x7f66f419f050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e9f0 tx=0x7f66dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.511+0000 7f66f1600640 1 -- 172.21.15.38:0/4243661855 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00cd80 con 0x7f66f4074eb0 2024-09-12T12:22:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.511+0000 7f66f1600640 1 -- 172.21.15.38:0/4243661855 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66dc005500 con 0x7f66f4074eb0 2024-09-12T12:22:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.511+0000 7f66f1600640 1 -- 172.21.15.38:0/4243661855 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc010690 con 0x7f66f4074eb0 2024-09-12T12:22:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.511+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f41a3e30 con 0x7f66f4074eb0 2024-09-12T12:22:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.511+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f41ab6c0 con 0x7f66f4074eb0 2024-09-12T12:22:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.512+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f4074970 con 0x7f66f4074eb0 2024-09-12T12:22:03.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.514+0000 7f66f1600640 1 -- 172.21.15.38:0/4243661855 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f66dc0046c0 con 0x7f66f4074eb0 2024-09-12T12:22:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.515+0000 7f66f1600640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f66d80a2c00 0x7f66d80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.515+0000 7f66f1600640 1 -- 172.21.15.38:0/4243661855 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f66dc0cf140 con 0x7f66f4074eb0 2024-09-12T12:22:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.515+0000 7f66f3e00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f66d80a2c00 0x7f66d80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.516+0000 7f66f3e00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f66d80a2c00 0x7f66d80a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005fd0 tx=0x7f66e4010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.518+0000 7f66f1600640 1 -- 172.21.15.38:0/4243661855 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66dc0541b0 con 0x7f66f4074eb0 2024-09-12T12:22:03.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.701+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66f402d7c0 con 0x7f66f4074eb0 2024-09-12T12:22:03.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.702+0000 7f66f1600640 1 -- 172.21.15.38:0/4243661855 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f66dc09c4a0 con 0x7f66f4074eb0 2024-09-12T12:22:03.702 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-12T12:22:03.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f66d80a2c00 msgr2=0x7f66d80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f66d80a2c00 0x7f66d80a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005fd0 tx=0x7f66e4010040 comp rx=0 tx=0).stop 2024-09-12T12:22:03.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4074eb0 msgr2=0x7f66f419f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4074eb0 0x7f66f419f050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e9f0 tx=0x7f66dc00edf0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 shutdown_connections 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f66d80a2c00 0x7f66d80a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66f4112b90 0x7f66f41a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66f4074eb0 0x7f66f419f050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 --2- 172.21.15.38:0/4243661855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66f4074590 0x7f66f419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 >> 172.21.15.38:0/4243661855 conn(0x7f66f40fd8c0 msgr2=0x7f66f40ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 shutdown_connections 2024-09-12T12:22:03.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:03.704+0000 7f66faa00640 1 -- 172.21.15.38:0/4243661855 wait complete. 2024-09-12T12:22:03.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:03 smithi038 ceph-mon[30810]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:03.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:03 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/4243661855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:22:04.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:03 smithi071 ceph-mon[34859]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:04.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:03 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/4243661855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:22:04.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:03 smithi154 ceph-mon[35578]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:03 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/4243661855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:22:04.627 INFO:tasks.cephadm:Adding mds.a on smithi038 2024-09-12T12:22:04.627 INFO:tasks.cephadm:Adding mds.d on smithi038 2024-09-12T12:22:04.627 INFO:tasks.cephadm:Adding mds.g on smithi038 2024-09-12T12:22:04.627 INFO:tasks.cephadm:Adding mds.j on smithi038 2024-09-12T12:22:04.627 INFO:tasks.cephadm:Adding mds.b on smithi071 2024-09-12T12:22:04.627 INFO:tasks.cephadm:Adding mds.e on smithi071 2024-09-12T12:22:04.627 INFO:tasks.cephadm:Adding mds.h on smithi071 2024-09-12T12:22:04.628 INFO:tasks.cephadm:Adding mds.k on smithi071 2024-09-12T12:22:04.628 INFO:tasks.cephadm:Adding mds.c on smithi154 2024-09-12T12:22:04.628 INFO:tasks.cephadm:Adding mds.f on smithi154 2024-09-12T12:22:04.628 INFO:tasks.cephadm:Adding mds.i on smithi154 2024-09-12T12:22:04.628 INFO:tasks.cephadm:Adding mds.l on smithi154 2024-09-12T12:22:04.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l' 2024-09-12T12:22:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:22:05.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 -- 172.21.15.154:0/1852783616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d00101d10 msgr2=0x7f2d00102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1852783616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d00101d10 0x7f2d00102190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009900 tx=0x7f2cf402a410 comp rx=0 tx=0).stop 2024-09-12T12:22:05.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 -- 172.21.15.154:0/1852783616 shutdown_connections 2024-09-12T12:22:05.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1852783616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d001026d0 0x7f2d00108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1852783616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d00101d10 0x7f2d00102190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1852783616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d00100b10 0x7f2d00100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 -- 172.21.15.154:0/1852783616 >> 172.21.15.154:0/1852783616 conn(0x7f2d000fc2a0 msgr2=0x7f2d000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:05.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 -- 172.21.15.154:0/1852783616 shutdown_connections 2024-09-12T12:22:05.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.421+0000 7f2d052e5640 1 -- 172.21.15.154:0/1852783616 wait complete. 2024-09-12T12:22:05.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 Processor -- start 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 -- start start 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d00100b10 0x7f2d00197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d00101d10 0x7f2d001984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d001026d0 0x7f2d0019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010c790 con 0x7f2d00101d10 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010c610 con 0x7f2d00100b10 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2d052e5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010c910 con 0x7f2d001026d0 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2cff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d001026d0 0x7f2d0019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2cff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d001026d0 0x7f2d0019f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43232/0 (socket says 172.21.15.154:43232) 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.422+0000 7f2cff7fe640 1 -- 172.21.15.154:0/1222574257 learned_addr learned my addr 172.21.15.154:0/1222574257 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cfe7fc640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d00101d10 0x7f2d001984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cfeffd640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d00100b10 0x7f2d00197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cff7fe640 1 -- 172.21.15.154:0/1222574257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d00100b10 msgr2=0x7f2d00197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cff7fe640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d00100b10 0x7f2d00197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cff7fe640 1 -- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d00101d10 msgr2=0x7f2d001984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cff7fe640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d00101d10 0x7f2d001984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cff7fe640 1 -- 172.21.15.154:0/1222574257 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0019fbd0 con 0x7f2d001026d0 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cfe7fc640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d00101d10 0x7f2d001984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2cff7fe640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d001026d0 0x7f2d0019f560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800cad0 tx=0x7f2cf800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2ce7fff640 1 -- 172.21.15.154:0/1222574257 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800ae20 con 0x7f2d001026d0 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2ce7fff640 1 -- 172.21.15.154:0/1222574257 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cf8005020 con 0x7f2d001026d0 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2ce7fff640 1 -- 172.21.15.154:0/1222574257 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f6f0 con 0x7f2d001026d0 2024-09-12T12:22:05.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0019fec0 con 0x7f2d001026d0 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.423+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d001a0320 con 0x7f2d001026d0 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.424+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d001a05e0 con 0x7f2d001026d0 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.425+0000 7f2ce7fff640 1 -- 172.21.15.154:0/1222574257 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2cf80051d0 con 0x7f2d001026d0 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.426+0000 7f2ce7fff640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2ce80a2bb0 0x7f2ce80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.426+0000 7f2ce7fff640 1 -- 172.21.15.154:0/1222574257 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f2cf80cec90 con 0x7f2d001026d0 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.427+0000 7f2cfeffd640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2ce80a2bb0 0x7f2ce80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.428+0000 7f2cfeffd640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2ce80a2bb0 0x7f2ce80a5070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005fd0 tx=0x7f2cf0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.430+0000 7f2ce7fff640 1 -- 172.21.15.154:0/1222574257 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2cf8014030 con 0x7f2d001026d0 2024-09-12T12:22:05.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.661+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}) -- 0x7f2d0006af10 con 0x7f2ce80a2bb0 2024-09-12T12:22:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.670+0000 7f2ce7fff640 1 -- 172.21.15.154:0/1222574257 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2d0006af10 con 0x7f2ce80a2bb0 2024-09-12T12:22:05.670 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mds.all update... 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2ce80a2bb0 msgr2=0x7f2ce80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2ce80a2bb0 0x7f2ce80a5070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005fd0 tx=0x7f2cf0005850 comp rx=0 tx=0).stop 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d001026d0 msgr2=0x7f2d0019f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d001026d0 0x7f2d0019f560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800cad0 tx=0x7f2cf800cf90 comp rx=0 tx=0).stop 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 shutdown_connections 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2ce80a2bb0 0x7f2ce80a5070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d001026d0 0x7f2d0019f560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d00101d10 0x7f2d001984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 --2- 172.21.15.154:0/1222574257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d00100b10 0x7f2d00197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 >> 172.21.15.154:0/1222574257 conn(0x7f2d000fc2a0 msgr2=0x7f2d0006a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:05.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 shutdown_connections 2024-09-12T12:22:05.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T12:22:05.673+0000 7f2d052e5640 1 -- 172.21.15.154:0/1222574257 wait complete. 2024-09-12T12:22:05.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:05 smithi154 ceph-mon[35578]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:05.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:05 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:05.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:05 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:06.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:05 smithi071 ceph-mon[34859]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:06.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:05 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:06.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:05 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:05 smithi038 ceph-mon[30810]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:05 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:05 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:06.448 DEBUG:teuthology.orchestra.run.smithi038:mds.a> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T12:22:06.453 DEBUG:teuthology.orchestra.run.smithi038:mds.d> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T12:22:06.498 DEBUG:teuthology.orchestra.run.smithi038:mds.g> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T12:22:06.544 DEBUG:teuthology.orchestra.run.smithi038:mds.j> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T12:22:06.589 DEBUG:teuthology.orchestra.run.smithi071:mds.b> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T12:22:06.591 DEBUG:teuthology.orchestra.run.smithi071:mds.e> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T12:22:06.634 DEBUG:teuthology.orchestra.run.smithi071:mds.h> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T12:22:06.677 DEBUG:teuthology.orchestra.run.smithi071:mds.k> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T12:22:06.720 DEBUG:teuthology.orchestra.run.smithi154:mds.c> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T12:22:06.722 DEBUG:teuthology.orchestra.run.smithi154:mds.f> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T12:22:06.766 DEBUG:teuthology.orchestra.run.smithi154:mds.i> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T12:22:06.809 DEBUG:teuthology.orchestra.run.smithi154:mds.l> sudo journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T12:22:06.852 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T12:22:06.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: Saving service mds.all spec with placement smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:07.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:06 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: Saving service mds.all spec with placement smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:07.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:06 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: Saving service mds.all spec with placement smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-12T12:22:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:07.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:07.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:06 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:07.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1208945285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0101de0 msgr2=0x7f8ed01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1208945285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0101de0 0x7f8ed01021c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec402a410 comp rx=0 tx=0).stop 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1208945285 shutdown_connections 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1208945285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ed0106f10 0x7f8ed010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1208945285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0102790 0x7f8ed01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1208945285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0101de0 0x7f8ed01021c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1208945285 >> 172.21.15.38:0/1208945285 conn(0x7f8ed00fd8c0 msgr2=0x7f8ed00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1208945285 shutdown_connections 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.763+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1208945285 wait complete. 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.764+0000 7f8ed7c00640 1 Processor -- start 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed7c00640 1 -- start start 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed7c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0101de0 0x7f8ed019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed7c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0102790 0x7f8ed019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed7c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ed0106f10 0x7f8ed019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed7c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0111fc0 con 0x7f8ed0102790 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed7c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0111e40 con 0x7f8ed0101de0 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed7c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0112140 con 0x7f8ed0106f10 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed5200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0101de0 0x7f8ed019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed5200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0101de0 0x7f8ed019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:38596/0 (socket says 172.21.15.38:38596) 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed5200640 1 -- 172.21.15.38:0/1853382156 learned_addr learned my addr 172.21.15.38:0/1853382156 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ed5c00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ed0106f10 0x7f8ed019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.765+0000 7f8ecfe00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0102790 0x7f8ed019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.766+0000 7f8ed5200640 1 -- 172.21.15.38:0/1853382156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ed0106f10 msgr2=0x7f8ed019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.766+0000 7f8ed5200640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ed0106f10 0x7f8ed019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.766+0000 7f8ed5200640 1 -- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0102790 msgr2=0x7f8ed019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.766+0000 7f8ed5200640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0102790 0x7f8ed019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.766+0000 7f8ed5200640 1 -- 172.21.15.38:0/1853382156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed019f5e0 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.766+0000 7f8ed5200640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0101de0 0x7f8ed019a630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4004770 tx=0x7f8ec4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.768+0000 7f8ecd600640 1 -- 172.21.15.38:0/1853382156 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec403f070 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.768+0000 7f8ecd600640 1 -- 172.21.15.38:0/1853382156 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ec4031ca0 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.768+0000 7f8ecd600640 1 -- 172.21.15.38:0/1853382156 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4035030 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.768+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed019f870 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.768+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed019fd00 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.769+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed01021c0 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.771+0000 7f8ecd600640 1 -- 172.21.15.38:0/1853382156 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8ec4042070 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.772+0000 7f8ecd600640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8eb80a2c00 0x7f8eb80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.772+0000 7f8ecd600640 1 -- 172.21.15.38:0/1853382156 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f8ec40ef180 con 0x7f8ed0101de0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.772+0000 7f8ecfe00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8eb80a2c00 0x7f8eb80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.773+0000 7f8ecfe00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8eb80a2c00 0x7f8eb80a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ed010ee50 tx=0x7f8ebc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:07.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:07.776+0000 7f8ecd600640 1 -- 172.21.15.38:0/1853382156 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ec40bbf50 con 0x7f8ed0101de0 2024-09-12T12:22:07.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:07 smithi154 ceph-mon[35578]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:07.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:07 smithi154 ceph-mon[35578]: Deploying daemon mds.l on smithi154 2024-09-12T12:22:07.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:07 smithi038 ceph-mon[30810]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:07.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:07 smithi038 ceph-mon[30810]: Deploying daemon mds.l on smithi154 2024-09-12T12:22:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.002+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ed01a7240 con 0x7f8ed0101de0 2024-09-12T12:22:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.002+0000 7f8ecd600640 1 -- 172.21.15.38:0/1853382156 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f8ec40c0250 con 0x7f8ed0101de0 2024-09-12T12:22:08.003 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:08.003 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":1,"btime":"2024-09-12T12:14:39:913230+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T12:22:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 1 2024-09-12T12:22:08.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8eb80a2c00 msgr2=0x7f8eb80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8eb80a2c00 0x7f8eb80a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ed010ee50 tx=0x7f8ebc005f90 comp rx=0 tx=0).stop 2024-09-12T12:22:08.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0101de0 msgr2=0x7f8ed019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0101de0 0x7f8ed019a630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4004770 tx=0x7f8ec4003c10 comp rx=0 tx=0).stop 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 shutdown_connections 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8eb80a2c00 0x7f8eb80a50c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ed0106f10 0x7f8ed019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ed0102790 0x7f8ed019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 --2- 172.21.15.38:0/1853382156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed0101de0 0x7f8ed019a630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 >> 172.21.15.38:0/1853382156 conn(0x7f8ed00fd8c0 msgr2=0x7f8ed00ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 shutdown_connections 2024-09-12T12:22:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:08.005+0000 7f8ed7c00640 1 -- 172.21.15.38:0/1853382156 wait complete. 2024-09-12T12:22:08.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:07 smithi071 ceph-mon[34859]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:08.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:07 smithi071 ceph-mon[34859]: Deploying daemon mds.l on smithi154 2024-09-12T12:22:08.343 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 systemd[1]: Starting Ceph mds.l for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:08.621 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 podman[65406]: 2024-09-12 12:22:08.245724746 +0000 UTC m=+0.015745374 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:08.621 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 podman[65406]: 2024-09-12 12:22:08.366005393 +0000 UTC m=+0.136026062 container create 441e1918bc5bb413ac9b1d6b1bd96de6a4deedd5ff664dafa20f17c3ffc386df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T12:22:08.621 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 podman[65406]: 2024-09-12 12:22:08.621984996 +0000 UTC m=+0.392005625 container init 441e1918bc5bb413ac9b1d6b1bd96de6a4deedd5ff664dafa20f17c3ffc386df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T12:22:08.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1853382156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6832/632951998,v1:172.21.15.154:6833/632951998] up:boot 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: fsmap 1 up:standby 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.917 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 podman[65406]: 2024-09-12 12:22:08.624725096 +0000 UTC m=+0.394745730 container start 441e1918bc5bb413ac9b1d6b1bd96de6a4deedd5ff664dafa20f17c3ffc386df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T12:22:08.918 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-mds[65425]: -- 172.21.15.154:0/2612125239 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fee42ad860 con 0x55fee428a800 2024-09-12T12:22:08.918 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l[65421]: starting mds.l at 2024-09-12T12:22:08.918 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 bash[65406]: 441e1918bc5bb413ac9b1d6b1bd96de6a4deedd5ff664dafa20f17c3ffc386df 2024-09-12T12:22:08.918 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:22:08 smithi154 systemd[1]: Started Ceph mds.l for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:09.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1853382156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:09.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6832/632951998,v1:172.21.15.154:6833/632951998] up:boot 2024-09-12T12:22:09.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: fsmap 1 up:standby 2024-09-12T12:22:09.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:22:09.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:09.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:09.171 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:09.172 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:09.172 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:09.172 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:08 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1853382156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6832/632951998,v1:172.21.15.154:6833/632951998] up:boot 2024-09-12T12:22:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: fsmap 1 up:standby 2024-09-12T12:22:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:22:09.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:09.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:09.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:09.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:09.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:09.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:08 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:10.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:09 smithi154 ceph-mon[35578]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:10.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:09 smithi154 ceph-mon[35578]: Deploying daemon mds.k on smithi071 2024-09-12T12:22:10.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:09 smithi038 ceph-mon[30810]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:10.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:09 smithi038 ceph-mon[30810]: Deploying daemon mds.k on smithi071 2024-09-12T12:22:10.253 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:09 smithi071 ceph-mon[34859]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:10.254 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:09 smithi071 ceph-mon[34859]: Deploying daemon mds.k on smithi071 2024-09-12T12:22:10.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:11.014 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:10 smithi071 systemd[1]: Starting Ceph mds.k for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:11.277 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:11.291 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 podman[64322]: 2024-09-12 12:22:10.928450126 +0000 UTC m=+0.015521671 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:11.291 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 podman[64322]: 2024-09-12 12:22:11.063512763 +0000 UTC m=+0.150584354 container create 4e02d3284e69a60d45888d56806e195101a5e44c0deff9055876ea6f7019cbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T12:22:11.291 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 podman[64322]: 2024-09-12 12:22:11.291711534 +0000 UTC m=+0.378783088 container init 4e02d3284e69a60d45888d56806e195101a5e44c0deff9055876ea6f7019cbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T12:22:11.764 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 podman[64322]: 2024-09-12 12:22:11.294736833 +0000 UTC m=+0.381808385 container start 4e02d3284e69a60d45888d56806e195101a5e44c0deff9055876ea6f7019cbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T12:22:11.764 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mds[64341]: -- 172.21.15.71:0/460070348 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3ac8ef860 con 0x55b3ac8cd000 2024-09-12T12:22:11.764 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k[64337]: starting mds.k at 2024-09-12T12:22:11.764 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 bash[64322]: 4e02d3284e69a60d45888d56806e195101a5e44c0deff9055876ea6f7019cbfc 2024-09-12T12:22:11.764 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:22:11 smithi071 systemd[1]: Started Ceph mds.k for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 -- 172.21.15.38:0/3199232983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c10e260 msgr2=0x7f2d6c110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3199232983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c10e260 0x7f2d6c110650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009be0 tx=0x7f2d6402a750 comp rx=0 tx=0).stop 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 -- 172.21.15.38:0/3199232983 shutdown_connections 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3199232983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c10e260 0x7f2d6c110650 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3199232983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d6c074ee0 0x7f2d6c10dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3199232983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0745c0 0x7f2d6c0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 -- 172.21.15.38:0/3199232983 >> 172.21.15.38:0/3199232983 conn(0x7f2d6c0fd740 msgr2=0x7f2d6c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 -- 172.21.15.38:0/3199232983 shutdown_connections 2024-09-12T12:22:11.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.844+0000 7f2d6b200640 1 -- 172.21.15.38:0/3199232983 wait complete. 2024-09-12T12:22:11.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.845+0000 7f2d6b200640 1 Processor -- start 2024-09-12T12:22:11.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.845+0000 7f2d6b200640 1 -- start start 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d6b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c0745c0 0x7f2d6c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d6b200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d6c074ee0 0x7f2d6c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d6b200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c10e260 0x7f2d6c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d6b200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c113f70 con 0x7f2d6c10e260 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d6b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c113df0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d6b200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1140f0 con 0x7f2d6c074ee0 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d69e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c0745c0 0x7f2d6c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d69e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c0745c0 0x7f2d6c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:38610/0 (socket says 172.21.15.38:38610) 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d69e00640 1 -- 172.21.15.38:0/3976816919 learned_addr learned my addr 172.21.15.38:0/3976816919 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d6a800640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c10e260 0x7f2d6c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.846+0000 7f2d69400640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d6c074ee0 0x7f2d6c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d69e00640 1 -- 172.21.15.38:0/3976816919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d6c074ee0 msgr2=0x7f2d6c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d69e00640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d6c074ee0 0x7f2d6c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d69e00640 1 -- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c10e260 msgr2=0x7f2d6c19ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d69e00640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c10e260 0x7f2d6c19ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d69e00640 1 -- 172.21.15.38:0/3976816919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c19f3e0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d69e00640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c0745c0 0x7f2d6c19a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e9c0 tx=0x7f2d5c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:11.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d62a00640 1 -- 172.21.15.38:0/3976816919 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00cde0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d62a00640 1 -- 172.21.15.38:0/3976816919 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d5c0035f0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d62a00640 1 -- 172.21.15.38:0/3976816919 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c010690 con 0x7f2d6c0745c0 2024-09-12T12:22:11.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c19f6d0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.847+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c1a6fb0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.849+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c0749a0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.850+0000 7f2d62a00640 1 -- 172.21.15.38:0/3976816919 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2d5c0037a0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.852+0000 7f2d62a00640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d500a2c00 0x7f2d500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.852+0000 7f2d62a00640 1 -- 172.21.15.38:0/3976816919 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f2d5c0ceec0 con 0x7f2d6c0745c0 2024-09-12T12:22:11.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.852+0000 7f2d69400640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d500a2c00 0x7f2d500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.853+0000 7f2d69400640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d500a2c00 0x7f2d500a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c10f5f0 tx=0x7f2d5800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:11.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:11.855+0000 7f2d62a00640 1 -- 172.21.15.38:0/3976816919 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d5c09c220 con 0x7f2d6c0745c0 2024-09-12T12:22:12.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.092+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d6c19b790 con 0x7f2d6c0745c0 2024-09-12T12:22:12.093 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:11 smithi038 ceph-mon[30810]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:12.093 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.093 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.093 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.093 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:12.093 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:12.093 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:11 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.092+0000 7f2d62a00640 1 -- 172.21.15.38:0/3976816919 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f2d5c09bb20 con 0x7f2d6c0745c0 2024-09-12T12:22:12.094 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:12.094 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":3,"btime":"2024-09-12T12:22:11:776140+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T12:22:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 3 2024-09-12T12:22:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d500a2c00 msgr2=0x7f2d500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d500a2c00 0x7f2d500a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c10f5f0 tx=0x7f2d5800b390 comp rx=0 tx=0).stop 2024-09-12T12:22:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c0745c0 msgr2=0x7f2d6c19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c0745c0 0x7f2d6c19a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e9c0 tx=0x7f2d5c00ee80 comp rx=0 tx=0).stop 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 shutdown_connections 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d500a2c00 0x7f2d500a50c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c10e260 0x7f2d6c19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d6c074ee0 0x7f2d6c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 --2- 172.21.15.38:0/3976816919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d6c0745c0 0x7f2d6c19a430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 >> 172.21.15.38:0/3976816919 conn(0x7f2d6c0fd740 msgr2=0x7f2d6c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 shutdown_connections 2024-09-12T12:22:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:12.095+0000 7f2d6b200640 1 -- 172.21.15.38:0/3976816919 wait complete. 2024-09-12T12:22:12.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:11 smithi154 ceph-mon[35578]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:12.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:12.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:12.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:11 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mon[34859]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:11 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:12.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:12 smithi038 ceph-mon[30810]: Deploying daemon mds.j on smithi038 2024-09-12T12:22:12.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:12 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6832/3768607144,v1:172.21.15.71:6833/3768607144] up:boot 2024-09-12T12:22:12.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:12 smithi038 ceph-mon[30810]: fsmap 2 up:standby 2024-09-12T12:22:12.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:12 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:22:12.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:12 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3976816919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:12 smithi071 ceph-mon[34859]: Deploying daemon mds.j on smithi038 2024-09-12T12:22:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:12 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6832/3768607144,v1:172.21.15.71:6833/3768607144] up:boot 2024-09-12T12:22:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:12 smithi071 ceph-mon[34859]: fsmap 2 up:standby 2024-09-12T12:22:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:12 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:22:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:12 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3976816919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:13.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:12 smithi154 ceph-mon[35578]: Deploying daemon mds.j on smithi038 2024-09-12T12:22:13.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:12 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6832/3768607144,v1:172.21.15.71:6833/3768607144] up:boot 2024-09-12T12:22:13.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:12 smithi154 ceph-mon[35578]: fsmap 2 up:standby 2024-09-12T12:22:13.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:12 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:22:13.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:12 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3976816919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:14.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:13 smithi071 ceph-mon[34859]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:14.132 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:13 smithi038 ceph-mon[30810]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:14.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:13 smithi154 ceph-mon[35578]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:15.117 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:14 smithi038 systemd[1]: Starting Ceph mds.j for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:15.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:15.380 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 podman[69818]: 2024-09-12 12:22:15.021508063 +0000 UTC m=+0.027622077 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:15.380 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 podman[69818]: 2024-09-12 12:22:15.1355312 +0000 UTC m=+0.141645198 container create 138e3e55a3fe0d2f8a4f9175ee6a8034a9d1d484c09c419badd569c58824152d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T12:22:15.380 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 podman[69818]: 2024-09-12 12:22:15.380683956 +0000 UTC m=+0.386797948 container init 138e3e55a3fe0d2f8a4f9175ee6a8034a9d1d484c09c419badd569c58824152d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:22:15.611 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:15.719 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 podman[69818]: 2024-09-12 12:22:15.389521183 +0000 UTC m=+0.395635182 container start 138e3e55a3fe0d2f8a4f9175ee6a8034a9d1d484c09c419badd569c58824152d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T12:22:15.719 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mds[69862]: -- 172.21.15.38:0/2356701518 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba14f43860 con 0x55ba14f20800 2024-09-12T12:22:15.720 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j[69850]: starting mds.j at 2024-09-12T12:22:15.720 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 bash[69818]: 138e3e55a3fe0d2f8a4f9175ee6a8034a9d1d484c09c419badd569c58824152d 2024-09-12T12:22:15.720 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:22:15 smithi038 systemd[1]: Started Ceph mds.j for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:16.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mon[30810]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:16.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:16.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:16.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:15 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:16.158 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:15 smithi154 ceph-mon[35578]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:16.158 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.159 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.159 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.159 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:16.159 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:16.159 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:15 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:16.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.159+0000 7f7969c00640 1 -- 172.21.15.38:0/1940539179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964112870 msgr2=0x7f7964114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:16.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.159+0000 7f7969c00640 1 --2- 172.21.15.38:0/1940539179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964112870 0x7f7964114c60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f795c009ca0 tx=0x7f795c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.160+0000 7f7969c00640 1 -- 172.21.15.38:0/1940539179 shutdown_connections 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.160+0000 7f7969c00640 1 --2- 172.21.15.38:0/1940539179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964112870 0x7f7964114c60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.160+0000 7f7969c00640 1 --2- 172.21.15.38:0/1940539179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 0x7f7964112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.160+0000 7f7969c00640 1 --2- 172.21.15.38:0/1940539179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7964076720 0x7f7964076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.160+0000 7f7969c00640 1 -- 172.21.15.38:0/1940539179 >> 172.21.15.38:0/1940539179 conn(0x7f79640ff8d0 msgr2=0x7f7964101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.160+0000 7f7969c00640 1 -- 172.21.15.38:0/1940539179 shutdown_connections 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.160+0000 7f7969c00640 1 -- 172.21.15.38:0/1940539179 wait complete. 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.161+0000 7f7969c00640 1 Processor -- start 2024-09-12T12:22:16.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.161+0000 7f7969c00640 1 -- start start 2024-09-12T12:22:16.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7969c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964076720 0x7f79641a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:16.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7969c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 0x7f79641a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:16.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7969c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7964112870 0x7f796419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:16.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7969c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7964118400 con 0x7f7964076720 2024-09-12T12:22:16.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7969c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7964118280 con 0x7f7964112870 2024-09-12T12:22:16.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7969c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7964118580 con 0x7f7964077040 2024-09-12T12:22:16.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f795b400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 0x7f79641a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:16.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7963e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964076720 0x7f79641a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f795b400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 0x7f79641a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:42186/0 (socket says 172.21.15.38:42186) 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f795b400640 1 -- 172.21.15.38:0/625224839 learned_addr learned my addr 172.21.15.38:0/625224839 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.162+0000 7f7969200640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7964112870 0x7f796419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f795b400640 1 -- 172.21.15.38:0/625224839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7964112870 msgr2=0x7f796419e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f795b400640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7964112870 0x7f796419e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f795b400640 1 -- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964076720 msgr2=0x7f79641a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f795b400640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964076720 0x7f79641a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f795b400640 1 -- 172.21.15.38:0/625224839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796419ef20 con 0x7f7964077040 2024-09-12T12:22:16.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f795b400640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 0x7f79641a4b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f794c00e9f0 tx=0x7f794c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:16.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f7961600640 1 -- 172.21.15.38:0/625224839 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c00cd80 con 0x7f7964077040 2024-09-12T12:22:16.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.164+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796419f210 con 0x7f7964077040 2024-09-12T12:22:16.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.163+0000 7f7961600640 1 -- 172.21.15.38:0/625224839 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f794c010910 con 0x7f7964077040 2024-09-12T12:22:16.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.164+0000 7f7961600640 1 -- 172.21.15.38:0/625224839 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c0188f0 con 0x7f7964077040 2024-09-12T12:22:16.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.164+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79641ab560 con 0x7f7964077040 2024-09-12T12:22:16.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.165+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7964077e60 con 0x7f7964077040 2024-09-12T12:22:16.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.167+0000 7f7961600640 1 -- 172.21.15.38:0/625224839 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f794c010ac0 con 0x7f7964077040 2024-09-12T12:22:16.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.168+0000 7f7961600640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79480a2c00 0x7f79480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:16.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.168+0000 7f7961600640 1 -- 172.21.15.38:0/625224839 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f794c0cf420 con 0x7f7964077040 2024-09-12T12:22:16.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.169+0000 7f7963e00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79480a2c00 0x7f79480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:16.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.169+0000 7f7963e00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79480a2c00 0x7f79480a50c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7954005d00 tx=0x7f795400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:16.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.170+0000 7f7961600640 1 -- 172.21.15.38:0/625224839 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f794c09c130 con 0x7f7964077040 2024-09-12T12:22:16.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:15 smithi071 ceph-mon[34859]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:16.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:16.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:16.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:16.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:15 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:16.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.397+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7964076b00 con 0x7f7964077040 2024-09-12T12:22:16.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.398+0000 7f7961600640 1 -- 172.21.15.38:0/625224839 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f7964076b00 con 0x7f7964077040 2024-09-12T12:22:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:16.398 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":4,"btime":"2024-09-12T12:22:15:796147+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T12:22:16.399 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 4 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79480a2c00 msgr2=0x7f79480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79480a2c00 0x7f79480a50c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7954005d00 tx=0x7f795400b410 comp rx=0 tx=0).stop 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 msgr2=0x7f79641a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 0x7f79641a4b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f794c00e9f0 tx=0x7f794c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 shutdown_connections 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79480a2c00 0x7f79480a50c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7964112870 0x7f796419e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7964077040 0x7f79641a4b20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 --2- 172.21.15.38:0/625224839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7964076720 0x7f79641a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:16.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 >> 172.21.15.38:0/625224839 conn(0x7f79640ff8d0 msgr2=0x7f7964101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:16.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.400+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 shutdown_connections 2024-09-12T12:22:16.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:16.401+0000 7f7969c00640 1 -- 172.21.15.38:0/625224839 wait complete. 2024-09-12T12:22:16.963 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:16 smithi038 ceph-mon[30810]: Deploying daemon mds.d on smithi038 2024-09-12T12:22:16.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:16 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.38:6834/675820097,v1:172.21.15.38:6835/675820097] up:boot 2024-09-12T12:22:16.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:16 smithi038 ceph-mon[30810]: fsmap 3 up:standby 2024-09-12T12:22:16.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:16 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:22:16.964 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:16 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/625224839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:17.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:16 smithi071 ceph-mon[34859]: Deploying daemon mds.d on smithi038 2024-09-12T12:22:17.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:16 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.38:6834/675820097,v1:172.21.15.38:6835/675820097] up:boot 2024-09-12T12:22:17.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:16 smithi071 ceph-mon[34859]: fsmap 3 up:standby 2024-09-12T12:22:17.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:16 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:22:17.166 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:16 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/625224839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:17.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:16 smithi154 ceph-mon[35578]: Deploying daemon mds.d on smithi038 2024-09-12T12:22:17.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:16 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.38:6834/675820097,v1:172.21.15.38:6835/675820097] up:boot 2024-09-12T12:22:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:16 smithi154 ceph-mon[35578]: fsmap 3 up:standby 2024-09-12T12:22:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:16 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:22:17.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:16 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/625224839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:17.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:17 smithi038 ceph-mon[30810]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:18.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:17 smithi154 ceph-mon[35578]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:18.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:17 smithi071 ceph-mon[34859]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:19.348 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:19.364 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 systemd[1]: Starting Ceph mds.d for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:19.645 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 podman[70224]: 2024-09-12 12:22:19.267510734 +0000 UTC m=+0.027727309 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:19.645 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 podman[70224]: 2024-09-12 12:22:19.383777998 +0000 UTC m=+0.143994562 container create 970ee6ccd4e6d54b8ae309582c63567a6174c1ba2f301d0d58efc26003e99841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T12:22:19.968 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:20.111 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:19 smithi038 ceph-mon[30810]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:20.111 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 podman[70224]: 2024-09-12 12:22:19.786903333 +0000 UTC m=+0.547119897 container init 970ee6ccd4e6d54b8ae309582c63567a6174c1ba2f301d0d58efc26003e99841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:22:20.112 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 podman[70224]: 2024-09-12 12:22:19.794819925 +0000 UTC m=+0.555036492 container start 970ee6ccd4e6d54b8ae309582c63567a6174c1ba2f301d0d58efc26003e99841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T12:22:20.112 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 ceph-mds[70283]: -- 172.21.15.38:0/3840357489 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571b680f860 con 0x5571b67ed000 2024-09-12T12:22:20.112 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d[70269]: starting mds.d at 2024-09-12T12:22:20.112 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 bash[70224]: 970ee6ccd4e6d54b8ae309582c63567a6174c1ba2f301d0d58efc26003e99841 2024-09-12T12:22:20.112 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:22:19 smithi038 systemd[1]: Started Ceph mds.d for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:20.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:19 smithi154 ceph-mon[35578]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:20.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:19 smithi071 ceph-mon[34859]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 -- 172.21.15.38:0/4156275950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074f40 msgr2=0x7f48f410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 --2- 172.21.15.38:0/4156275950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074f40 0x7f48f410de80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009900 tx=0x7f48dc02a480 comp rx=0 tx=0).stop 2024-09-12T12:22:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 -- 172.21.15.38:0/4156275950 shutdown_connections 2024-09-12T12:22:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 --2- 172.21.15.38:0/4156275950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f410e3c0 0x7f48f4110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 --2- 172.21.15.38:0/4156275950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074f40 0x7f48f410de80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 --2- 172.21.15.38:0/4156275950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f4074620 0x7f48f4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 -- 172.21.15.38:0/4156275950 >> 172.21.15.38:0/4156275950 conn(0x7f48f40fd8c0 msgr2=0x7f48f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 -- 172.21.15.38:0/4156275950 shutdown_connections 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.522+0000 7f48f8c00640 1 -- 172.21.15.38:0/4156275950 wait complete. 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 Processor -- start 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 -- start start 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074620 0x7f48f419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f4074f40 0x7f48f419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f410e3c0 0x7f48f419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4114190 con 0x7f48f4074f40 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4114010 con 0x7f48f4074620 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.523+0000 7f48f8c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4114310 con 0x7f48f410e3c0 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074620 0x7f48f419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074620 0x7f48f419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57286/0 (socket says 172.21.15.38:57286) 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 -- 172.21.15.38:0/2762469794 learned_addr learned my addr 172.21.15.38:0/2762469794 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48e9400640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f4074f40 0x7f48f419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f2800640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f410e3c0 0x7f48f419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 -- 172.21.15.38:0/2762469794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f410e3c0 msgr2=0x7f48f419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f410e3c0 0x7f48f419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 -- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f4074f40 msgr2=0x7f48f419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f4074f40 0x7f48f419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 -- 172.21.15.38:0/2762469794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f419f620 con 0x7f48f4074620 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.524+0000 7f48f1e00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074620 0x7f48f419a670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48e400d950 tx=0x7f48e400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.525+0000 7f48eb400640 1 -- 172.21.15.38:0/2762469794 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4017030 con 0x7f48f4074620 2024-09-12T12:22:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.525+0000 7f48eb400640 1 -- 172.21.15.38:0/2762469794 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e4004020 con 0x7f48f4074620 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.525+0000 7f48eb400640 1 -- 172.21.15.38:0/2762469794 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40047a0 con 0x7f48f4074620 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.525+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f419f910 con 0x7f48f4074620 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.525+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f41a71f0 con 0x7f48f4074620 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.526+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f4074a00 con 0x7f48f4074620 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.528+0000 7f48eb400640 1 -- 172.21.15.38:0/2762469794 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f48e40041d0 con 0x7f48f4074620 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.529+0000 7f48eb400640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48d80a2c00 0x7f48d80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.529+0000 7f48eb400640 1 -- 172.21.15.38:0/2762469794 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f48e40ce7a0 con 0x7f48f4074620 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.529+0000 7f48e9400640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48d80a2c00 0x7f48d80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.530+0000 7f48e9400640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48d80a2c00 0x7f48d80a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48dc000c00 tx=0x7f48dc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.531+0000 7f48eb400640 1 -- 172.21.15.38:0/2762469794 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48e409bb80 con 0x7f48f4074620 2024-09-12T12:22:20.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.751+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48f419b9d0 con 0x7f48f4074620 2024-09-12T12:22:20.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.752+0000 7f48eb400640 1 -- 172.21.15.38:0/2762469794 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f48e409b480 con 0x7f48f4074620 2024-09-12T12:22:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:20.752 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":4,"btime":"2024-09-12T12:22:15:796147+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T12:22:20.752 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 4 2024-09-12T12:22:20.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48d80a2c00 msgr2=0x7f48d80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:20.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48d80a2c00 0x7f48d80a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48dc000c00 tx=0x7f48dc005b50 comp rx=0 tx=0).stop 2024-09-12T12:22:20.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074620 msgr2=0x7f48f419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:20.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074620 0x7f48f419a670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48e400d950 tx=0x7f48e400de10 comp rx=0 tx=0).stop 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 shutdown_connections 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48d80a2c00 0x7f48d80a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f410e3c0 0x7f48f419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f4074f40 0x7f48f419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 --2- 172.21.15.38:0/2762469794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f4074620 0x7f48f419a670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 >> 172.21.15.38:0/2762469794 conn(0x7f48f40fd8c0 msgr2=0x7f48f40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 shutdown_connections 2024-09-12T12:22:20.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:20.755+0000 7f48f8c00640 1 -- 172.21.15.38:0/2762469794 wait complete. 2024-09-12T12:22:21.104 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.104 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.104 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.104 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:21.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:21.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:21.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: Deploying daemon mds.e on smithi071 2024-09-12T12:22:21.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2762469794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:21.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.38:6836/3190889999,v1:172.21.15.38:6837/3190889999] up:boot 2024-09-12T12:22:21.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: fsmap 4 up:standby 2024-09-12T12:22:21.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:20 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:22:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: Deploying daemon mds.e on smithi071 2024-09-12T12:22:21.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2762469794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:21.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.38:6836/3190889999,v1:172.21.15.38:6837/3190889999] up:boot 2024-09-12T12:22:21.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: fsmap 4 up:standby 2024-09-12T12:22:21.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:20 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: Deploying daemon mds.e on smithi071 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2762469794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.38:6836/3190889999,v1:172.21.15.38:6837/3190889999] up:boot 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: fsmap 4 up:standby 2024-09-12T12:22:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:20 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:22:22.228 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:21 smithi071 ceph-mon[34859]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:22.229 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 systemd[1]: Starting Ceph mds.e for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:22.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:21 smithi154 ceph-mon[35578]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:22.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:21 smithi038 ceph-mon[30810]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:22.507 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 podman[64633]: 2024-09-12 12:22:22.129442591 +0000 UTC m=+0.015440200 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:22.507 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 podman[64633]: 2024-09-12 12:22:22.245422349 +0000 UTC m=+0.131419942 container create d0c09cffebc90bcb106e75b8025a48ec8b3039d58f116742b554771642be7289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T12:22:22.507 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 podman[64633]: 2024-09-12 12:22:22.507172377 +0000 UTC m=+0.393169973 container init d0c09cffebc90bcb106e75b8025a48ec8b3039d58f116742b554771642be7289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T12:22:22.764 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 podman[64633]: 2024-09-12 12:22:22.510105334 +0000 UTC m=+0.396102941 container start d0c09cffebc90bcb106e75b8025a48ec8b3039d58f116742b554771642be7289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T12:22:22.764 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 ceph-mds[64653]: -- 172.21.15.71:0/3924368772 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5639e8ed5860 con 0x5639e8eb2800 2024-09-12T12:22:22.764 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e[64649]: starting mds.e at 2024-09-12T12:22:22.764 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 bash[64633]: d0c09cffebc90bcb106e75b8025a48ec8b3039d58f116742b554771642be7289 2024-09-12T12:22:22.764 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:22:22 smithi071 systemd[1]: Started Ceph mds.e for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:23.475 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: Deploying daemon mds.f on smithi154 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6834/2977480232,v1:172.21.15.71:6835/2977480232] up:boot 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: fsmap 5 up:standby 2024-09-12T12:22:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:23 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:22:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:23.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: Deploying daemon mds.f on smithi154 2024-09-12T12:22:23.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6834/2977480232,v1:172.21.15.71:6835/2977480232] up:boot 2024-09-12T12:22:23.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: fsmap 5 up:standby 2024-09-12T12:22:23.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:23 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:22:24.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:24.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:24.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:24.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:24.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:24.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:24.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:24.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: Deploying daemon mds.f on smithi154 2024-09-12T12:22:24.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6834/2977480232,v1:172.21.15.71:6835/2977480232] up:boot 2024-09-12T12:22:24.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: fsmap 5 up:standby 2024-09-12T12:22:24.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:23 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 -- 172.21.15.38:0/1934580498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b4103e30 msgr2=0x7f27b4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 --2- 172.21.15.38:0/1934580498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b4103e30 0x7f27b4104210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009900 tx=0x7f27a402a410 comp rx=0 tx=0).stop 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 -- 172.21.15.38:0/1934580498 shutdown_connections 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 --2- 172.21.15.38:0/1934580498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b4108f60 0x7f27b4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 --2- 172.21.15.38:0/1934580498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b41047e0 0x7f27b4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 --2- 172.21.15.38:0/1934580498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b4103e30 0x7f27b4104210 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 -- 172.21.15.38:0/1934580498 >> 172.21.15.38:0/1934580498 conn(0x7f27b40ff910 msgr2=0x7f27b4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 -- 172.21.15.38:0/1934580498 shutdown_connections 2024-09-12T12:22:24.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.428+0000 7f27b3200640 1 -- 172.21.15.38:0/1934580498 wait complete. 2024-09-12T12:22:24.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 Processor -- start 2024-09-12T12:22:24.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 -- start start 2024-09-12T12:22:24.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b4103e30 0x7f27b419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:24.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b41047e0 0x7f27b419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b4108f60 0x7f27b419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f27b4113fc0 con 0x7f27b41047e0 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27b4113e40 con 0x7f27b4103e30 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.429+0000 7f27b3200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27b4114140 con 0x7f27b4108f60 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b4103e30 0x7f27b419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b41047e0 0x7f27b419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b4103e30 0x7f27b419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57314/0 (socket says 172.21.15.38:57314) 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1e00640 1 -- 172.21.15.38:0/2511348994 learned_addr learned my addr 172.21.15.38:0/2511348994 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b2800640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b4108f60 0x7f27b419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1400640 1 -- 172.21.15.38:0/2511348994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b4108f60 msgr2=0x7f27b419edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1400640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b4108f60 0x7f27b419edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1400640 1 -- 172.21.15.38:0/2511348994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b4103e30 msgr2=0x7f27b419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1400640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b4103e30 0x7f27b419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1400640 1 -- 172.21.15.38:0/2511348994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b419f490 con 0x7f27b41047e0 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1e00640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b4103e30 0x7f27b419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.430+0000 7f27b1400640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b41047e0 0x7f27b419aa20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f27a000e9f0 tx=0x7f27a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.431+0000 7f27aaa00640 1 -- 172.21.15.38:0/2511348994 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a000ccc0 con 0x7f27b41047e0 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.431+0000 7f27aaa00640 1 -- 172.21.15.38:0/2511348994 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a0010910 con 0x7f27b41047e0 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.431+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b419f780 con 0x7f27b41047e0 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.431+0000 7f27aaa00640 1 -- 172.21.15.38:0/2511348994 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0018800 con 0x7f27b41047e0 2024-09-12T12:22:24.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.431+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b41a7060 con 0x7f27b41047e0 2024-09-12T12:22:24.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.432+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b4105310 con 0x7f27b41047e0 2024-09-12T12:22:24.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.435+0000 7f27aaa00640 1 -- 172.21.15.38:0/2511348994 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f27a0010ac0 con 0x7f27b41047e0 2024-09-12T12:22:24.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.436+0000 7f27aaa00640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f27980a2b80 0x7f27980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:24.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.436+0000 7f27aaa00640 1 -- 172.21.15.38:0/2511348994 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f27a00cef40 con 0x7f27b41047e0 2024-09-12T12:22:24.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.436+0000 7f27b1e00640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f27980a2b80 0x7f27980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:24.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.437+0000 7f27b1e00640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f27980a2b80 0x7f27980a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27a40096c0 tx=0x7f27a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.440+0000 7f27aaa00640 1 -- 172.21.15.38:0/2511348994 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27a009c2a0 con 0x7f27b41047e0 2024-09-12T12:22:24.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.662+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27b402d7c0 con 0x7f27b41047e0 2024-09-12T12:22:24.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.663+0000 7f27aaa00640 1 -- 172.21.15.38:0/2511348994 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7f27a009bba0 con 0x7f27b41047e0 2024-09-12T12:22:24.663 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:24.663 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"btime":"2024-09-12T12:22:22:996618+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T12:22:24.663 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-09-12T12:22:24.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f27980a2b80 msgr2=0x7f27980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:24.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f27980a2b80 0x7f27980a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27a40096c0 tx=0x7f27a4005a20 comp rx=0 tx=0).stop 2024-09-12T12:22:24.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b41047e0 msgr2=0x7f27b419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:24.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b41047e0 0x7f27b419aa20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f27a000e9f0 tx=0x7f27a000edf0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 shutdown_connections 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f27980a2b80 0x7f27980a5040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b4108f60 0x7f27b419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27b41047e0 0x7f27b419aa20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 --2- 172.21.15.38:0/2511348994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b4103e30 0x7f27b419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 >> 172.21.15.38:0/2511348994 conn(0x7f27b40ff910 msgr2=0x7f27b4100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 shutdown_connections 2024-09-12T12:22:24.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:24.665+0000 7f27b3200640 1 -- 172.21.15.38:0/2511348994 wait complete. 2024-09-12T12:22:24.667 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:24 smithi154 systemd[1]: Starting Ceph mds.f for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:25.034 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:24 smithi154 podman[65711]: 2024-09-12 12:22:24.657449944 +0000 UTC m=+0.016457520 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:25.035 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:24 smithi154 podman[65711]: 2024-09-12 12:22:24.782423538 +0000 UTC m=+0.141431123 container create 3d8d71f6c61013edafc700e555ab1810cfa99a47d59f6050e45bf276ea0b2ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T12:22:25.035 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:25 smithi154 podman[65711]: 2024-09-12 12:22:25.035314363 +0000 UTC m=+0.394321939 container init 3d8d71f6c61013edafc700e555ab1810cfa99a47d59f6050e45bf276ea0b2ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T12:22:25.416 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:25 smithi154 podman[65711]: 2024-09-12 12:22:25.038211714 +0000 UTC m=+0.397219298 container start 3d8d71f6c61013edafc700e555ab1810cfa99a47d59f6050e45bf276ea0b2ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T12:22:25.417 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mds[65730]: -- 172.21.15.154:0/2506768575 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b0f9d5860 con 0x555b0f9b2800 2024-09-12T12:22:25.417 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f[65726]: starting mds.f at 2024-09-12T12:22:25.417 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:25 smithi154 bash[65711]: 3d8d71f6c61013edafc700e555ab1810cfa99a47d59f6050e45bf276ea0b2ba7 2024-09-12T12:22:25.417 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:22:25 smithi154 systemd[1]: Started Ceph mds.f for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:25.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:25.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2511348994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:25.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:25.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:25.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:25.898 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:25.898 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:25.898 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:25 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2511348994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:25.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:25 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2511348994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:25 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:26.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:26 smithi154 ceph-mon[35578]: Deploying daemon mds.c on smithi154 2024-09-12T12:22:26.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:26 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] up:boot 2024-09-12T12:22:26.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:26 smithi154 ceph-mon[35578]: fsmap 6 up:standby 2024-09-12T12:22:26.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:26 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:22:26.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:26 smithi038 ceph-mon[30810]: Deploying daemon mds.c on smithi154 2024-09-12T12:22:26.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:26 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] up:boot 2024-09-12T12:22:26.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:26 smithi038 ceph-mon[30810]: fsmap 6 up:standby 2024-09-12T12:22:26.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:26 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:22:27.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:26 smithi071 ceph-mon[34859]: Deploying daemon mds.c on smithi154 2024-09-12T12:22:27.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:26 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] up:boot 2024-09-12T12:22:27.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:26 smithi071 ceph-mon[34859]: fsmap 6 up:standby 2024-09-12T12:22:27.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:26 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:22:27.277 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 systemd[1]: Starting Ceph mds.c for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:27.394 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:27.529 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 podman[66014]: 2024-09-12 12:22:27.289820402 +0000 UTC m=+0.016546629 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:27.529 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 podman[66014]: 2024-09-12 12:22:27.396483105 +0000 UTC m=+0.123209373 container create b87446bf47763e3f556526eae1396da3d7e46b0fbc2e33692a22cac6d2d35d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T12:22:27.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:27 smithi038 ceph-mon[30810]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:27.776 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:27.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:27 smithi154 ceph-mon[35578]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:27.917 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 podman[66014]: 2024-09-12 12:22:27.659923469 +0000 UTC m=+0.386649697 container init b87446bf47763e3f556526eae1396da3d7e46b0fbc2e33692a22cac6d2d35d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T12:22:27.917 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 podman[66014]: 2024-09-12 12:22:27.662845286 +0000 UTC m=+0.389571522 container start b87446bf47763e3f556526eae1396da3d7e46b0fbc2e33692a22cac6d2d35d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T12:22:27.917 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c[66029]: starting mds.c at 2024-09-12T12:22:27.917 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 bash[66014]: b87446bf47763e3f556526eae1396da3d7e46b0fbc2e33692a22cac6d2d35d3b 2024-09-12T12:22:27.917 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:22:27 smithi154 systemd[1]: Started Ceph mds.c for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:28.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:27 smithi071 ceph-mon[34859]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:28.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 -- 172.21.15.38:0/2030448699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8112870 msgr2=0x7f75f8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:28.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 --2- 172.21.15.38:0/2030448699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8112870 0x7f75f8114c60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009ca0 tx=0x7f75f002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 -- 172.21.15.38:0/2030448699 shutdown_connections 2024-09-12T12:22:28.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 --2- 172.21.15.38:0/2030448699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8112870 0x7f75f8114c60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 --2- 172.21.15.38:0/2030448699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75f8077040 0x7f75f8112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 --2- 172.21.15.38:0/2030448699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 0x7f75f8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 -- 172.21.15.38:0/2030448699 >> 172.21.15.38:0/2030448699 conn(0x7f75f80ff8d0 msgr2=0x7f75f8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 -- 172.21.15.38:0/2030448699 shutdown_connections 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.430+0000 7f75f7200640 1 -- 172.21.15.38:0/2030448699 wait complete. 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.431+0000 7f75f7200640 1 Processor -- start 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.431+0000 7f75f7200640 1 -- start start 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 0x7f75f81a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f7200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8077040 0x7f75f81a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75f8112870 0x7f75f819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f7200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f75f8118410 con 0x7f75f8077040 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75f8118290 con 0x7f75f8112870 2024-09-12T12:22:28.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f7200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f75f8118590 con 0x7f75f8076720 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 0x7f75f81a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75ed400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8077040 0x7f75f81a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 0x7f75f81a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52696/0 (socket says 172.21.15.38:52696) 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 -- 172.21.15.38:0/255859340 learned_addr learned my addr 172.21.15.38:0/255859340 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75f8112870 0x7f75f819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 -- 172.21.15.38:0/255859340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75f8112870 msgr2=0x7f75f819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75f8112870 0x7f75f819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 -- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8077040 msgr2=0x7f75f81a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8077040 0x7f75f81a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.432+0000 7f75f5e00640 1 -- 172.21.15.38:0/255859340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f819ef30 con 0x7f75f8076720 2024-09-12T12:22:28.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.433+0000 7f75f5e00640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 0x7f75f81a45f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75e800e9f0 tx=0x7f75e800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.433+0000 7f75ef400640 1 -- 172.21.15.38:0/255859340 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e800cd80 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.433+0000 7f75ef400640 1 -- 172.21.15.38:0/255859340 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75e8005500 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.433+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f819f220 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.433+0000 7f75ef400640 1 -- 172.21.15.38:0/255859340 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8010690 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.433+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f81ab3a0 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.434+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f8077e60 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.436+0000 7f75ef400640 1 -- 172.21.15.38:0/255859340 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f75e80046c0 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.437+0000 7f75ef400640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f75dc0a2b80 0x7f75dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.437+0000 7f75ef400640 1 -- 172.21.15.38:0/255859340 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f75e80cefe0 con 0x7f75f8076720 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.438+0000 7f75ed400640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f75dc0a2b80 0x7f75dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.438+0000 7f75ed400640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f75dc0a2b80 0x7f75dc0a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75f819ff10 tx=0x7f75e000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:28.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.441+0000 7f75ef400640 1 -- 172.21.15.38:0/255859340 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75e809c380 con 0x7f75f8076720 2024-09-12T12:22:28.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.663+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75f81ab630 con 0x7f75f8076720 2024-09-12T12:22:28.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.663+0000 7f75ef400640 1 -- 172.21.15.38:0/255859340 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7f75e809bc80 con 0x7f75f8076720 2024-09-12T12:22:28.664 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:28.664 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"btime":"2024-09-12T12:22:25:658631+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-12T12:22:28.664 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2024-09-12T12:22:28.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f75dc0a2b80 msgr2=0x7f75dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f75dc0a2b80 0x7f75dc0a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75f819ff10 tx=0x7f75e000b410 comp rx=0 tx=0).stop 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 msgr2=0x7f75f81a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 0x7f75f81a45f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75e800e9f0 tx=0x7f75e800edf0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 shutdown_connections 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f75dc0a2b80 0x7f75dc0a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75f8112870 0x7f75f819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f75f8077040 0x7f75f81a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 --2- 172.21.15.38:0/255859340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75f8076720 0x7f75f81a45f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 >> 172.21.15.38:0/255859340 conn(0x7f75f80ff8d0 msgr2=0x7f75f8101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 shutdown_connections 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:28.666+0000 7f75f7200640 1 -- 172.21.15.38:0/255859340 wait complete. 2024-09-12T12:22:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:28.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: Deploying daemon mds.h on smithi071 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/255859340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] up:boot 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: fsmap 7 up:standby 2024-09-12T12:22:28.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:28 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: Deploying daemon mds.h on smithi071 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/255859340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] up:boot 2024-09-12T12:22:29.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: fsmap 7 up:standby 2024-09-12T12:22:29.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:28 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:22:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:29.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: Deploying daemon mds.h on smithi071 2024-09-12T12:22:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/255859340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] up:boot 2024-09-12T12:22:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: fsmap 7 up:standby 2024-09-12T12:22:29.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:28 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:22:30.000 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:29 smithi071 ceph-mon[34859]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:30.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:29 smithi154 ceph-mon[35578]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:30.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:29 smithi038 ceph-mon[30810]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:30.764 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:22:30 smithi071 systemd[1]: Started Ceph mds.h for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:31.536 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:31.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:31.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:31.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:31.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:31.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: Deploying daemon mds.i on smithi154 2024-09-12T12:22:31.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] up:boot 2024-09-12T12:22:31.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: fsmap 8 up:standby 2024-09-12T12:22:31.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:31 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:22:31.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: Deploying daemon mds.i on smithi154 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] up:boot 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: fsmap 8 up:standby 2024-09-12T12:22:31.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:31 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:31.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: Deploying daemon mds.i on smithi154 2024-09-12T12:22:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] up:boot 2024-09-12T12:22:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: fsmap 8 up:standby 2024-09-12T12:22:31.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:31 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:22:31.926 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 -- 172.21.15.38:0/4197576552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8109140 msgr2=0x7f9af8110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 --2- 172.21.15.38:0/4197576552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8109140 0x7f9af8110cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009ca0 tx=0x7f9af402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 -- 172.21.15.38:0/4197576552 shutdown_connections 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 --2- 172.21.15.38:0/4197576552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8109140 0x7f9af8110cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 --2- 172.21.15.38:0/4197576552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9af81049c0 0x7f9af8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 --2- 172.21.15.38:0/4197576552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9af8104010 0x7f9af81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 -- 172.21.15.38:0/4197576552 >> 172.21.15.38:0/4197576552 conn(0x7f9af80ffa50 msgr2=0x7f9af8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 -- 172.21.15.38:0/4197576552 shutdown_connections 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.447+0000 7f9b00800640 1 -- 172.21.15.38:0/4197576552 wait complete. 2024-09-12T12:22:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.448+0000 7f9b00800640 1 Processor -- start 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.448+0000 7f9b00800640 1 -- start start 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.448+0000 7f9b00800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8104010 0x7f9af819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.448+0000 7f9b00800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9af81049c0 0x7f9af819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.448+0000 7f9b00800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9af8109140 0x7f9af819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9b00800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9af81141c0 con 0x7f9af8104010 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9b00800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9af8114040 con 0x7f9af81049c0 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9b00800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9af8114340 con 0x7f9af8109140 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afde00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8104010 0x7f9af819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afde00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8104010 0x7f9af819a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54790/0 (socket says 172.21.15.38:54790) 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afde00640 1 -- 172.21.15.38:0/1456416579 learned_addr learned my addr 172.21.15.38:0/1456416579 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afe800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9af8109140 0x7f9af819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afd400640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9af81049c0 0x7f9af819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afe800640 1 -- 172.21.15.38:0/1456416579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9af81049c0 msgr2=0x7f9af819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afe800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9af81049c0 0x7f9af819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afe800640 1 -- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8104010 msgr2=0x7f9af819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afe800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8104010 0x7f9af819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.449+0000 7f9afe800640 1 -- 172.21.15.38:0/1456416579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af819f670 con 0x7f9af8109140 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.450+0000 7f9afe800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9af8109140 0x7f9af819ef90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005e30 tx=0x7f9af4003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.450+0000 7f9af2a00640 1 -- 172.21.15.38:0/1456416579 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4031650 con 0x7f9af8109140 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.450+0000 7f9af2a00640 1 -- 172.21.15.38:0/1456416579 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9af40317f0 con 0x7f9af8109140 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.450+0000 7f9af2a00640 1 -- 172.21.15.38:0/1456416579 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af402fa30 con 0x7f9af8109140 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.450+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af819f900 con 0x7f9af8109140 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.450+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af81a7240 con 0x7f9af8109140 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.451+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af81054f0 con 0x7f9af8109140 2024-09-12T12:22:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.453+0000 7f9af2a00640 1 -- 172.21.15.38:0/1456416579 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9af402fbd0 con 0x7f9af8109140 2024-09-12T12:22:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.454+0000 7f9af2a00640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9ae00a2b80 0x7f9ae00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.454+0000 7f9af2a00640 1 -- 172.21.15.38:0/1456416579 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f9af40efef0 con 0x7f9af8109140 2024-09-12T12:22:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.454+0000 7f9afde00640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9ae00a2b80 0x7f9ae00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.455+0000 7f9afde00640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9ae00a2b80 0x7f9ae00a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9aec005fd0 tx=0x7f9aec00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.458+0000 7f9af2a00640 1 -- 172.21.15.38:0/1456416579 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9af40319a0 con 0x7f9af8109140 2024-09-12T12:22:32.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.678+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9af810c380 con 0x7f9af8109140 2024-09-12T12:22:32.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.679+0000 7f9af2a00640 1 -- 172.21.15.38:0/1456416579 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7f9af40bd370 con 0x7f9af8109140 2024-09-12T12:22:32.680 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:32.680 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":9,"btime":"2024-09-12T12:22:30:829553+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T12:22:32.680 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 9 2024-09-12T12:22:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9ae00a2b80 msgr2=0x7f9ae00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9ae00a2b80 0x7f9ae00a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9aec005fd0 tx=0x7f9aec00b480 comp rx=0 tx=0).stop 2024-09-12T12:22:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9af8109140 msgr2=0x7f9af819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9af8109140 0x7f9af819ef90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005e30 tx=0x7f9af4003f10 comp rx=0 tx=0).stop 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 shutdown_connections 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9ae00a2b80 0x7f9ae00a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9af8109140 0x7f9af819ef90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9af81049c0 0x7f9af819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 --2- 172.21.15.38:0/1456416579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9af8104010 0x7f9af819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 >> 172.21.15.38:0/1456416579 conn(0x7f9af80ffa50 msgr2=0x7f9af8100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 shutdown_connections 2024-09-12T12:22:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:32.682+0000 7f9b00800640 1 -- 172.21.15.38:0/1456416579 wait complete. 2024-09-12T12:22:33.417 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:22:33 smithi154 systemd[1]: Started Ceph mds.i for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:33.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:33.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1456416579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:33.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:33.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:33.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:33 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:33.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:33.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1456416579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:33.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:33.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:33.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:33 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1456416579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:33.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:33 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:34.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:34 smithi038 ceph-mon[30810]: Deploying daemon mds.g on smithi038 2024-09-12T12:22:34.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:34 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] up:boot 2024-09-12T12:22:34.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:34 smithi038 ceph-mon[30810]: fsmap 9 up:standby 2024-09-12T12:22:34.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:22:34.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:34 smithi071 ceph-mon[34859]: Deploying daemon mds.g on smithi038 2024-09-12T12:22:34.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:34 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] up:boot 2024-09-12T12:22:34.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:34 smithi071 ceph-mon[34859]: fsmap 9 up:standby 2024-09-12T12:22:34.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:22:34.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:34 smithi154 ceph-mon[35578]: Deploying daemon mds.g on smithi038 2024-09-12T12:22:34.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:34 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] up:boot 2024-09-12T12:22:34.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:34 smithi154 ceph-mon[35578]: fsmap 9 up:standby 2024-09-12T12:22:34.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:22:35.457 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:35.561 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:35 smithi038 ceph-mon[30810]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:35.763 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:35 smithi071 ceph-mon[34859]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:35.912 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:35 smithi038 systemd[1]: Starting Ceph mds.g for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:35.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:35 smithi154 ceph-mon[35578]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:36.219 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:35 smithi038 podman[71008]: 2024-09-12 12:22:35.817207909 +0000 UTC m=+0.033383105 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:36.219 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:35 smithi038 podman[71008]: 2024-09-12 12:22:35.966321508 +0000 UTC m=+0.182496703 container create f73c55f9588cebcb20f058b2853cc874178fa368fd9199432e0a86dff81aeff2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:22:36.402 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:36.546 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:36 smithi038 podman[71008]: 2024-09-12 12:22:36.244140068 +0000 UTC m=+0.460315265 container init f73c55f9588cebcb20f058b2853cc874178fa368fd9199432e0a86dff81aeff2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T12:22:36.546 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:36 smithi038 podman[71008]: 2024-09-12 12:22:36.250407901 +0000 UTC m=+0.466583108 container start f73c55f9588cebcb20f058b2853cc874178fa368fd9199432e0a86dff81aeff2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T12:22:36.546 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:36 smithi038 ceph-mds[71045]: -- 172.21.15.38:0/1823085518 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b4c3ca5860 con 0x55b4c3c82800 2024-09-12T12:22:36.546 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:36 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g[71041]: starting mds.g at 2024-09-12T12:22:36.546 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:36 smithi038 bash[71008]: f73c55f9588cebcb20f058b2853cc874178fa368fd9199432e0a86dff81aeff2 2024-09-12T12:22:36.546 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:22:36 smithi038 systemd[1]: Started Ceph mds.g for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.927+0000 7eff2f000640 1 -- 172.21.15.38:0/3010978700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074620 msgr2=0x7eff28074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.927+0000 7eff2f000640 1 --2- 172.21.15.38:0/3010978700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074620 0x7eff28074a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff18009900 tx=0x7eff1802a480 comp rx=0 tx=0).stop 2024-09-12T12:22:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.927+0000 7eff2f000640 1 -- 172.21.15.38:0/3010978700 shutdown_connections 2024-09-12T12:22:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.927+0000 7eff2f000640 1 --2- 172.21.15.38:0/3010978700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2810e3c0 0x7eff28110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.927+0000 7eff2f000640 1 --2- 172.21.15.38:0/3010978700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff28074f40 0x7eff2810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.927+0000 7eff2f000640 1 --2- 172.21.15.38:0/3010978700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074620 0x7eff28074a00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.927+0000 7eff2f000640 1 -- 172.21.15.38:0/3010978700 >> 172.21.15.38:0/3010978700 conn(0x7eff280fd8c0 msgr2=0x7eff280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.928+0000 7eff2f000640 1 -- 172.21.15.38:0/3010978700 shutdown_connections 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.928+0000 7eff2f000640 1 -- 172.21.15.38:0/3010978700 wait complete. 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.928+0000 7eff2f000640 1 Processor -- start 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2f000640 1 -- start start 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2f000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff28074620 0x7eff2819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2f000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074f40 0x7eff2819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2f000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2810e3c0 0x7eff2819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2f000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7eff281141c0 con 0x7eff28074f40 2024-09-12T12:22:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2f000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff28114040 con 0x7eff28074620 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2f000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff28114340 con 0x7eff2810e3c0 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff27400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074f40 0x7eff2819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff27400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074f40 0x7eff2819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45778/0 (socket says 172.21.15.38:45778) 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff27400640 1 -- 172.21.15.38:0/862864226 learned_addr learned my addr 172.21.15.38:0/862864226 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff27e00640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff28074620 0x7eff2819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.929+0000 7eff2d000640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2810e3c0 0x7eff2819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff27400640 1 -- 172.21.15.38:0/862864226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2810e3c0 msgr2=0x7eff2819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff27400640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2810e3c0 0x7eff2819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff27400640 1 -- 172.21.15.38:0/862864226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff28074620 msgr2=0x7eff2819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff27400640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff28074620 0x7eff2819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff27400640 1 -- 172.21.15.38:0/862864226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2819f640 con 0x7eff28074f40 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff27400640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074f40 0x7eff2819abd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7eff1400e9f0 tx=0x7eff1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff24c00640 1 -- 172.21.15.38:0/862864226 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1400cd80 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff24c00640 1 -- 172.21.15.38:0/862864226 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff14010910 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2819f930 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff24c00640 1 -- 172.21.15.38:0/862864226 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14018990 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.930+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff281a7210 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.932+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff28074a00 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.934+0000 7eff24c00640 1 -- 172.21.15.38:0/862864226 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7eff14010ac0 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.935+0000 7eff24c00640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.936+0000 7eff24c00640 1 -- 172.21.15.38:0/862864226 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7eff140ceeb0 con 0x7eff28074f40 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.936+0000 7eff27e00640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.936+0000 7eff27e00640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff18005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:36.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:36.939+0000 7eff24c00640 1 -- 172.21.15.38:0/862864226 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff1409bbc0 con 0x7eff28074f40 2024-09-12T12:22:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.186+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff2802d7c0 con 0x7eff28074f40 2024-09-12T12:22:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.187+0000 7eff24c00640 1 -- 172.21.15.38:0/862864226 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7eff1409fec0 con 0x7eff28074f40 2024-09-12T12:22:37.187 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:37.187 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":11,"btime":"2024-09-12T12:22:36:443063+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T12:22:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 11 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7eff0c0a2c00 msgr2=0x7eff0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff18005b50 comp rx=0 tx=0).stop 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074f40 msgr2=0x7eff2819abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074f40 0x7eff2819abd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7eff1400e9f0 tx=0x7eff1400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 shutdown_connections 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7eff0c0a2c00 0x7eff0c0a50c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2810e3c0 0x7eff2819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff28074f40 0x7eff2819abd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 --2- 172.21.15.38:0/862864226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff28074620 0x7eff2819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.189+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 >> 172.21.15.38:0/862864226 conn(0x7eff280fd8c0 msgr2=0x7eff280fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.190+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 shutdown_connections 2024-09-12T12:22:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:37.190+0000 7eff2f000640 1 -- 172.21.15.38:0/862864226 wait complete. 2024-09-12T12:22:37.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:37.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: Deploying daemon mds.a on smithi038 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.38:6838/4044590502,v1:172.21.15.38:6839/4044590502] up:boot 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: fsmap 10 up:standby 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:22:37.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:37 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/862864226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:37.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:37.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:37.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:37.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:37.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: Deploying daemon mds.a on smithi038 2024-09-12T12:22:37.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.38:6838/4044590502,v1:172.21.15.38:6839/4044590502] up:boot 2024-09-12T12:22:37.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: fsmap 10 up:standby 2024-09-12T12:22:37.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:22:37.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:37 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/862864226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:37.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: Deploying daemon mds.a on smithi038 2024-09-12T12:22:37.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.38:6838/4044590502,v1:172.21.15.38:6839/4044590502] up:boot 2024-09-12T12:22:37.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: fsmap 10 up:standby 2024-09-12T12:22:37.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:22:37.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:37 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/862864226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:39.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:39 smithi038 ceph-mon[30810]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:39.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:39 smithi071 ceph-mon[34859]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:39.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:39 smithi154 ceph-mon[35578]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:40.090 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:39 smithi038 systemd[1]: Starting Ceph mds.a for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:40.391 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 podman[71394]: 2024-09-12 12:22:39.995115485 +0000 UTC m=+0.027781233 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:40.391 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 podman[71394]: 2024-09-12 12:22:40.138867193 +0000 UTC m=+0.171532931 container create 6f950a63d34152bdc168d9e6a65f94ba58afde4c3dfd7198271db843a6afa017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T12:22:40.391 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 podman[71394]: 2024-09-12 12:22:40.391738612 +0000 UTC m=+0.424404350 container init 6f950a63d34152bdc168d9e6a65f94ba58afde4c3dfd7198271db843a6afa017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T12:22:40.627 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:40.678 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 podman[71394]: 2024-09-12 12:22:40.398220008 +0000 UTC m=+0.430885746 container start 6f950a63d34152bdc168d9e6a65f94ba58afde4c3dfd7198271db843a6afa017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T12:22:40.678 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 ceph-mds[71413]: -- 172.21.15.38:0/3728349334 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3a971bc20 con 0x55b3a96f9400 2024-09-12T12:22:40.678 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a[71409]: starting mds.a at 2024-09-12T12:22:40.678 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 bash[71394]: 6f950a63d34152bdc168d9e6a65f94ba58afde4c3dfd7198271db843a6afa017 2024-09-12T12:22:40.678 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:22:40 smithi038 systemd[1]: Started Ceph mds.a for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:41.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 -- 172.21.15.38:0/2736733777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff614109140 msgr2=0x7ff614110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 --2- 172.21.15.38:0/2736733777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff614109140 0x7ff614110cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009ca0 tx=0x7ff60c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 -- 172.21.15.38:0/2736733777 shutdown_connections 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 --2- 172.21.15.38:0/2736733777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff614109140 0x7ff614110cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 --2- 172.21.15.38:0/2736733777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6141049c0 0x7ff614108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 --2- 172.21.15.38:0/2736733777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614104010 0x7ff6141043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 -- 172.21.15.38:0/2736733777 >> 172.21.15.38:0/2736733777 conn(0x7ff6140ffa50 msgr2=0x7ff614101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 -- 172.21.15.38:0/2736733777 shutdown_connections 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.568+0000 7ff619800640 1 -- 172.21.15.38:0/2736733777 wait complete. 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.569+0000 7ff619800640 1 Processor -- start 2024-09-12T12:22:41.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.569+0000 7ff619800640 1 -- start start 2024-09-12T12:22:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff619800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614104010 0x7ff61419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff619800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141049c0 0x7ff61419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff619800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614109140 0x7ff61419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff619800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff614114170 con 0x7ff6141049c0 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff619800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff614113ff0 con 0x7ff614109140 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff619800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141142f0 con 0x7ff614104010 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff60be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141049c0 0x7ff61419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff613400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614109140 0x7ff61419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff60be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141049c0 0x7ff61419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45812/0 (socket says 172.21.15.38:45812) 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff60be00640 1 -- 172.21.15.38:0/665062643 learned_addr learned my addr 172.21.15.38:0/665062643 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff612a00640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614104010 0x7ff61419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff613400640 1 -- 172.21.15.38:0/665062643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614104010 msgr2=0x7ff61419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff613400640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614104010 0x7ff61419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff613400640 1 -- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141049c0 msgr2=0x7ff61419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff613400640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141049c0 0x7ff61419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff613400640 1 -- 172.21.15.38:0/665062643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61419f5e0 con 0x7ff614109140 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.570+0000 7ff60be00640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141049c0 0x7ff61419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.571+0000 7ff613400640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614109140 0x7ff61419ef00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff60c02ade0 tx=0x7ff60c0319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.571+0000 7ff60b400640 1 -- 172.21.15.38:0/665062643 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c003b70 con 0x7ff614109140 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.571+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61419f870 con 0x7ff614109140 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.571+0000 7ff60b400640 1 -- 172.21.15.38:0/665062643 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff60c003d10 con 0x7ff614109140 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.571+0000 7ff60b400640 1 -- 172.21.15.38:0/665062643 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c02fc40 con 0x7ff614109140 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.571+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141a71b0 con 0x7ff614109140 2024-09-12T12:22:41.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.573+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6141043f0 con 0x7ff614109140 2024-09-12T12:22:41.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.574+0000 7ff60b400640 1 -- 172.21.15.38:0/665062643 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff60c004050 con 0x7ff614109140 2024-09-12T12:22:41.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.575+0000 7ff60b400640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2b80 0x7ff5f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.575+0000 7ff60b400640 1 -- 172.21.15.38:0/665062643 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff60c0efb90 con 0x7ff614109140 2024-09-12T12:22:41.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.576+0000 7ff612a00640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2b80 0x7ff5f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.576+0000 7ff612a00640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2b80 0x7ff5f80a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff604009bd0 tx=0x7ff604005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.579+0000 7ff60b400640 1 -- 172.21.15.38:0/665062643 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff60c0bcef0 con 0x7ff614109140 2024-09-12T12:22:41.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:41.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: Deploying daemon mds.b on smithi071 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.38:6840/1563078137,v1:172.21.15.38:6841/1563078137] up:boot 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: fsmap 11 up:standby 2024-09-12T12:22:41.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:41 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:22:41.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:41.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:41.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:41.747 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:41.748 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: Deploying daemon mds.b on smithi071 2024-09-12T12:22:41.748 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.38:6840/1563078137,v1:172.21.15.38:6841/1563078137] up:boot 2024-09-12T12:22:41.748 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: fsmap 11 up:standby 2024-09-12T12:22:41.748 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:41 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:22:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.803+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff61410c380 con 0x7ff614109140 2024-09-12T12:22:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.804+0000 7ff60b400640 1 -- 172.21.15.38:0/665062643 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9689 (secure 0 0 0) 0x7ff60c0bc7f0 con 0x7ff614109140 2024-09-12T12:22:41.805 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:41.805 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":12,"btime":"2024-09-12T12:22:41:421700+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T12:22:41.805 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 12 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2b80 msgr2=0x7ff5f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2b80 0x7ff5f80a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff604009bd0 tx=0x7ff604005f90 comp rx=0 tx=0).stop 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614109140 msgr2=0x7ff61419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614109140 0x7ff61419ef00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff60c02ade0 tx=0x7ff60c0319f0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 shutdown_connections 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2b80 0x7ff5f80a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614109140 0x7ff61419ef00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141049c0 0x7ff61419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 --2- 172.21.15.38:0/665062643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614104010 0x7ff61419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 >> 172.21.15.38:0/665062643 conn(0x7ff6140ffa50 msgr2=0x7ff614100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.806+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 shutdown_connections 2024-09-12T12:22:41.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:41.807+0000 7ff619800640 1 -- 172.21.15.38:0/665062643 wait complete. 2024-09-12T12:22:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:22:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:22:41.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:41.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: Deploying daemon mds.b on smithi071 2024-09-12T12:22:41.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.38:6840/1563078137,v1:172.21.15.38:6841/1563078137] up:boot 2024-09-12T12:22:41.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: fsmap 11 up:standby 2024-09-12T12:22:41.918 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:41 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:22:42.609 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:42 smithi071 systemd[1]: Starting Ceph mds.b for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:22:42.899 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:42 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/665062643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:42.899 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:42 smithi071 podman[65238]: 2024-09-12 12:22:42.642738659 +0000 UTC m=+0.015681727 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:22:42.899 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:42 smithi071 podman[65238]: 2024-09-12 12:22:42.779952635 +0000 UTC m=+0.152895740 container create dee4565796963ec9a0508b0cc1835619cdcd81f2fdcfde6500494138ec36591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T12:22:42.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:42 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/665062643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:42.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:42 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/665062643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:43.264 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:43 smithi071 podman[65238]: 2024-09-12 12:22:43.021346873 +0000 UTC m=+0.394289936 container init dee4565796963ec9a0508b0cc1835619cdcd81f2fdcfde6500494138ec36591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T12:22:43.264 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:43 smithi071 podman[65238]: 2024-09-12 12:22:43.024065298 +0000 UTC m=+0.397008372 container start dee4565796963ec9a0508b0cc1835619cdcd81f2fdcfde6500494138ec36591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T12:22:43.264 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mds[65257]: -- 172.21.15.71:0/3121948569 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d369e3860 con 0x557d369c1400 2024-09-12T12:22:43.264 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: starting mds.b at 2024-09-12T12:22:43.264 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:43 smithi071 bash[65238]: dee4565796963ec9a0508b0cc1835619cdcd81f2fdcfde6500494138ec36591c 2024-09-12T12:22:43.264 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:43 smithi071 systemd[1]: Started Ceph mds.b for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:22:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:43 smithi154 ceph-mon[35578]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:43 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:43.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mon[34859]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:43.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.935 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:43 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:43 smithi038 ceph-mon[30810]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:43.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:43 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:44.588 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:22:44.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:44 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] up:boot 2024-09-12T12:22:44.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:44 smithi071 ceph-mon[34859]: fsmap 12 up:standby 2024-09-12T12:22:44.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:44 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:22:44.906 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:44 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:44.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:44 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] up:boot 2024-09-12T12:22:44.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:44 smithi154 ceph-mon[35578]: fsmap 12 up:standby 2024-09-12T12:22:44.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:44 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:22:44.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:44 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:44.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:44 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] up:boot 2024-09-12T12:22:44.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:44 smithi038 ceph-mon[30810]: fsmap 12 up:standby 2024-09-12T12:22:44.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:44 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:22:44.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:44 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 -- 172.21.15.38:0/1375923321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff488103e30 msgr2=0x7ff488104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1375923321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff488103e30 0x7ff488104210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff478009900 tx=0x7ff47802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 -- 172.21.15.38:0/1375923321 shutdown_connections 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1375923321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff488108f60 0x7ff488110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1375923321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4881047e0 0x7ff488108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1375923321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff488103e30 0x7ff488104210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 -- 172.21.15.38:0/1375923321 >> 172.21.15.38:0/1375923321 conn(0x7ff4880ff8d0 msgr2=0x7ff488101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:45.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 -- 172.21.15.38:0/1375923321 shutdown_connections 2024-09-12T12:22:45.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.546+0000 7ff48cc00640 1 -- 172.21.15.38:0/1375923321 wait complete. 2024-09-12T12:22:45.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.547+0000 7ff48cc00640 1 Processor -- start 2024-09-12T12:22:45.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff48cc00640 1 -- start start 2024-09-12T12:22:45.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff48cc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff488103e30 0x7ff48819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff48cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4881047e0 0x7ff48819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff48cc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff488108f60 0x7ff48819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff48cc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff488114010 con 0x7ff488103e30 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff48cc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff488113e90 con 0x7ff4881047e0 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff48cc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff488114190 con 0x7ff488108f60 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff487400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff488103e30 0x7ff48819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff487400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff488103e30 0x7ff48819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57902/0 (socket says 172.21.15.38:57902) 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff487400640 1 -- 172.21.15.38:0/1349991460 learned_addr learned my addr 172.21.15.38:0/1349991460 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.548+0000 7ff47ea00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4881047e0 0x7ff48819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff487e00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff488108f60 0x7ff48819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff47ea00640 1 -- 172.21.15.38:0/1349991460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff488108f60 msgr2=0x7ff48819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff47ea00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff488108f60 0x7ff48819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff47ea00640 1 -- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff488103e30 msgr2=0x7ff48819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff47ea00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff488103e30 0x7ff48819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff47ea00640 1 -- 172.21.15.38:0/1349991460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48819f4a0 con 0x7ff4881047e0 2024-09-12T12:22:45.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff487e00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff488108f60 0x7ff48819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:45.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff47ea00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4881047e0 0x7ff48819aa30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff47000d6d0 tx=0x7ff47000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff484c00640 1 -- 172.21.15.38:0/1349991460 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470017070 con 0x7ff4881047e0 2024-09-12T12:22:45.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff484c00640 1 -- 172.21.15.38:0/1349991460 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff470009820 con 0x7ff4881047e0 2024-09-12T12:22:45.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48819f790 con 0x7ff4881047e0 2024-09-12T12:22:45.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.549+0000 7ff484c00640 1 -- 172.21.15.38:0/1349991460 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470004d00 con 0x7ff4881047e0 2024-09-12T12:22:45.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.550+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4881a7070 con 0x7ff4881047e0 2024-09-12T12:22:45.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.551+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff488104210 con 0x7ff4881047e0 2024-09-12T12:22:45.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.553+0000 7ff484c00640 1 -- 172.21.15.38:0/1349991460 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff4700099d0 con 0x7ff4881047e0 2024-09-12T12:22:45.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.555+0000 7ff484c00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff46c0a2b80 0x7ff46c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.555+0000 7ff484c00640 1 -- 172.21.15.38:0/1349991460 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff4700ce810 con 0x7ff4881047e0 2024-09-12T12:22:45.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.555+0000 7ff487400640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff46c0a2b80 0x7ff46c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.556+0000 7ff487400640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff46c0a2b80 0x7ff46c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4780096c0 tx=0x7ff4780046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.558+0000 7ff484c00640 1 -- 172.21.15.38:0/1349991460 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff47009bb70 con 0x7ff4881047e0 2024-09-12T12:22:45.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.799+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff48810bbb0 con 0x7ff4881047e0 2024-09-12T12:22:45.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.800+0000 7ff484c00640 1 -- 172.21.15.38:0/1349991460 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7ff47009b470 con 0x7ff4881047e0 2024-09-12T12:22:45.801 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:45.801 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":13,"btime":"2024-09-12T12:22:43:609162+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T12:22:45.801 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 13 2024-09-12T12:22:45.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff46c0a2b80 msgr2=0x7ff46c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff46c0a2b80 0x7ff46c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4780096c0 tx=0x7ff4780046c0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4881047e0 msgr2=0x7ff48819aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4881047e0 0x7ff48819aa30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff47000d6d0 tx=0x7ff47000db90 comp rx=0 tx=0).stop 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 shutdown_connections 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff46c0a2b80 0x7ff46c0a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff488108f60 0x7ff48819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4881047e0 0x7ff48819aa30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 --2- 172.21.15.38:0/1349991460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff488103e30 0x7ff48819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 >> 172.21.15.38:0/1349991460 conn(0x7ff4880ff8d0 msgr2=0x7ff488100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 shutdown_connections 2024-09-12T12:22:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:45.803+0000 7ff48cc00640 1 -- 172.21.15.38:0/1349991460 wait complete. 2024-09-12T12:22:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:45 smithi071 ceph-mon[34859]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:45 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:45 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1349991460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:45 smithi154 ceph-mon[35578]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:45 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:45 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1349991460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:46.180 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:45 smithi038 ceph-mon[30810]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:46.180 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.181 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.181 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.181 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:45 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:46.181 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:45 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1349991460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:22:46.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T12:22:46.972 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:47.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:47 smithi038 ceph-mon[30810]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:47.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:47.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:47.314 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:47 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.323 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:47 smithi154 ceph-mon[35578]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:47.323 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:47.323 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:47.323 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:47 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:47 smithi071 ceph-mon[34859]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:47 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 -- 172.21.15.38:0/2088840528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 msgr2=0x7ff2240748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 --2- 172.21.15.38:0/2088840528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff2240748f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff214009900 tx=0x7ff21402a480 comp rx=0 tx=0).stop 2024-09-12T12:22:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 -- 172.21.15.38:0/2088840528 shutdown_connections 2024-09-12T12:22:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 --2- 172.21.15.38:0/2088840528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff22410e280 0x7ff224110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 --2- 172.21.15.38:0/2088840528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff224074e30 0x7ff22410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 --2- 172.21.15.38:0/2088840528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff2240748f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 -- 172.21.15.38:0/2088840528 >> 172.21.15.38:0/2088840528 conn(0x7ff2240fd740 msgr2=0x7ff2240ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:47.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 -- 172.21.15.38:0/2088840528 shutdown_connections 2024-09-12T12:22:47.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.551+0000 7ff223e00640 1 -- 172.21.15.38:0/2088840528 wait complete. 2024-09-12T12:22:47.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.552+0000 7ff223e00640 1 Processor -- start 2024-09-12T12:22:47.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.552+0000 7ff223e00640 1 -- start start 2024-09-12T12:22:47.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff223e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff22419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff223e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff224074e30 0x7ff22419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff223e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff22410e280 0x7ff22419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff223e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff224113fb0 con 0x7ff22410e280 2024-09-12T12:22:47.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff223e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff224113e30 con 0x7ff224074e30 2024-09-12T12:22:47.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff223e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff224114130 con 0x7ff224074510 2024-09-12T12:22:47.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff22419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff22419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:33044/0 (socket says 172.21.15.38:33044) 2024-09-12T12:22:47.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 -- 172.21.15.38:0/3569703406 learned_addr learned my addr 172.21.15.38:0/3569703406 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:47.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff223400640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff22410e280 0x7ff22419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff21be00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff224074e30 0x7ff22419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 -- 172.21.15.38:0/3569703406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff224074e30 msgr2=0x7ff22419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff224074e30 0x7ff22419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 -- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff22410e280 msgr2=0x7ff22419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff22410e280 0x7ff22419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.553+0000 7ff222a00640 1 -- 172.21.15.38:0/3569703406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22419f4a0 con 0x7ff224074510 2024-09-12T12:22:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.554+0000 7ff222a00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff22419a4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff214006010 tx=0x7ff214004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.554+0000 7ff21b400640 1 -- 172.21.15.38:0/3569703406 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21403f030 con 0x7ff224074510 2024-09-12T12:22:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.554+0000 7ff21b400640 1 -- 172.21.15.38:0/3569703406 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff214004440 con 0x7ff224074510 2024-09-12T12:22:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.554+0000 7ff21b400640 1 -- 172.21.15.38:0/3569703406 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214035070 con 0x7ff224074510 2024-09-12T12:22:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.554+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22419f730 con 0x7ff224074510 2024-09-12T12:22:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.554+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22419fbc0 con 0x7ff224074510 2024-09-12T12:22:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.555+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2240748f0 con 0x7ff224074510 2024-09-12T12:22:47.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.557+0000 7ff21b400640 1 -- 172.21.15.38:0/3569703406 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff214042030 con 0x7ff224074510 2024-09-12T12:22:47.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.558+0000 7ff21b400640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff2080a2b80 0x7ff2080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.558+0000 7ff21b400640 1 -- 172.21.15.38:0/3569703406 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff2140ef400 con 0x7ff224074510 2024-09-12T12:22:47.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.559+0000 7ff21be00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff2080a2b80 0x7ff2080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.559+0000 7ff21be00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff2080a2b80 0x7ff2080a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff22410f710 tx=0x7ff20c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.560+0000 7ff21b400640 1 -- 172.21.15.38:0/3569703406 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2140bc820 con 0x7ff224074510 2024-09-12T12:22:47.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.773+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff224109400 con 0x7ff224074510 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.773+0000 7ff21b400640 1 -- 172.21.15.38:0/3569703406 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7ff2140bc120 con 0x7ff224074510 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:22:47.774 INFO:teuthology.orchestra.run.smithi038.stdout:] 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff2080a2b80 msgr2=0x7ff2080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff2080a2b80 0x7ff2080a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff22410f710 tx=0x7ff20c005f90 comp rx=0 tx=0).stop 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 msgr2=0x7ff22419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff22419a4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff214006010 tx=0x7ff214004040 comp rx=0 tx=0).stop 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 shutdown_connections 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff2080a2b80 0x7ff2080a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff22410e280 0x7ff22419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff224074e30 0x7ff22419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 --2- 172.21.15.38:0/3569703406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff224074510 0x7ff22419a4f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 >> 172.21.15.38:0/3569703406 conn(0x7ff2240fd740 msgr2=0x7ff2240fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:47.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.776+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 shutdown_connections 2024-09-12T12:22:47.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:47.777+0000 7ff223e00640 1 -- 172.21.15.38:0/3569703406 wait complete. 2024-09-12T12:22:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:48 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:48 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3569703406' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:22:48.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:48 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:48.339 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:48 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3569703406' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:22:48.423 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:48 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:48.423 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:48 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3569703406' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:22:48.978 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:22:48.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:22:49.421 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:49.807 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:49 smithi038 ceph-mon[30810]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:49.807 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:49.807 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:49.808 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:49.808 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:49.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:49 smithi154 ceph-mon[35578]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:49.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:49.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:49.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:49.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:49 smithi071 ceph-mon[34859]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:50.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:50.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 -- 172.21.15.38:0/2018630537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c101df0 msgr2=0x7f141c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 --2- 172.21.15.38:0/2018630537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c101df0 0x7f141c1021d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f140c009900 tx=0x7f140c02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 -- 172.21.15.38:0/2018630537 shutdown_connections 2024-09-12T12:22:50.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 --2- 172.21.15.38:0/2018630537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f141c106f20 0x7f141c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 --2- 172.21.15.38:0/2018630537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c1027a0 0x7f141c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 --2- 172.21.15.38:0/2018630537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c101df0 0x7f141c1021d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 -- 172.21.15.38:0/2018630537 >> 172.21.15.38:0/2018630537 conn(0x7f141c0fd8b0 msgr2=0x7f141c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:50.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 -- 172.21.15.38:0/2018630537 shutdown_connections 2024-09-12T12:22:50.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.040+0000 7f1422800640 1 -- 172.21.15.38:0/2018630537 wait complete. 2024-09-12T12:22:50.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.041+0000 7f1422800640 1 Processor -- start 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1422800640 1 -- start start 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1422800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c101df0 0x7f141c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1422800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c1027a0 0x7f141c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1422800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f141c106f20 0x7f141c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1422800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f141c111fd0 con 0x7f141c1027a0 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1422800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f141c111e50 con 0x7f141c106f20 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1422800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f141c112150 con 0x7f141c101df0 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f141b400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c101df0 0x7f141c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f141b400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c101df0 0x7f141c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:33070/0 (socket says 172.21.15.38:33070) 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f1413e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c1027a0 0x7f141c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f141b400640 1 -- 172.21.15.38:0/1555086191 learned_addr learned my addr 172.21.15.38:0/1555086191 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.042+0000 7f141be00640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f141c106f20 0x7f141c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.043+0000 7f141b400640 1 -- 172.21.15.38:0/1555086191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f141c106f20 msgr2=0x7f141c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.043+0000 7f141b400640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f141c106f20 0x7f141c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.043+0000 7f141b400640 1 -- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c1027a0 msgr2=0x7f141c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.043+0000 7f141b400640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c1027a0 0x7f141c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.043+0000 7f141b400640 1 -- 172.21.15.38:0/1555086191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c19f5d0 con 0x7f141c101df0 2024-09-12T12:22:50.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.043+0000 7f1413e00640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c1027a0 0x7f141c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:50.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.043+0000 7f141b400640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c101df0 0x7f141c19a620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f140c004770 tx=0x7f140c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.044+0000 7f1418c00640 1 -- 172.21.15.38:0/1555086191 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c03f070 con 0x7f141c101df0 2024-09-12T12:22:50.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.044+0000 7f1418c00640 1 -- 172.21.15.38:0/1555086191 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c031ca0 con 0x7f141c101df0 2024-09-12T12:22:50.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.044+0000 7f1418c00640 1 -- 172.21.15.38:0/1555086191 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c035030 con 0x7f141c101df0 2024-09-12T12:22:50.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.044+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141c19f860 con 0x7f141c101df0 2024-09-12T12:22:50.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.044+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141c19fcf0 con 0x7f141c101df0 2024-09-12T12:22:50.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.045+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f141c1021d0 con 0x7f141c101df0 2024-09-12T12:22:50.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.047+0000 7f1418c00640 1 -- 172.21.15.38:0/1555086191 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f140c042070 con 0x7f141c101df0 2024-09-12T12:22:50.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.048+0000 7f1418c00640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f14000a2b80 0x7f14000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.048+0000 7f1418c00640 1 -- 172.21.15.38:0/1555086191 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f140c0ef450 con 0x7f141c101df0 2024-09-12T12:22:50.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.048+0000 7f1413e00640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f14000a2b80 0x7f14000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.049+0000 7f1413e00640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f14000a2b80 0x7f14000a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f141c10eef0 tx=0x7f140400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.050+0000 7f1418c00640 1 -- 172.21.15.38:0/1555086191 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f140c0bc160 con 0x7f141c101df0 2024-09-12T12:22:50.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.242+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f141c1a72c0 con 0x7f141c101df0 2024-09-12T12:22:50.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.839+0000 7f1418c00640 1 -- 172.21.15.38:0/1555086191 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f140c0c0460 con 0x7f141c101df0 2024-09-12T12:22:50.843 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2024-09-12T12:22:50.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f14000a2b80 msgr2=0x7f14000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f14000a2b80 0x7f14000a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f141c10eef0 tx=0x7f140400b390 comp rx=0 tx=0).stop 2024-09-12T12:22:50.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c101df0 msgr2=0x7f141c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c101df0 0x7f141c19a620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f140c004770 tx=0x7f140c003c10 comp rx=0 tx=0).stop 2024-09-12T12:22:50.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 shutdown_connections 2024-09-12T12:22:50.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f14000a2b80 0x7f14000a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f141c106f20 0x7f141c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f141c1027a0 0x7f141c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 --2- 172.21.15.38:0/1555086191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c101df0 0x7f141c19a620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 >> 172.21.15.38:0/1555086191 conn(0x7f141c0fd8b0 msgr2=0x7f141c0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:50.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.844+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 shutdown_connections 2024-09-12T12:22:50.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:50.845+0000 7f1422800640 1 -- 172.21.15.38:0/1555086191 wait complete. 2024-09-12T12:22:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1555086191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:22:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:22:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:22:51.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:50 smithi154 ceph-mon[35578]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1555086191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:22:51.185 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:50 smithi038 ceph-mon[30810]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:22:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1555086191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:22:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:22:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:51.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:51.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:22:51.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:22:51.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:50 smithi071 ceph-mon[34859]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:22:51.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T12:22:51.849 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:51 smithi038 ceph-mon[30810]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:51.849 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:51 smithi038 ceph-mon[30810]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:22:51.996 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:52.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:51 smithi154 ceph-mon[35578]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:52.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:51 smithi154 ceph-mon[35578]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:22:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:51 smithi071 ceph-mon[34859]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:51 smithi071 ceph-mon[34859]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 -- 172.21.15.38:0/151933441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 msgr2=0x7f6570110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 --2- 172.21.15.38:0/151933441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 0x7f6570110ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6568009860 tx=0x7f656802a340 comp rx=0 tx=0).stop 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 -- 172.21.15.38:0/151933441 shutdown_connections 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 --2- 172.21.15.38:0/151933441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 0x7f6570110ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 --2- 172.21.15.38:0/151933441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65701049a0 0x7f65701089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 --2- 172.21.15.38:0/151933441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6570103ff0 0x7f65701043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 -- 172.21.15.38:0/151933441 >> 172.21.15.38:0/151933441 conn(0x7f65700ffa90 msgr2=0x7f6570101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 -- 172.21.15.38:0/151933441 shutdown_connections 2024-09-12T12:22:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.549+0000 7f6576400640 1 -- 172.21.15.38:0/151933441 wait complete. 2024-09-12T12:22:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.550+0000 7f6576400640 1 Processor -- start 2024-09-12T12:22:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6576400640 1 -- start start 2024-09-12T12:22:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6576400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6570103ff0 0x7f657019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6576400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65701049a0 0x7f657019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6576400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 0x7f657019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6576400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6570114150 con 0x7f6570103ff0 2024-09-12T12:22:52.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6576400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6570113fd0 con 0x7f6570109120 2024-09-12T12:22:52.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6576400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65701142d0 con 0x7f65701049a0 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f656f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6570103ff0 0x7f657019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f656f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6570103ff0 0x7f657019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57962/0 (socket says 172.21.15.38:57962) 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f656f400640 1 -- 172.21.15.38:0/129988395 learned_addr learned my addr 172.21.15.38:0/129988395 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.551+0000 7f6566a00640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65701049a0 0x7f657019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656fe00640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 0x7f657019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656f400640 1 -- 172.21.15.38:0/129988395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65701049a0 msgr2=0x7f657019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656f400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65701049a0 0x7f657019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656f400640 1 -- 172.21.15.38:0/129988395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 msgr2=0x7f657019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656f400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 0x7f657019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656f400640 1 -- 172.21.15.38:0/129988395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657019f570 con 0x7f6570103ff0 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656fe00640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 0x7f657019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.552+0000 7f656f400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6570103ff0 0x7f657019a5c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f656000eb90 tx=0x7f656000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.553+0000 7f656cc00640 1 -- 172.21.15.38:0/129988395 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560004b20 con 0x7f6570103ff0 2024-09-12T12:22:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.553+0000 7f656cc00640 1 -- 172.21.15.38:0/129988395 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6560004cc0 con 0x7f6570103ff0 2024-09-12T12:22:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.553+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657019f860 con 0x7f6570103ff0 2024-09-12T12:22:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.553+0000 7f656cc00640 1 -- 172.21.15.38:0/129988395 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560010720 con 0x7f6570103ff0 2024-09-12T12:22:52.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.553+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65701a7140 con 0x7f6570103ff0 2024-09-12T12:22:52.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.554+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65701043d0 con 0x7f6570103ff0 2024-09-12T12:22:52.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.557+0000 7f656cc00640 1 -- 172.21.15.38:0/129988395 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6560005000 con 0x7f6570103ff0 2024-09-12T12:22:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.558+0000 7f656cc00640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65540a2c00 0x7f65540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.558+0000 7f656cc00640 1 -- 172.21.15.38:0/129988395 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f65600cf530 con 0x7f6570103ff0 2024-09-12T12:22:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.558+0000 7f6566a00640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65540a2c00 0x7f65540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.559+0000 7f6566a00640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65540a2c00 0x7f65540a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f65700ffeb0 tx=0x7f6558009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:52.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.561+0000 7f656cc00640 1 -- 172.21.15.38:0/129988395 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65600541b0 con 0x7f6570103ff0 2024-09-12T12:22:52.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:52.747+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f657019b920 con 0x7f6570103ff0 2024-09-12T12:22:53.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.284+0000 7f656cc00640 1 -- 172.21.15.38:0/129988395 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v80) ==== 171+0+0 (secure 0 0 0) 0x7f656009c720 con 0x7f6570103ff0 2024-09-12T12:22:53.284 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2024-09-12T12:22:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.286+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65540a2c00 msgr2=0x7f65540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.286+0000 7f6576400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65540a2c00 0x7f65540a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f65700ffeb0 tx=0x7f6558009260 comp rx=0 tx=0).stop 2024-09-12T12:22:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.286+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6570103ff0 msgr2=0x7f657019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.286+0000 7f6576400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6570103ff0 0x7f657019a5c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f656000eb90 tx=0x7f656000ef90 comp rx=0 tx=0).stop 2024-09-12T12:22:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 shutdown_connections 2024-09-12T12:22:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65540a2c00 0x7f65540a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6570109120 0x7f657019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65701049a0 0x7f657019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 --2- 172.21.15.38:0/129988395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6570103ff0 0x7f657019a5c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 >> 172.21.15.38:0/129988395 conn(0x7f65700ffa90 msgr2=0x7f6570100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:53.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 shutdown_connections 2024-09-12T12:22:53.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:53.287+0000 7f6576400640 1 -- 172.21.15.38:0/129988395 wait complete. 2024-09-12T12:22:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:53 smithi154 ceph-mon[35578]: pgmap v288: 33 pgs: 11 creating+peering, 18 unknown, 4 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:53 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/129988395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T12:22:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:53 smithi154 ceph-mon[35578]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:22:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:53 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/129988395' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T12:22:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:53 smithi154 ceph-mon[35578]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:22:53.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:53 smithi038 ceph-mon[30810]: pgmap v288: 33 pgs: 11 creating+peering, 18 unknown, 4 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:53.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:53 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/129988395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T12:22:53.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:53 smithi038 ceph-mon[30810]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:22:53.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:53 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/129988395' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T12:22:53.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:53 smithi038 ceph-mon[30810]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:22:53.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:53 smithi071 ceph-mon[34859]: pgmap v288: 33 pgs: 11 creating+peering, 18 unknown, 4 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:53.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:53 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/129988395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T12:22:53.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:53 smithi071 ceph-mon[34859]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:22:53.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:53 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/129988395' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T12:22:53.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:53 smithi071 ceph-mon[34859]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:22:54.116 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:22:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:55.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 -- 172.21.15.38:0/2701518623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c074ee0 msgr2=0x7f216c10dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 --2- 172.21.15.38:0/2701518623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c074ee0 0x7f216c10dd20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f215c009900 tx=0x7f215c02a480 comp rx=0 tx=0).stop 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 -- 172.21.15.38:0/2701518623 shutdown_connections 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 --2- 172.21.15.38:0/2701518623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f216c10e260 0x7f216c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 --2- 172.21.15.38:0/2701518623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c074ee0 0x7f216c10dd20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 --2- 172.21.15.38:0/2701518623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0745c0 0x7f216c0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 -- 172.21.15.38:0/2701518623 >> 172.21.15.38:0/2701518623 conn(0x7f216c0fd740 msgr2=0x7f216c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 -- 172.21.15.38:0/2701518623 shutdown_connections 2024-09-12T12:22:55.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.055+0000 7f2173200640 1 -- 172.21.15.38:0/2701518623 wait complete. 2024-09-12T12:22:55.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.056+0000 7f2173200640 1 Processor -- start 2024-09-12T12:22:55.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.056+0000 7f2173200640 1 -- start start 2024-09-12T12:22:55.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.056+0000 7f2173200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0745c0 0x7f216c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2173200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f216c074ee0 0x7f216c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2173200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c10e260 0x7f216c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2173200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f216c114000 con 0x7f216c10e260 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2173200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f216c113e80 con 0x7f216c074ee0 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2173200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f216c114180 con 0x7f216c0745c0 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c10e260 0x7f216c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c10e260 0x7f216c19ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57990/0 (socket says 172.21.15.38:57990) 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 -- 172.21.15.38:0/3179421772 learned_addr learned my addr 172.21.15.38:0/3179421772 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2171400640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f216c074ee0 0x7f216c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2171e00640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0745c0 0x7f216c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 -- 172.21.15.38:0/3179421772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0745c0 msgr2=0x7f216c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0745c0 0x7f216c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 -- 172.21.15.38:0/3179421772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f216c074ee0 msgr2=0x7f216c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f216c074ee0 0x7f216c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.057+0000 7f2172800640 1 -- 172.21.15.38:0/3179421772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c19f450 con 0x7f216c10e260 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.058+0000 7f2172800640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c10e260 0x7f216c19ed70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f216800eb40 tx=0x7f216800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.058+0000 7f2166a00640 1 -- 172.21.15.38:0/3179421772 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168004b20 con 0x7f216c10e260 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.058+0000 7f2166a00640 1 -- 172.21.15.38:0/3179421772 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2168004cc0 con 0x7f216c10e260 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.058+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c19f740 con 0x7f216c10e260 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.058+0000 7f2166a00640 1 -- 172.21.15.38:0/3179421772 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168010850 con 0x7f216c10e260 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.058+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1a7020 con 0x7f216c10e260 2024-09-12T12:22:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.059+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216c0749a0 con 0x7f216c10e260 2024-09-12T12:22:55.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.062+0000 7f2166a00640 1 -- 172.21.15.38:0/3179421772 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2168005000 con 0x7f216c10e260 2024-09-12T12:22:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.063+0000 7f2166a00640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f21540a2c00 0x7f21540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.063+0000 7f2166a00640 1 -- 172.21.15.38:0/3179421772 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f21680cf5a0 con 0x7f216c10e260 2024-09-12T12:22:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.063+0000 7f2171e00640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f21540a2c00 0x7f21540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.064+0000 7f2171e00640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f21540a2c00 0x7f21540a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2160009bd0 tx=0x7f2160005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.065+0000 7f2166a00640 1 -- 172.21.15.38:0/3179421772 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f216809c610 con 0x7f216c10e260 2024-09-12T12:22:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:55.288+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f216c02d7c0 con 0x7f216c10e260 2024-09-12T12:22:55.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:55 smithi154 ceph-mon[35578]: pgmap v290: 97 pgs: 64 unknown, 11 creating+peering, 22 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:55.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:55 smithi154 ceph-mon[35578]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:22:55.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:55 smithi038 ceph-mon[30810]: pgmap v290: 97 pgs: 64 unknown, 11 creating+peering, 22 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:55.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:55 smithi038 ceph-mon[30810]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:22:55.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:55 smithi071 ceph-mon[34859]: pgmap v290: 97 pgs: 64 unknown, 11 creating+peering, 22 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:55.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:55 smithi071 ceph-mon[34859]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:22:56.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.301+0000 7f2166a00640 1 -- 172.21.15.38:0/3179421772 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f216809bf10 con 0x7f216c10e260 2024-09-12T12:22:56.302 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f21540a2c00 msgr2=0x7f21540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f21540a2c00 0x7f21540a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2160009bd0 tx=0x7f2160005f90 comp rx=0 tx=0).stop 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c10e260 msgr2=0x7f216c19ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c10e260 0x7f216c19ed70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f216800eb40 tx=0x7f216800c2d0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 shutdown_connections 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f21540a2c00 0x7f21540a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f216c10e260 0x7f216c19ed70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f216c074ee0 0x7f216c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 --2- 172.21.15.38:0/3179421772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0745c0 0x7f216c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 >> 172.21.15.38:0/3179421772 conn(0x7f216c0fd740 msgr2=0x7f216c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:56.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 shutdown_connections 2024-09-12T12:22:56.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:56.304+0000 7f2173200640 1 -- 172.21.15.38:0/3179421772 wait complete. 2024-09-12T12:22:56.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:56 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3179421772' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:22:56.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:56 smithi154 ceph-mon[35578]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T12:22:56.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:56 smithi154 ceph-mon[35578]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:22:56.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:56 smithi154 ceph-mon[35578]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:22:56.711 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:56 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3179421772' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:22:56.711 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:56 smithi038 ceph-mon[30810]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T12:22:56.711 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:56 smithi038 ceph-mon[30810]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:22:56.711 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:56 smithi038 ceph-mon[30810]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:22:56.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:56 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3179421772' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:22:56.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:56 smithi071 ceph-mon[34859]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T12:22:56.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:56 smithi071 ceph-mon[34859]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:22:56.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:56 smithi071 ceph-mon[34859]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:22:57.207 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T12:22:57.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T12:22:57.564 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:57 smithi071 ceph-mon[34859]: pgmap v294: 97 pgs: 56 unknown, 9 creating+peering, 32 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:57.564 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:57 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3179421772' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:22:57.564 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:57 smithi071 ceph-mon[34859]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T12:22:57.564 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:57 smithi071 ceph-mon[34859]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:22:57.564 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:57 smithi071 ceph-mon[34859]: Cluster is now healthy 2024-09-12T12:22:57.564 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:57 smithi071 ceph-mon[34859]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T12:22:57.594 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:57.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:57 smithi154 ceph-mon[35578]: pgmap v294: 97 pgs: 56 unknown, 9 creating+peering, 32 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:57.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:57 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3179421772' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:22:57.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:57 smithi154 ceph-mon[35578]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T12:22:57.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:57 smithi154 ceph-mon[35578]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:22:57.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:57 smithi154 ceph-mon[35578]: Cluster is now healthy 2024-09-12T12:22:57.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:57 smithi154 ceph-mon[35578]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T12:22:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:57 smithi038 ceph-mon[30810]: pgmap v294: 97 pgs: 56 unknown, 9 creating+peering, 32 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:22:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:57 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3179421772' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:22:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:57 smithi038 ceph-mon[30810]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T12:22:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:57 smithi038 ceph-mon[30810]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:22:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:57 smithi038 ceph-mon[30810]: Cluster is now healthy 2024-09-12T12:22:57.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:57 smithi038 ceph-mon[30810]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T12:22:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 -- 172.21.15.38:0/2859038550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60109120 msgr2=0x7f7c60110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 --2- 172.21.15.38:0/2859038550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60109120 0x7f7c60110ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009ca0 tx=0x7f7c5802a8b0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 -- 172.21.15.38:0/2859038550 shutdown_connections 2024-09-12T12:22:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 --2- 172.21.15.38:0/2859038550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60109120 0x7f7c60110ca0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 --2- 172.21.15.38:0/2859038550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c601049a0 0x7f7c601089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 --2- 172.21.15.38:0/2859038550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c60103ff0 0x7f7c601043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 -- 172.21.15.38:0/2859038550 >> 172.21.15.38:0/2859038550 conn(0x7f7c600ffa90 msgr2=0x7f7c60101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 -- 172.21.15.38:0/2859038550 shutdown_connections 2024-09-12T12:22:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.190+0000 7f7c68400640 1 -- 172.21.15.38:0/2859038550 wait complete. 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.191+0000 7f7c68400640 1 Processor -- start 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c68400640 1 -- start start 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c68400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60103ff0 0x7f7c6019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c68400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c601049a0 0x7f7c6019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c68400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c60109120 0x7f7c6019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c68400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c60114130 con 0x7f7c60103ff0 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c68400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c60113fb0 con 0x7f7c601049a0 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c68400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c601142b0 con 0x7f7c60109120 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c65a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60103ff0 0x7f7c6019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c65a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60103ff0 0x7f7c6019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37162/0 (socket says 172.21.15.38:37162) 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c65a00640 1 -- 172.21.15.38:0/2314889516 learned_addr learned my addr 172.21.15.38:0/2314889516 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c65000640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c601049a0 0x7f7c6019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.192+0000 7f7c66400640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c60109120 0x7f7c6019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c65a00640 1 -- 172.21.15.38:0/2314889516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c60109120 msgr2=0x7f7c6019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c65a00640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c60109120 0x7f7c6019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c65a00640 1 -- 172.21.15.38:0/2314889516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c601049a0 msgr2=0x7f7c6019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c65a00640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c601049a0 0x7f7c6019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c65a00640 1 -- 172.21.15.38:0/2314889516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6019f5c0 con 0x7f7c60103ff0 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c65a00640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60103ff0 0x7f7c6019a610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400d950 tx=0x7f7c5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c5e000640 1 -- 172.21.15.38:0/2314889516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54017070 con 0x7f7c60103ff0 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c5e000640 1 -- 172.21.15.38:0/2314889516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c54009c30 con 0x7f7c60103ff0 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c5e000640 1 -- 172.21.15.38:0/2314889516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400f6b0 con 0x7f7c60103ff0 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6019f8b0 con 0x7f7c60103ff0 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.193+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c601a7190 con 0x7f7c60103ff0 2024-09-12T12:22:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.195+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c601043d0 con 0x7f7c60103ff0 2024-09-12T12:22:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.196+0000 7f7c5e000640 1 -- 172.21.15.38:0/2314889516 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7c540109d0 con 0x7f7c60103ff0 2024-09-12T12:22:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.198+0000 7f7c5e000640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7c480a2c00 0x7f7c480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.198+0000 7f7c5e000640 1 -- 172.21.15.38:0/2314889516 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f7c540cead0 con 0x7f7c60103ff0 2024-09-12T12:22:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.198+0000 7f7c65000640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7c480a2c00 0x7f7c480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.199+0000 7f7c65000640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7c480a2c00 0x7f7c480a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7c6010a9e0 tx=0x7f7c4c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.202+0000 7f7c5e000640 1 -- 172.21.15.38:0/2314889516 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c54009de0 con 0x7f7c60103ff0 2024-09-12T12:22:58.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:58.396+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7c601a7450 con 0x7f7c60103ff0 2024-09-12T12:22:58.397 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:58 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] up:active 2024-09-12T12:22:58.397 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:58 smithi038 ceph-mon[30810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:22:58.397 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:58 smithi038 ceph-mon[30810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:22:58.618 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:58 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] up:active 2024-09-12T12:22:58.618 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:58 smithi071 ceph-mon[34859]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:22:58.619 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:58 smithi071 ceph-mon[34859]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:22:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:58 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] up:active 2024-09-12T12:22:58.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:58 smithi154 ceph-mon[35578]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:22:58.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:58 smithi154 ceph-mon[35578]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:22:59.014 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:22:58 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: 2024-09-12T12:22:58.617+0000 7f0b4b86a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:22:59.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.339+0000 7f7c5e000640 1 -- 172.21.15.38:0/2314889516 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v84) ==== 157+0+0 (secure 0 0 0) 0x7f7c5409b490 con 0x7f7c60103ff0 2024-09-12T12:22:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.341+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7c480a2c00 msgr2=0x7f7c480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.341+0000 7f7c68400640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7c480a2c00 0x7f7c480a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7c6010a9e0 tx=0x7f7c4c00b390 comp rx=0 tx=0).stop 2024-09-12T12:22:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.341+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60103ff0 msgr2=0x7f7c6019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.341+0000 7f7c68400640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60103ff0 0x7f7c6019a610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400d950 tx=0x7f7c5400de10 comp rx=0 tx=0).stop 2024-09-12T12:22:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 shutdown_connections 2024-09-12T12:22:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7c480a2c00 0x7f7c480a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c60109120 0x7f7c6019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c601049a0 0x7f7c6019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 --2- 172.21.15.38:0/2314889516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c60103ff0 0x7f7c6019a610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 >> 172.21.15.38:0/2314889516 conn(0x7f7c600ffa90 msgr2=0x7f7c601005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 shutdown_connections 2024-09-12T12:22:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:22:59.342+0000 7f7c68400640 1 -- 172.21.15.38:0/2314889516 wait complete. 2024-09-12T12:22:59.613 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:59 smithi038 ceph-mon[30810]: pgmap v295: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:22:59.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:22:59 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2314889516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T12:22:59.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:59 smithi154 ceph-mon[35578]: pgmap v295: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:22:59.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:22:59 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2314889516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T12:22:59.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:59 smithi071 ceph-mon[34859]: pgmap v295: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:22:59.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:22:59 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2314889516' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T12:23:00.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:23:00.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:00 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2314889516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T12:23:00.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:00 smithi038 ceph-mon[30810]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:23:00.552 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:00.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:00 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2314889516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T12:23:00.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:00 smithi154 ceph-mon[35578]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:23:00.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:00 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2314889516' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T12:23:00.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:00 smithi071 ceph-mon[34859]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:23:01.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.146+0000 7fc41ae00640 1 -- 172.21.15.38:0/2604172305 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 msgr2=0x7fc414076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.146+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2604172305 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc414076b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc408009900 tx=0x7fc40802a410 comp rx=0 tx=0).stop 2024-09-12T12:23:01.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.146+0000 7fc41ae00640 1 -- 172.21.15.38:0/2604172305 shutdown_connections 2024-09-12T12:23:01.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.146+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2604172305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc414112870 0x7fc414114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.146+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2604172305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc414077040 0x7fc414112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.147+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2604172305 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc414076b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.147+0000 7fc41ae00640 1 -- 172.21.15.38:0/2604172305 >> 172.21.15.38:0/2604172305 conn(0x7fc4140ff8d0 msgr2=0x7fc414101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:01.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.147+0000 7fc41ae00640 1 -- 172.21.15.38:0/2604172305 shutdown_connections 2024-09-12T12:23:01.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.147+0000 7fc41ae00640 1 -- 172.21.15.38:0/2604172305 wait complete. 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 Processor -- start 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 -- start start 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc4141a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc414077040 0x7fc4141a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc414112870 0x7fc41419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc414118430 con 0x7fc414076720 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141182b0 con 0x7fc414112870 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.148+0000 7fc41ae00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141185b0 con 0x7fc414077040 2024-09-12T12:23:01.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc4141a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:01.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc4141a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37186/0 (socket says 172.21.15.38:37186) 2024-09-12T12:23:01.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419a00640 1 -- 172.21.15.38:0/2752365547 learned_addr learned my addr 172.21.15.38:0/2752365547 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:01.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419000640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc414077040 0x7fc4141a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:01.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc41a400640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc414112870 0x7fc41419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419000640 1 -- 172.21.15.38:0/2752365547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc414112870 msgr2=0x7fc41419e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419000640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc414112870 0x7fc41419e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419000640 1 -- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 msgr2=0x7fc4141a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419000640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc4141a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419000640 1 -- 172.21.15.38:0/2752365547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41419ef70 con 0x7fc414077040 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.149+0000 7fc419a00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc4141a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.150+0000 7fc419000640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc414077040 0x7fc4141a4b70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e9f0 tx=0x7fc40000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.150+0000 7fc412000640 1 -- 172.21.15.38:0/2752365547 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40000ccc0 con 0x7fc414077040 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.150+0000 7fc412000640 1 -- 172.21.15.38:0/2752365547 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc400010910 con 0x7fc414077040 2024-09-12T12:23:01.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.150+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41419f260 con 0x7fc414077040 2024-09-12T12:23:01.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.150+0000 7fc412000640 1 -- 172.21.15.38:0/2752365547 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400018960 con 0x7fc414077040 2024-09-12T12:23:01.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.150+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141ab5b0 con 0x7fc414077040 2024-09-12T12:23:01.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.151+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41419f5d0 con 0x7fc414077040 2024-09-12T12:23:01.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.153+0000 7fc412000640 1 -- 172.21.15.38:0/2752365547 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc400010ac0 con 0x7fc414077040 2024-09-12T12:23:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.155+0000 7fc412000640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc3fc0a2b80 0x7fc3fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.155+0000 7fc412000640 1 -- 172.21.15.38:0/2752365547 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8277+0+0 (secure 0 0 0) 0x7fc4000cf7e0 con 0x7fc414077040 2024-09-12T12:23:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.155+0000 7fc419a00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc3fc0a2b80 0x7fc3fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:01.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.156+0000 7fc419a00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc3fc0a2b80 0x7fc3fc0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc4080096c0 tx=0x7fc4080046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.156+0000 7fc412000640 1 -- 172.21.15.38:0/2752365547 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc40009c060 con 0x7fc414077040 2024-09-12T12:23:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:01.341+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc41419fc30 con 0x7fc414077040 2024-09-12T12:23:02.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:01 smithi154 ceph-mon[35578]: pgmap v297: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T12:23:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:01 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2752365547' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:01 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:01 smithi038 ceph-mon[30810]: pgmap v297: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T12:23:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:01 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2752365547' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:01 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:01 smithi071 ceph-mon[34859]: pgmap v297: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T12:23:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:01 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2752365547' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:01 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:02.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.362+0000 7fc412000640 1 -- 172.21.15.38:0/2752365547 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v86) ==== 228+0+0 (secure 0 0 0) 0x7fc4000a0360 con 0x7fc414077040 2024-09-12T12:23:02.363 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data_ec' created 2024-09-12T12:23:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.366+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc3fc0a2b80 msgr2=0x7fc3fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.366+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc3fc0a2b80 0x7fc3fc0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc4080096c0 tx=0x7fc4080046c0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.366+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc414077040 msgr2=0x7fc4141a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.366+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc414077040 0x7fc4141a4b70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e9f0 tx=0x7fc40000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 shutdown_connections 2024-09-12T12:23:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc3fc0a2b80 0x7fc3fc0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc414112870 0x7fc41419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc414077040 0x7fc4141a4b70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 --2- 172.21.15.38:0/2752365547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc414076720 0x7fc4141a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 >> 172.21.15.38:0/2752365547 conn(0x7fc4140ff8d0 msgr2=0x7fc414101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 shutdown_connections 2024-09-12T12:23:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:02.367+0000 7fc41ae00640 1 -- 172.21.15.38:0/2752365547 wait complete. 2024-09-12T12:23:03.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:02 smithi038 ceph-mon[30810]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:23:03.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:02 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:23:03.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:02 smithi038 ceph-mon[30810]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:23:03.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T12:23:03.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:02 smithi154 ceph-mon[35578]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:23:03.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:02 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:23:03.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:02 smithi154 ceph-mon[35578]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:23:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:02 smithi071 ceph-mon[34859]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:23:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:02 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:23:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:02 smithi071 ceph-mon[34859]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:23:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 -- 172.21.15.38:0/3606781629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b441049c0 msgr2=0x7f1b44108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3606781629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b441049c0 0x7f1b44108a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009900 tx=0x7f1b2c02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 -- 172.21.15.38:0/3606781629 shutdown_connections 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3606781629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b44109140 0x7f1b44110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3606781629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b441049c0 0x7f1b44108a10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3606781629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 0x7f1b441043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 -- 172.21.15.38:0/3606781629 >> 172.21.15.38:0/3606781629 conn(0x7f1b440ffa50 msgr2=0x7f1b44101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 -- 172.21.15.38:0/3606781629 shutdown_connections 2024-09-12T12:23:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.051+0000 7f1b4a400640 1 -- 172.21.15.38:0/3606781629 wait complete. 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.052+0000 7f1b4a400640 1 Processor -- start 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.052+0000 7f1b4a400640 1 -- start start 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b4a400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 0x7f1b4419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b4a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b441049c0 0x7f1b4419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b4a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b44109140 0x7f1b4419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b4a400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1b44114190 con 0x7f1b44109140 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b4a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b44114010 con 0x7f1b441049c0 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b4a400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b44114310 con 0x7f1b44104010 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b44109140 0x7f1b4419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b43400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 0x7f1b4419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b44109140 0x7f1b4419ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37208/0 (socket says 172.21.15.38:37208) 2024-09-12T12:23:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b43400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 0x7f1b4419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:38834/0 (socket says 172.21.15.38:38834) 2024-09-12T12:23:04.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b43e00640 1 -- 172.21.15.38:0/3866346596 learned_addr learned my addr 172.21.15.38:0/3866346596 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:04.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.053+0000 7f1b3aa00640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b441049c0 0x7f1b4419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b43400640 1 -- 172.21.15.38:0/3866346596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b441049c0 msgr2=0x7f1b4419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b43400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b441049c0 0x7f1b4419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b43400640 1 -- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b44109140 msgr2=0x7f1b4419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b43400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b44109140 0x7f1b4419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b43400640 1 -- 172.21.15.38:0/3866346596 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4419f600 con 0x7f1b44104010 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b43e00640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b44109140 0x7f1b4419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b43400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 0x7f1b4419a650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b34005fd0 tx=0x7f1b3400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b40c00640 1 -- 172.21.15.38:0/3866346596 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34009c30 con 0x7f1b44104010 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b40c00640 1 -- 172.21.15.38:0/3866346596 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b34009dd0 con 0x7f1b44104010 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4419f8f0 con 0x7f1b44104010 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.054+0000 7f1b40c00640 1 -- 172.21.15.38:0/3866346596 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34010460 con 0x7f1b44104010 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.055+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b441a71d0 con 0x7f1b44104010 2024-09-12T12:23:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.056+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b441043f0 con 0x7f1b44104010 2024-09-12T12:23:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.058+0000 7f1b40c00640 1 -- 172.21.15.38:0/3866346596 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1b34003ef0 con 0x7f1b44104010 2024-09-12T12:23:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.059+0000 7f1b40c00640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1b280a2b80 0x7f1b280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.059+0000 7f1b40c00640 1 -- 172.21.15.38:0/3866346596 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7f1b340ced80 con 0x7f1b44104010 2024-09-12T12:23:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.059+0000 7f1b3aa00640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1b280a2b80 0x7f1b280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.060+0000 7f1b3aa00640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1b280a2b80 0x7f1b280a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c000c00 tx=0x7f1b2c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.061+0000 7f1b40c00640 1 -- 172.21.15.38:0/3866346596 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b34017020 con 0x7f1b44104010 2024-09-12T12:23:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:03 smithi154 ceph-mon[35578]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T12:23:04.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:03 smithi154 ceph-mon[35578]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:23:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:03 smithi038 ceph-mon[30810]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T12:23:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:03 smithi038 ceph-mon[30810]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:23:04.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.248+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f1b4402d7c0 con 0x7f1b44104010 2024-09-12T12:23:04.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:03 smithi071 ceph-mon[34859]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T12:23:04.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:03 smithi071 ceph-mon[34859]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:23:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.365+0000 7f1b40c00640 1 -- 172.21.15.38:0/3866346596 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7f1b3409b410 con 0x7f1b44104010 2024-09-12T12:23:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1b280a2b80 msgr2=0x7f1b280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1b280a2b80 0x7f1b280a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c000c00 tx=0x7f1b2c005b50 comp rx=0 tx=0).stop 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 msgr2=0x7f1b4419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 0x7f1b4419a650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b34005fd0 tx=0x7f1b3400dde0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 shutdown_connections 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1b280a2b80 0x7f1b280a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b44109140 0x7f1b4419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b441049c0 0x7f1b4419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 --2- 172.21.15.38:0/3866346596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b44104010 0x7f1b4419a650 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 >> 172.21.15.38:0/3866346596 conn(0x7f1b440ffa50 msgr2=0x7f1b44100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 shutdown_connections 2024-09-12T12:23:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:04.367+0000 7f1b4a400640 1 -- 172.21.15.38:0/3866346596 wait complete. 2024-09-12T12:23:04.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:04 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3866346596' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:04.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:04 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:04.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:04 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T12:23:04.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:04 smithi038 ceph-mon[30810]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:23:05.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:04 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3866346596' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:05.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:04 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:05.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:04 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T12:23:05.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:04 smithi154 ceph-mon[35578]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:23:05.193 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T12:23:05.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:04 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3866346596' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:05.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:04 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:05.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:04 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T12:23:05.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:04 smithi071 ceph-mon[34859]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:23:05.570 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:05.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:05 smithi038 ceph-mon[30810]: pgmap v302: 129 pgs: 17 creating+peering, 15 unknown, 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 649 B/s wr, 1 op/s 2024-09-12T12:23:05.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:05 smithi038 ceph-mon[30810]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:06.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 -- 172.21.15.38:0/4030249004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4101de0 msgr2=0x7f46f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 --2- 172.21.15.38:0/4030249004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4101de0 0x7f46f41021c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009900 tx=0x7f46e402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 -- 172.21.15.38:0/4030249004 shutdown_connections 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 --2- 172.21.15.38:0/4030249004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f4106f10 0x7f46f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 --2- 172.21.15.38:0/4030249004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f4102790 0x7f46f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 --2- 172.21.15.38:0/4030249004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4101de0 0x7f46f41021c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 -- 172.21.15.38:0/4030249004 >> 172.21.15.38:0/4030249004 conn(0x7f46f40fd8c0 msgr2=0x7f46f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 -- 172.21.15.38:0/4030249004 shutdown_connections 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.106+0000 7f46fa600640 1 -- 172.21.15.38:0/4030249004 wait complete. 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.107+0000 7f46fa600640 1 Processor -- start 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.107+0000 7f46fa600640 1 -- start start 2024-09-12T12:23:06.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.107+0000 7f46fa600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f4101de0 0x7f46f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46fa600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f4102790 0x7f46f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46fa600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4106f10 0x7f46f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46fa600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4111fc0 con 0x7f46f4106f10 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46fa600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4111e40 con 0x7f46f4101de0 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46fa600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4112140 con 0x7f46f4102790 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4106f10 0x7f46f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4106f10 0x7f46f4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51826/0 (socket says 172.21.15.38:51826) 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 -- 172.21.15.38:0/3612257848 learned_addr learned my addr 172.21.15.38:0/3612257848 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3400640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f4101de0 0x7f46f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f2a00640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f4102790 0x7f46f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 -- 172.21.15.38:0/3612257848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f4102790 msgr2=0x7f46f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f4102790 0x7f46f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 -- 172.21.15.38:0/3612257848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f4101de0 msgr2=0x7f46f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f4101de0 0x7f46f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.108+0000 7f46f3e00640 1 -- 172.21.15.38:0/3612257848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f41a69a0 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.109+0000 7f46f3e00640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4106f10 0x7f46f4074f70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009fd0 tx=0x7f46ec00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.109+0000 7f46ebe00640 1 -- 172.21.15.38:0/3612257848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec017070 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.109+0000 7f46ebe00640 1 -- 172.21.15.38:0/3612257848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46ec003e50 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.109+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f41a6c90 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.109+0000 7f46ebe00640 1 -- 172.21.15.38:0/3612257848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0106c0 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.109+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f41a7180 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.110+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f41021c0 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.112+0000 7f46ebe00640 1 -- 172.21.15.38:0/3612257848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f46ec003970 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.114+0000 7f46ebe00640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46d80a2b80 0x7f46d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.114+0000 7f46ebe00640 1 -- 172.21.15.38:0/3612257848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f46ec0cef40 con 0x7f46f4106f10 2024-09-12T12:23:06.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.114+0000 7f46f3400640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46d80a2b80 0x7f46d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.115+0000 7f46f3400640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46d80a2b80 0x7f46d80a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:06.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.119+0000 7f46ebe00640 1 -- 172.21.15.38:0/3612257848 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46ec09b5d0 con 0x7f46f4106f10 2024-09-12T12:23:06.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:05 smithi154 ceph-mon[35578]: pgmap v302: 129 pgs: 17 creating+peering, 15 unknown, 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 649 B/s wr, 1 op/s 2024-09-12T12:23:06.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:05 smithi154 ceph-mon[35578]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:06.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:05 smithi071 ceph-mon[34859]: pgmap v302: 129 pgs: 17 creating+peering, 15 unknown, 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 649 B/s wr, 1 op/s 2024-09-12T12:23:06.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:05 smithi071 ceph-mon[34859]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:06.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.350+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f46f410a0f0 con 0x7f46f4106f10 2024-09-12T12:23:06.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.915+0000 7f46ebe00640 1 -- 172.21.15.38:0/3612257848 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f46ec09f8d0 con 0x7f46f4106f10 2024-09-12T12:23:06.915 INFO:teuthology.orchestra.run.smithi038.stderr:added data pool 4 to fsmap 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46d80a2b80 msgr2=0x7f46d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46d80a2b80 0x7f46d80a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e4005b50 comp rx=0 tx=0).stop 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4106f10 msgr2=0x7f46f4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4106f10 0x7f46f4074f70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009fd0 tx=0x7f46ec00b260 comp rx=0 tx=0).stop 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 shutdown_connections 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46d80a2b80 0x7f46d80a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46f4106f10 0x7f46f4074f70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f4102790 0x7f46f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 --2- 172.21.15.38:0/3612257848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46f4101de0 0x7f46f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 >> 172.21.15.38:0/3612257848 conn(0x7f46f40fd8c0 msgr2=0x7f46f40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:06.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 shutdown_connections 2024-09-12T12:23:06.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:06.918+0000 7f46fa600640 1 -- 172.21.15.38:0/3612257848 wait complete. 2024-09-12T12:23:07.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:06 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3612257848' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T12:23:07.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:06 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3612257848' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T12:23:07.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:06 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3612257848' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T12:23:07.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:08.197 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:08.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:07 smithi038 ceph-mon[30810]: pgmap v304: 129 pgs: 17 creating+peering, 13 unknown, 99 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T12:23:08.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:07 smithi038 ceph-mon[30810]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:23:08.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:07 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3612257848' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T12:23:08.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:07 smithi038 ceph-mon[30810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:08.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:07 smithi071 ceph-mon[34859]: pgmap v304: 129 pgs: 17 creating+peering, 13 unknown, 99 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T12:23:08.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:07 smithi071 ceph-mon[34859]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:23:08.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:07 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3612257848' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T12:23:08.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:07 smithi071 ceph-mon[34859]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:08.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:07 smithi154 ceph-mon[35578]: pgmap v304: 129 pgs: 17 creating+peering, 13 unknown, 99 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T12:23:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:07 smithi154 ceph-mon[35578]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:23:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:07 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3612257848' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T12:23:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:07 smithi154 ceph-mon[35578]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 -- 172.21.15.38:0/213976552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae581047e0 msgr2=0x7fae58108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 --2- 172.21.15.38:0/213976552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae581047e0 0x7fae58108830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae44009900 tx=0x7fae4402a410 comp rx=0 tx=0).stop 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 -- 172.21.15.38:0/213976552 shutdown_connections 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 --2- 172.21.15.38:0/213976552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae58108f60 0x7fae58110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 --2- 172.21.15.38:0/213976552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae581047e0 0x7fae58108830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 --2- 172.21.15.38:0/213976552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae58103e30 0x7fae58104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 -- 172.21.15.38:0/213976552 >> 172.21.15.38:0/213976552 conn(0x7fae580ff910 msgr2=0x7fae58101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 -- 172.21.15.38:0/213976552 shutdown_connections 2024-09-12T12:23:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.706+0000 7fae5ee00640 1 -- 172.21.15.38:0/213976552 wait complete. 2024-09-12T12:23:08.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.707+0000 7fae5ee00640 1 Processor -- start 2024-09-12T12:23:08.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.707+0000 7fae5ee00640 1 -- start start 2024-09-12T12:23:08.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.707+0000 7fae5ee00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae58103e30 0x7fae5819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5ee00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae581047e0 0x7fae5819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5ee00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae58108f60 0x7fae5819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5ee00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fae58114010 con 0x7fae58108f60 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5ee00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fae58113e90 con 0x7fae581047e0 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5ee00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae58114190 con 0x7fae58103e30 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae58108f60 0x7fae5819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5da00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae58103e30 0x7fae5819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae58108f60 0x7fae5819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51850/0 (socket says 172.21.15.38:51850) 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 -- 172.21.15.38:0/3684425643 learned_addr learned my addr 172.21.15.38:0/3684425643 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:08.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5d000640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae581047e0 0x7fae5819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 -- 172.21.15.38:0/3684425643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae58103e30 msgr2=0x7fae5819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae58103e30 0x7fae5819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 -- 172.21.15.38:0/3684425643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae581047e0 msgr2=0x7fae5819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae581047e0 0x7fae5819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5e400640 1 -- 172.21.15.38:0/3684425643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5819f420 con 0x7fae58108f60 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.708+0000 7fae5da00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae58103e30 0x7fae5819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.709+0000 7fae5e400640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae58108f60 0x7fae5819ed40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae5000eb10 tx=0x7fae5000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.709+0000 7fae56000640 1 -- 172.21.15.38:0/3684425643 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50004b20 con 0x7fae58108f60 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.709+0000 7fae56000640 1 -- 172.21.15.38:0/3684425643 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae50004cc0 con 0x7fae58108f60 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.709+0000 7fae56000640 1 -- 172.21.15.38:0/3684425643 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50010760 con 0x7fae58108f60 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.709+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5819f710 con 0x7fae58108f60 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.709+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae581a6ff0 con 0x7fae58108f60 2024-09-12T12:23:08.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.710+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae58105310 con 0x7fae58108f60 2024-09-12T12:23:08.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.712+0000 7fae56000640 1 -- 172.21.15.38:0/3684425643 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fae50005020 con 0x7fae58108f60 2024-09-12T12:23:08.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.714+0000 7fae56000640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fae400a2cd0 0x7fae400a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.714+0000 7fae56000640 1 -- 172.21.15.38:0/3684425643 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fae500cf830 con 0x7fae58108f60 2024-09-12T12:23:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.714+0000 7fae5da00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fae400a2cd0 0x7fae400a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.715+0000 7fae5da00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fae400a2cd0 0x7fae400a5190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009fc0 tx=0x7fae4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.718+0000 7fae56000640 1 -- 172.21.15.38:0/3684425643 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae5009c4f0 con 0x7fae58108f60 2024-09-12T12:23:08.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.938+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae58104210 con 0x7fae58108f60 2024-09-12T12:23:08.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.939+0000 7fae56000640 1 -- 172.21.15.38:0/3684425643 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11833 (secure 0 0 0) 0x7fae58104210 con 0x7fae58108f60 2024-09-12T12:23:08.940 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:08.940 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"btime":"2024-09-12T12:23:06:907384+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:06.351859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24557,"qdb_cluster":[24557]},"id":1}]} 2024-09-12T12:23:08.940 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2024-09-12T12:23:08.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.941+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fae400a2cd0 msgr2=0x7fae400a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.941+0000 7fae5ee00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fae400a2cd0 0x7fae400a5190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009fc0 tx=0x7fae4c005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:08.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.941+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae58108f60 msgr2=0x7fae5819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.941+0000 7fae5ee00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae58108f60 0x7fae5819ed40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae5000eb10 tx=0x7fae5000c2d0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 shutdown_connections 2024-09-12T12:23:08.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fae400a2cd0 0x7fae400a5190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae58108f60 0x7fae5819ed40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae581047e0 0x7fae5819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 --2- 172.21.15.38:0/3684425643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae58103e30 0x7fae5819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 >> 172.21.15.38:0/3684425643 conn(0x7fae580ff910 msgr2=0x7fae58100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 shutdown_connections 2024-09-12T12:23:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:08.942+0000 7fae5ee00640 1 -- 172.21.15.38:0/3684425643 wait complete. 2024-09-12T12:23:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:08 smithi038 ceph-mon[30810]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T12:23:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:08 smithi038 ceph-mon[30810]: Cluster is now healthy 2024-09-12T12:23:09.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:08 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3684425643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:09.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:08 smithi071 ceph-mon[34859]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T12:23:09.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:08 smithi071 ceph-mon[34859]: Cluster is now healthy 2024-09-12T12:23:09.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:08 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3684425643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:08 smithi154 ceph-mon[35578]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T12:23:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:08 smithi154 ceph-mon[35578]: Cluster is now healthy 2024-09-12T12:23:09.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:08 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3684425643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:09.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:23:10.208 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:10.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:09 smithi038 ceph-mon[30810]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:10.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:09 smithi071 ceph-mon[34859]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:10.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:09 smithi154 ceph-mon[35578]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:10.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 -- 172.21.15.38:0/1828397697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98601047e0 msgr2=0x7f9860108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 --2- 172.21.15.38:0/1828397697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98601047e0 0x7f9860108830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9848009900 tx=0x7f984802a410 comp rx=0 tx=0).stop 2024-09-12T12:23:10.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 -- 172.21.15.38:0/1828397697 shutdown_connections 2024-09-12T12:23:10.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 --2- 172.21.15.38:0/1828397697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9860108f60 0x7f9860110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 --2- 172.21.15.38:0/1828397697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98601047e0 0x7f9860108830 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 --2- 172.21.15.38:0/1828397697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860103e30 0x7f9860104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 -- 172.21.15.38:0/1828397697 >> 172.21.15.38:0/1828397697 conn(0x7f98600ff8d0 msgr2=0x7f9860101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:10.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 -- 172.21.15.38:0/1828397697 shutdown_connections 2024-09-12T12:23:10.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.733+0000 7f9864a00640 1 -- 172.21.15.38:0/1828397697 wait complete. 2024-09-12T12:23:10.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 Processor -- start 2024-09-12T12:23:10.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 -- start start 2024-09-12T12:23:10.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9860103e30 0x7f986019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98601047e0 0x7f986019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9860108f60 0x7f986019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9860114010 con 0x7f9860108f60 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9860113e90 con 0x7f9860103e30 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f9864a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9860114190 con 0x7f98601047e0 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f985f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9860108f60 0x7f986019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f985e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9860103e30 0x7f986019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.735+0000 7f985f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9860108f60 0x7f986019ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51876/0 (socket says 172.21.15.38:51876) 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985f200640 1 -- 172.21.15.38:0/3073330622 learned_addr learned my addr 172.21.15.38:0/3073330622 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f9855e00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98601047e0 0x7f986019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985f200640 1 -- 172.21.15.38:0/3073330622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98601047e0 msgr2=0x7f986019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985f200640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98601047e0 0x7f986019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985f200640 1 -- 172.21.15.38:0/3073330622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9860103e30 msgr2=0x7f986019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985f200640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9860103e30 0x7f986019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985f200640 1 -- 172.21.15.38:0/3073330622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986019f440 con 0x7f9860108f60 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985e800640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9860103e30 0x7f986019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.736+0000 7f985f200640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9860108f60 0x7f986019ed60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f985800e970 tx=0x7f985800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.737+0000 7f9857e00640 1 -- 172.21.15.38:0/3073330622 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985800ccc0 con 0x7f9860108f60 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.737+0000 7f9857e00640 1 -- 172.21.15.38:0/3073330622 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f985800ce60 con 0x7f9860108f60 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.737+0000 7f9857e00640 1 -- 172.21.15.38:0/3073330622 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858010490 con 0x7f9860108f60 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.737+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986019f730 con 0x7f9860108f60 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.737+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98601a7010 con 0x7f9860108f60 2024-09-12T12:23:10.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.738+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9860104210 con 0x7f9860108f60 2024-09-12T12:23:10.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.740+0000 7f9857e00640 1 -- 172.21.15.38:0/3073330622 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9858005020 con 0x7f9860108f60 2024-09-12T12:23:10.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.741+0000 7f9857e00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98440a2c00 0x7f98440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.741+0000 7f9857e00640 1 -- 172.21.15.38:0/3073330622 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f98580cf680 con 0x7f9860108f60 2024-09-12T12:23:10.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.741+0000 7f985e800640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98440a2c00 0x7f98440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.742+0000 7f985e800640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98440a2c00 0x7f98440a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9850009fd0 tx=0x7f9850009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:10.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.745+0000 7f9857e00640 1 -- 172.21.15.38:0/3073330622 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f985809c340 con 0x7f9860108f60 2024-09-12T12:23:10.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.931+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f986010bbb0 con 0x7f9860108f60 2024-09-12T12:23:10.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.933+0000 7f9857e00640 1 -- 172.21.15.38:0/3073330622 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24199 (secure 0 0 0) 0x7f985809bc40 con 0x7f9860108f60 2024-09-12T12:23:10.933 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:10.933 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":89,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:06.351651+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98440a2c00 msgr2=0x7f98440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98440a2c00 0x7f98440a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9850009fd0 tx=0x7f9850009680 comp rx=0 tx=0).stop 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9860108f60 msgr2=0x7f986019ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9860108f60 0x7f986019ed60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f985800e970 tx=0x7f985800ed70 comp rx=0 tx=0).stop 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 shutdown_connections 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98440a2c00 0x7f98440a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9860108f60 0x7f986019ed60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98601047e0 0x7f986019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 --2- 172.21.15.38:0/3073330622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9860103e30 0x7f986019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 >> 172.21.15.38:0/3073330622 conn(0x7f98600ff8d0 msgr2=0x7f9860100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:10.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 shutdown_connections 2024-09-12T12:23:10.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:10.937+0000 7f9864a00640 1 -- 172.21.15.38:0/3073330622 wait complete. 2024-09-12T12:23:11.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:10 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3073330622' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:11.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:10 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3073330622' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:11.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:10 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3073330622' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:11.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:23:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:11 smithi038 ceph-mon[30810]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:12.254 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:12.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:11 smithi071 ceph-mon[34859]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:12.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:11 smithi154 ceph-mon[35578]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 -- 172.21.15.38:0/754164751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34103e30 msgr2=0x7fbb34104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 --2- 172.21.15.38:0/754164751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34103e30 0x7fbb34104210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009900 tx=0x7fbb2402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 -- 172.21.15.38:0/754164751 shutdown_connections 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 --2- 172.21.15.38:0/754164751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb34108f60 0x7fbb34110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 --2- 172.21.15.38:0/754164751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb341047e0 0x7fbb34108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 --2- 172.21.15.38:0/754164751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34103e30 0x7fbb34104210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 -- 172.21.15.38:0/754164751 >> 172.21.15.38:0/754164751 conn(0x7fbb340ff8d0 msgr2=0x7fbb34101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 -- 172.21.15.38:0/754164751 shutdown_connections 2024-09-12T12:23:12.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.794+0000 7fbb33200640 1 -- 172.21.15.38:0/754164751 wait complete. 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 Processor -- start 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 -- start start 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34103e30 0x7fbb3419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb341047e0 0x7fbb3419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34108f60 0x7fbb3419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34114010 con 0x7fbb34108f60 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34113e90 con 0x7fbb341047e0 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.795+0000 7fbb33200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34114190 con 0x7fbb34103e30 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb32800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34108f60 0x7fbb3419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34103e30 0x7fbb3419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34103e30 0x7fbb3419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:54894/0 (socket says 172.21.15.38:54894) 2024-09-12T12:23:12.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 -- 172.21.15.38:0/38509537 learned_addr learned my addr 172.21.15.38:0/38509537 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:12.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb29400640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb341047e0 0x7fbb3419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:12.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 -- 172.21.15.38:0/38509537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb341047e0 msgr2=0x7fbb3419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:12.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb341047e0 0x7fbb3419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 -- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34108f60 msgr2=0x7fbb3419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:12.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34108f60 0x7fbb3419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.796+0000 7fbb31e00640 1 -- 172.21.15.38:0/38509537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3419f400 con 0x7fbb34103e30 2024-09-12T12:23:12.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.797+0000 7fbb31e00640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34103e30 0x7fbb3419a450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb24004770 tx=0x7fbb24003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:12.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.797+0000 7fbb2b400640 1 -- 172.21.15.38:0/38509537 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2403f070 con 0x7fbb34103e30 2024-09-12T12:23:12.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.797+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3419f690 con 0x7fbb34103e30 2024-09-12T12:23:12.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.797+0000 7fbb2b400640 1 -- 172.21.15.38:0/38509537 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb24031ca0 con 0x7fbb34103e30 2024-09-12T12:23:12.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.797+0000 7fbb2b400640 1 -- 172.21.15.38:0/38509537 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24035030 con 0x7fbb34103e30 2024-09-12T12:23:12.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.797+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb341a6fd0 con 0x7fbb34103e30 2024-09-12T12:23:12.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.798+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb34104210 con 0x7fbb34103e30 2024-09-12T12:23:12.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.800+0000 7fbb2b400640 1 -- 172.21.15.38:0/38509537 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbb24042070 con 0x7fbb34103e30 2024-09-12T12:23:12.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.802+0000 7fbb2b400640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbb180a2c00 0x7fbb180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:12.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.802+0000 7fbb2b400640 1 -- 172.21.15.38:0/38509537 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fbb240efe80 con 0x7fbb34103e30 2024-09-12T12:23:12.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.802+0000 7fbb29400640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbb180a2c00 0x7fbb180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:12.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.802+0000 7fbb29400640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbb180a2c00 0x7fbb180a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb340ffcf0 tx=0x7fbb1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.804+0000 7fbb2b400640 1 -- 172.21.15.38:0/38509537 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb240bc4f0 con 0x7fbb34103e30 2024-09-12T12:23:12.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.988+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb3410c140 con 0x7fbb34103e30 2024-09-12T12:23:12.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.990+0000 7fbb2b400640 1 -- 172.21.15.38:0/38509537 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24199 (secure 0 0 0) 0x7fbb240c07f0 con 0x7fbb34103e30 2024-09-12T12:23:12.990 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:12.990 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":89,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:06.351651+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbb180a2c00 msgr2=0x7fbb180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbb180a2c00 0x7fbb180a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb340ffcf0 tx=0x7fbb1c005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34103e30 msgr2=0x7fbb3419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34103e30 0x7fbb3419a450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb24004770 tx=0x7fbb24003c10 comp rx=0 tx=0).stop 2024-09-12T12:23:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 shutdown_connections 2024-09-12T12:23:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbb180a2c00 0x7fbb180a50c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb34108f60 0x7fbb3419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.992+0000 7fbb33200640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb341047e0 0x7fbb3419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.993+0000 7fbb33200640 1 --2- 172.21.15.38:0/38509537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb34103e30 0x7fbb3419a450 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.993+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 >> 172.21.15.38:0/38509537 conn(0x7fbb340ff8d0 msgr2=0x7fbb34100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.993+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 shutdown_connections 2024-09-12T12:23:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:12.993+0000 7fbb33200640 1 -- 172.21.15.38:0/38509537 wait complete. 2024-09-12T12:23:13.867 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:14.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:13 smithi038 ceph-mon[30810]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:14.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:13 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/38509537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:14.246 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:14.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:13 smithi071 ceph-mon[34859]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:14.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:13 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/38509537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:14.430 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:13 smithi154 ceph-mon[35578]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:14.431 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:13 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/38509537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:14.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.777+0000 7fbbc5800640 1 -- 172.21.15.38:0/1452710316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0077040 msgr2=0x7fbbc01124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 --2- 172.21.15.38:0/1452710316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0077040 0x7fbbc01124f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009900 tx=0x7fbba802a410 comp rx=0 tx=0).stop 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 -- 172.21.15.38:0/1452710316 shutdown_connections 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 --2- 172.21.15.38:0/1452710316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0112a30 0x7fbbc0114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 --2- 172.21.15.38:0/1452710316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0077040 0x7fbbc01124f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 --2- 172.21.15.38:0/1452710316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc0076720 0x7fbbc0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 -- 172.21.15.38:0/1452710316 >> 172.21.15.38:0/1452710316 conn(0x7fbbc00ffa90 msgr2=0x7fbbc0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 -- 172.21.15.38:0/1452710316 shutdown_connections 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.778+0000 7fbbc5800640 1 -- 172.21.15.38:0/1452710316 wait complete. 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 Processor -- start 2024-09-12T12:23:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 -- start start 2024-09-12T12:23:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0076720 0x7fbbc01a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0077040 0x7fbbc01a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc0112a30 0x7fbbc019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc01185c0 con 0x7fbbc0076720 2024-09-12T12:23:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc0118440 con 0x7fbbc0077040 2024-09-12T12:23:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.779+0000 7fbbc5800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc0118740 con 0x7fbbc0112a30 2024-09-12T12:23:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbbea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0076720 0x7fbbc01a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0077040 0x7fbbc01a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbbea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0076720 0x7fbbc01a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51908/0 (socket says 172.21.15.38:51908) 2024-09-12T12:23:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0077040 0x7fbbc01a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:39224/0 (socket says 172.21.15.38:39224) 2024-09-12T12:23:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbbea00640 1 -- 172.21.15.38:0/3959093557 learned_addr learned my addr 172.21.15.38:0/3959093557 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbbf400640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc0112a30 0x7fbbc019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 -- 172.21.15.38:0/3959093557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc0112a30 msgr2=0x7fbbc019e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc0112a30 0x7fbbc019e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 -- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0076720 msgr2=0x7fbbc01a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0076720 0x7fbbc01a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 -- 172.21.15.38:0/3959093557 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc019f020 con 0x7fbbc0077040 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.780+0000 7fbbb7e00640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0077040 0x7fbbc01a4c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbba8005940 tx=0x7fbba80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.781+0000 7fbbb7400640 1 -- 172.21.15.38:0/3959093557 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba803f030 con 0x7fbbc0077040 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.781+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc019f2b0 con 0x7fbbc0077040 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.781+0000 7fbbb7400640 1 -- 172.21.15.38:0/3959093557 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba8003ce0 con 0x7fbbc0077040 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.781+0000 7fbbb7400640 1 -- 172.21.15.38:0/3959093557 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8035070 con 0x7fbbc0077040 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.781+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc01ab600 con 0x7fbbc0077040 2024-09-12T12:23:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.782+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc0076b00 con 0x7fbbc0077040 2024-09-12T12:23:14.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.784+0000 7fbbb7400640 1 -- 172.21.15.38:0/3959093557 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbba8042030 con 0x7fbbc0077040 2024-09-12T12:23:14.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.785+0000 7fbbb7400640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbba40a2b80 0x7fbba40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.785+0000 7fbbb7400640 1 -- 172.21.15.38:0/3959093557 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fbba80efcf0 con 0x7fbbc0077040 2024-09-12T12:23:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.785+0000 7fbbbea00640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbba40a2b80 0x7fbba40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.786+0000 7fbbbea00640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbba40a2b80 0x7fbba40a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbc019fa30 tx=0x7fbbb000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:14.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:14.787+0000 7fbbb7400640 1 -- 172.21.15.38:0/3959093557 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbba80bc360 con 0x7fbbc0077040 2024-09-12T12:23:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.012+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbc019fe20 con 0x7fbbc0077040 2024-09-12T12:23:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.013+0000 7fbbb7400640 1 -- 172.21.15.38:0/3959093557 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11833 (secure 0 0 0) 0x7fbba80c0660 con 0x7fbbc0077040 2024-09-12T12:23:15.013 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:15.013 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"btime":"2024-09-12T12:23:06:907384+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14526,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:06.351859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24557,"qdb_cluster":[24557]},"id":1}]} 2024-09-12T12:23:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbba40a2b80 msgr2=0x7fbba40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbba40a2b80 0x7fbba40a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbc019fa30 tx=0x7fbbb000b410 comp rx=0 tx=0).stop 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0077040 msgr2=0x7fbbc01a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0077040 0x7fbbc01a4c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbba8005940 tx=0x7fbba80042f0 comp rx=0 tx=0).stop 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 shutdown_connections 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbba40a2b80 0x7fbba40a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbc0112a30 0x7fbbc019e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc0077040 0x7fbbc01a4c70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 --2- 172.21.15.38:0/3959093557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbbc0076720 0x7fbbc01a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.015+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 >> 172.21.15.38:0/3959093557 conn(0x7fbbc00ffa90 msgr2=0x7fbbc0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.016+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 shutdown_connections 2024-09-12T12:23:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:15.016+0000 7fbbc5800640 1 -- 172.21.15.38:0/3959093557 wait complete. 2024-09-12T12:23:15.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:23:16.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:15 smithi038 ceph-mon[30810]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:16.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:15 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3959093557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:16.255 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:16.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:15 smithi071 ceph-mon[34859]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:16.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:15 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3959093557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:16.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:15 smithi154 ceph-mon[35578]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:16.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:15 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3959093557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:16.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 -- 172.21.15.38:0/1592819414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 msgr2=0x7f1e241089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 --2- 172.21.15.38:0/1592819414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 0x7f1e241089f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009900 tx=0x7f1e0c02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 -- 172.21.15.38:0/1592819414 shutdown_connections 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 --2- 172.21.15.38:0/1592819414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24109120 0x7f1e24110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 --2- 172.21.15.38:0/1592819414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 0x7f1e241089f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 --2- 172.21.15.38:0/1592819414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e24103ff0 0x7f1e241043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 -- 172.21.15.38:0/1592819414 >> 172.21.15.38:0/1592819414 conn(0x7f1e240ffa90 msgr2=0x7f1e24101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 -- 172.21.15.38:0/1592819414 shutdown_connections 2024-09-12T12:23:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.802+0000 7f1e29200640 1 -- 172.21.15.38:0/1592819414 wait complete. 2024-09-12T12:23:16.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 Processor -- start 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 -- start start 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24103ff0 0x7f1e2419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 0x7f1e2419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e24109120 0x7f1e2419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24114190 con 0x7f1e241049a0 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24114010 con 0x7f1e24109120 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e29200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24114310 con 0x7f1e24103ff0 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 0x7f1e2419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.803+0000 7f1e21e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24103ff0 0x7f1e2419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24103ff0 0x7f1e2419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:46860/0 (socket says 172.21.15.38:46860) 2024-09-12T12:23:16.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 -- 172.21.15.38:0/2057119256 learned_addr learned my addr 172.21.15.38:0/2057119256 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e22800640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e24109120 0x7f1e2419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 -- 172.21.15.38:0/2057119256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e24109120 msgr2=0x7f1e2419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e24109120 0x7f1e2419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 -- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 msgr2=0x7f1e2419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 0x7f1e2419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 -- 172.21.15.38:0/2057119256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2419f5a0 con 0x7f1e24103ff0 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e1be00640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 0x7f1e2419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.804+0000 7f1e21e00640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24103ff0 0x7f1e2419a5f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400d950 tx=0x7f1e1400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.805+0000 7f1e1aa00640 1 -- 172.21.15.38:0/2057119256 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e14017070 con 0x7f1e24103ff0 2024-09-12T12:23:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.805+0000 7f1e1aa00640 1 -- 172.21.15.38:0/2057119256 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e14009c30 con 0x7f1e24103ff0 2024-09-12T12:23:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.805+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2419f890 con 0x7f1e24103ff0 2024-09-12T12:23:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.805+0000 7f1e1aa00640 1 -- 172.21.15.38:0/2057119256 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400f6b0 con 0x7f1e24103ff0 2024-09-12T12:23:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.805+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e241a7170 con 0x7f1e24103ff0 2024-09-12T12:23:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.806+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e241043d0 con 0x7f1e24103ff0 2024-09-12T12:23:16.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.808+0000 7f1e1aa00640 1 -- 172.21.15.38:0/2057119256 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e140109d0 con 0x7f1e24103ff0 2024-09-12T12:23:16.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.809+0000 7f1e1aa00640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1e080a2c00 0x7f1e080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:16.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.809+0000 7f1e1aa00640 1 -- 172.21.15.38:0/2057119256 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f1e140cedc0 con 0x7f1e24103ff0 2024-09-12T12:23:16.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.810+0000 7f1e1be00640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1e080a2c00 0x7f1e080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:16.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.810+0000 7f1e1be00640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1e080a2c00 0x7f1e080a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:16.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:16.811+0000 7f1e1aa00640 1 -- 172.21.15.38:0/2057119256 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e14009de0 con 0x7f1e24103ff0 2024-09-12T12:23:17.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.001+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e241a73a0 con 0x7f1e24103ff0 2024-09-12T12:23:17.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.003+0000 7f1e1aa00640 1 -- 172.21.15.38:0/2057119256 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24199 (secure 0 0 0) 0x7f1e1409b4b0 con 0x7f1e24103ff0 2024-09-12T12:23:17.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:17.004 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":89,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:06.351651+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1e080a2c00 msgr2=0x7f1e080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1e080a2c00 0x7f1e080a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c031510 comp rx=0 tx=0).stop 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24103ff0 msgr2=0x7f1e2419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24103ff0 0x7f1e2419a5f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400d950 tx=0x7f1e1400de10 comp rx=0 tx=0).stop 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 shutdown_connections 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1e080a2c00 0x7f1e080a50c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e24109120 0x7f1e2419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e241049a0 0x7f1e2419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 --2- 172.21.15.38:0/2057119256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e24103ff0 0x7f1e2419a5f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 >> 172.21.15.38:0/2057119256 conn(0x7f1e240ffa90 msgr2=0x7f1e24101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 shutdown_connections 2024-09-12T12:23:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:17.006+0000 7f1e29200640 1 -- 172.21.15.38:0/2057119256 wait complete. 2024-09-12T12:23:17.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:22:55.298669+0000', 'modified': '2024-09-12T12:23:06.351859+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24557}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24557': {'gid': 24557, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.71:6839/3960727102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3960727102}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3960727102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24557, 'qdb_cluster': [24557]} 2024-09-12T12:23:17.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:23:17.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T12:23:18.150 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:18.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:18 smithi071 ceph-mon[34859]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:18.265 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:18 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2057119256' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:18.289 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:17 smithi038 ceph-mon[30810]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:18.290 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:17 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2057119256' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:18 smithi154 ceph-mon[35578]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:18 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2057119256' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.678+0000 7efe77000640 1 -- 172.21.15.38:0/2653196849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe70103ff0 msgr2=0x7efe701043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.678+0000 7efe77000640 1 --2- 172.21.15.38:0/2653196849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe70103ff0 0x7efe701043d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe60009900 tx=0x7efe6002a410 comp rx=0 tx=0).stop 2024-09-12T12:23:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.679+0000 7efe77000640 1 -- 172.21.15.38:0/2653196849 shutdown_connections 2024-09-12T12:23:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.679+0000 7efe77000640 1 --2- 172.21.15.38:0/2653196849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe70109120 0x7efe70110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.679+0000 7efe77000640 1 --2- 172.21.15.38:0/2653196849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe701049a0 0x7efe701089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.679+0000 7efe77000640 1 --2- 172.21.15.38:0/2653196849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe70103ff0 0x7efe701043d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.679+0000 7efe77000640 1 -- 172.21.15.38:0/2653196849 >> 172.21.15.38:0/2653196849 conn(0x7efe700ffa90 msgr2=0x7efe70101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.679+0000 7efe77000640 1 -- 172.21.15.38:0/2653196849 shutdown_connections 2024-09-12T12:23:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.679+0000 7efe77000640 1 -- 172.21.15.38:0/2653196849 wait complete. 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.680+0000 7efe77000640 1 Processor -- start 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.680+0000 7efe77000640 1 -- start start 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.680+0000 7efe77000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe70103ff0 0x7efe7019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.680+0000 7efe77000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe701049a0 0x7efe7019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.680+0000 7efe77000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe70109120 0x7efe7019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe77000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7efe70114140 con 0x7efe701049a0 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe77000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe70113fc0 con 0x7efe70109120 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe77000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe701142c0 con 0x7efe70103ff0 2024-09-12T12:23:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe70103ff0 0x7efe7019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe67400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe701049a0 0x7efe7019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe70103ff0 0x7efe7019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:46872/0 (socket says 172.21.15.38:46872) 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 -- 172.21.15.38:0/766689054 learned_addr learned my addr 172.21.15.38:0/766689054 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe75000640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe70109120 0x7efe7019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 -- 172.21.15.38:0/766689054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe70109120 msgr2=0x7efe7019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe70109120 0x7efe7019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 -- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe701049a0 msgr2=0x7efe7019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe701049a0 0x7efe7019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe6fe00640 1 -- 172.21.15.38:0/766689054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7019f670 con 0x7efe70103ff0 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.681+0000 7efe67400640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe701049a0 0x7efe7019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.682+0000 7efe6fe00640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe70103ff0 0x7efe7019a6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe60006010 tx=0x7efe600042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.682+0000 7efe6d600640 1 -- 172.21.15.38:0/766689054 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6003f030 con 0x7efe70103ff0 2024-09-12T12:23:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.682+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7019f900 con 0x7efe70103ff0 2024-09-12T12:23:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.682+0000 7efe6d600640 1 -- 172.21.15.38:0/766689054 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe60003ce0 con 0x7efe70103ff0 2024-09-12T12:23:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.682+0000 7efe6d600640 1 -- 172.21.15.38:0/766689054 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60035070 con 0x7efe70103ff0 2024-09-12T12:23:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.682+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe701a7240 con 0x7efe70103ff0 2024-09-12T12:23:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.685+0000 7efe79abb740 1 Processor -- start 2024-09-12T12:23:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.685+0000 7efe79abb740 1 -- start start 2024-09-12T12:23:18.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.685+0000 7efe6d600640 1 -- 172.21.15.38:0/766689054 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efe60042030 con 0x7efe70103ff0 2024-09-12T12:23:18.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe79abb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe79abb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589eb5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe79abb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eb6510 0x555589eb8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe79abb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555589e110b0 con 0x555589eabc50 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe79abb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555589db8ab0 con 0x555589eab330 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe79abb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555589e0d070 con 0x555589eb6510 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe67400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eb6510 0x555589eb8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eab710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:46450/0 (socket says 172.21.15.38:46450) 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 -- 172.21.15.38:0/2532905011 learned_addr learned my addr 172.21.15.38:0/2532905011 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe6fe00640 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589eb5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 -- 172.21.15.38:0/2532905011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eb6510 msgr2=0x555589eb8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eb6510 0x555589eb8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 -- 172.21.15.38:0/2532905011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 msgr2=0x555589eb5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589eb5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.686+0000 7efe75000640 1 -- 172.21.15.38:0/2532905011 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555589dc54a0 con 0x555589eab330 2024-09-12T12:23:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.687+0000 7efe75000640 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eab710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe68009f70 tx=0x7efe68010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a23eff71265098 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.687+0000 7efe65600640 1 -- 172.21.15.38:0/2532905011 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68016070 con 0x555589eab330 2024-09-12T12:23:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.687+0000 7efe6d600640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe540a2b80 0x7efe540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.687+0000 7efe65600640 1 -- 172.21.15.38:0/2532905011 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe68004d20 con 0x555589eab330 2024-09-12T12:23:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.687+0000 7efe65600640 1 -- 172.21.15.38:0/2532905011 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe680128f0 con 0x555589eab330 2024-09-12T12:23:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.687+0000 7efe6d600640 1 -- 172.21.15.38:0/766689054 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7efe600ef810 con 0x7efe70103ff0 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.687+0000 7efe6fe00640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe540a2b80 0x7efe540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 -- 172.21.15.38:0/2532905011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 msgr2=0x555589eab710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eab710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe68009f70 tx=0x7efe68010800 comp rx=0 tx=0).stop 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 -- 172.21.15.38:0/2532905011 shutdown_connections 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eb6510 0x555589eb8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589eb5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 --2- 172.21.15.38:0/2532905011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eab710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe6fe00640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe540a2b80 0x7efe540a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efe60005ab0 tx=0x7efe6002a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 -- 172.21.15.38:0/2532905011 >> 172.21.15.38:0/2532905011 conn(0x555589ea78c0 msgr2=0x555589ea7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 -- 172.21.15.38:0/2532905011 shutdown_connections 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.688+0000 7efe79abb740 1 -- 172.21.15.38:0/2532905011 wait complete. 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 -- start start 2024-09-12T12:23:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 Processor -- start 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589eb40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555589eb9060 con 0x555589eb6510 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555589d99920 con 0x555589eab330 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555589eb91e0 con 0x555589eabc50 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe79abb740 10 client.0 _ll_register_callbacks cb 0x555589dbd8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe75000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe75000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589eb40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe75000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:46452/0 (socket says 172.21.15.38:46452) 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.689+0000 7efe75000640 1 -- 172.21.15.38:0/1367586155 learned_addr learned my addr 172.21.15.38:0/1367586155 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe67400640 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe75000640 1 -- 172.21.15.38:0/1367586155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 msgr2=0x555589eb3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe75000640 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe75000640 1 -- 172.21.15.38:0/1367586155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 msgr2=0x555589eb40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe75000640 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589eb40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe75000640 1 -- 172.21.15.38:0/1367586155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555589b822b0 con 0x555589eab330 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe67400640 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe75000640 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb3640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe68005ab0 tx=0x7efe68012620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e13c3559eab7f18a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe5e000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe5e000640 1 -- 172.21.15.38:0/1367586155 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68016070 con 0x555589eab330 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe68004d20 con 0x555589eab330 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.690+0000 7efe5e000640 1 -- 172.21.15.38:0/1367586155 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7efe68003970 con 0x555589eab330 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe5e000640 1 -- 172.21.15.38:0/1367586155 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efe68031050 con 0x555589eab330 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 10 client.24653 fetch_fsmap learned FSMap version 17 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x555589ec4e40 con 0x555589eab330 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe5e000640 1 -- 172.21.15.38:0/1367586155 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe68004d20 con 0x555589eab330 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe5e000640 1 -- 172.21.15.38:0/1367586155 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7efe6800f040 con 0x555589eab330 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 10 client.24653 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 10 client.24653 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 20 client.24653 populate_metadata read hostname 'smithi038' 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589ec72c0 0x555589ec8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 4 client.24653 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:23:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.691+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555589e1e620 con 0x555589ec72c0 2024-09-12T12:23:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.692+0000 7efe67400640 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589ec72c0 0x555589ec8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.692+0000 7efe67400640 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589ec72c0 0x555589ec8730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6da7334441c457e server_cookie=34ae6e6f7cefb411 in_seq=0 out_seq=0 2024-09-12T12:23:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.692+0000 7efe5e000640 10 client.24653 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.693+0000 7efe5e000640 1 -- 172.21.15.38:0/1367586155 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555589e1e620 con 0x555589ec72c0 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.693+0000 7efe5e000640 10 client.24653 handle_command_reply: tid=0 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.693+0000 7efe79abb740 1 client.24653 shutdown 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.693+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 msgr2=0x555589eb3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.693+0000 7efe79abb740 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb3640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe68005ab0 tx=0x7efe68012620 comp rx=0 tx=0).stop 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 shutdown_connections 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589ec72c0 0x555589ec8730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589eb40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe5e000640 0 client.24653 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:23:18.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 --2- 172.21.15.38:0/1367586155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb3640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 >> 172.21.15.38:0/1367586155 conn(0x555589ea78c0 msgr2=0x555589ead5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:18.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 shutdown_connections 2024-09-12T12:23:18.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 1 -- 172.21.15.38:0/1367586155 wait complete. 2024-09-12T12:23:18.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.694+0000 7efe79abb740 20 client.24653 trim_cache size 0 max 16384 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.712+0000 7efe79abb740 1 Processor -- start 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.712+0000 7efe79abb740 1 -- start start 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe79abb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eab330 0x555589eb2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe79abb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589ec62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe79abb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eb6510 0x555589eb1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe79abb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555589ec6a70 con 0x555589eabc50 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe79abb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555589ec7140 con 0x555589eb6510 2024-09-12T12:23:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe79abb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555589ec7810 con 0x555589eab330 2024-09-12T12:23:18.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589ec62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589ec62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51032/0 (socket says 172.21.15.38:51032) 2024-09-12T12:23:18.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 -- 172.21.15.38:0/2859961978 learned_addr learned my addr 172.21.15.38:0/2859961978 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:18.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe75000640 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eb6510 0x555589eb1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe75000640 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eab330 0x555589eb2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 -- 172.21.15.38:0/2859961978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eab330 msgr2=0x555589eb2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eab330 0x555589eb2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 -- 172.21.15.38:0/2859961978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eb6510 msgr2=0x555589eb1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eb6510 0x555589eb1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.713+0000 7efe67400640 1 -- 172.21.15.38:0/2859961978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555589eb1b90 con 0x555589eabc50 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.714+0000 7efe75000640 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eab330 0x555589eb2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.714+0000 7efe67400640 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589ec62b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x555589eb2ed0 tx=0x7efe58012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c6eb4dfdeab3b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.714+0000 7efe64c00640 1 -- 172.21.15.38:0/2859961978 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580120d0 con 0x555589eabc50 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.714+0000 7efe64c00640 1 -- 172.21.15.38:0/2859961978 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe58005500 con 0x555589eabc50 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.714+0000 7efe64c00640 1 -- 172.21.15.38:0/2859961978 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580047a0 con 0x555589eabc50 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 -- 172.21.15.38:0/2859961978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 msgr2=0x555589ec62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589ec62b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x555589eb2ed0 tx=0x7efe58012b90 comp rx=0 tx=0).stop 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 -- 172.21.15.38:0/2859961978 shutdown_connections 2024-09-12T12:23:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eb6510 0x555589eb1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eabc50 0x555589ec62b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 --2- 172.21.15.38:0/2859961978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eab330 0x555589eb2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 -- 172.21.15.38:0/2859961978 >> 172.21.15.38:0/2859961978 conn(0x555589ea78c0 msgr2=0x555589eadf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:18.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 -- 172.21.15.38:0/2859961978 shutdown_connections 2024-09-12T12:23:18.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 -- 172.21.15.38:0/2859961978 wait complete. 2024-09-12T12:23:18.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 -- start start 2024-09-12T12:23:18.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.715+0000 7efe79abb740 1 Processor -- start 2024-09-12T12:23:18.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe79abb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe79abb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe79abb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589f2f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe79abb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555589ec85b0 con 0x555589eb6510 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe79abb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555589ec7ee0 con 0x555589eab330 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe79abb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555589ec8c80 con 0x555589eabc50 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe79abb740 10 client.0 _ll_register_callbacks cb 0x7efe68004c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe75000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe75000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:46466/0 (socket says 172.21.15.38:46466) 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe75000640 1 -- 172.21.15.38:0/4136697033 learned_addr learned my addr 172.21.15.38:0/4136697033 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe67400640 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.716+0000 7efe75000640 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589f2f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe67400640 1 -- 172.21.15.38:0/4136697033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 msgr2=0x555589eb0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe67400640 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe67400640 1 -- 172.21.15.38:0/4136697033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 msgr2=0x555589f2f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe67400640 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589f2f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe67400640 1 -- 172.21.15.38:0/4136697033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555589f2ff00 con 0x555589eabc50 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe67400640 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb0550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe580104a0 tx=0x7efe58012e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e515bd905865121 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe5e000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe5e000640 1 -- 172.21.15.38:0/4136697033 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe58005220 con 0x555589eabc50 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe58005500 con 0x555589eabc50 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.717+0000 7efe5e000640 1 -- 172.21.15.38:0/4136697033 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7efe580120d0 con 0x555589eabc50 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe5e000640 1 -- 172.21.15.38:0/4136697033 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efe58039050 con 0x555589eabc50 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 10 client.24655 fetch_fsmap learned FSMap version 17 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x555589f31110 con 0x555589eabc50 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe5e000640 1 -- 172.21.15.38:0/4136697033 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe58005500 con 0x555589eabc50 2024-09-12T12:23:18.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe5e000640 1 -- 172.21.15.38:0/4136697033 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7efe58004800 con 0x555589eabc50 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 10 client.24655 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 10 client.24655 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 20 client.24655 populate_metadata read hostname 'smithi038' 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589f35780 0x555589f34490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 4 client.24655 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.718+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "status"}) -- 0x555589e18b30 con 0x555589f35780 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.719+0000 7efe75000640 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589f35780 0x555589f34490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.719+0000 7efe75000640 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589f35780 0x555589f34490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7281a48af0ae6ee1 server_cookie=821c8cafb840ca3c in_seq=0 out_seq=0 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.719+0000 7efe5e000640 10 client.24655 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.719+0000 7efe5e000640 1 -- 172.21.15.38:0/4136697033 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555589e18b30 con 0x555589f35780 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.719+0000 7efe5e000640 10 client.24655 handle_command_reply: tid=0 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.719+0000 7efe79abb740 1 client.24655 shutdown 2024-09-12T12:23:18.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 msgr2=0x555589eb0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb0550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe580104a0 tx=0x7efe58012e40 comp rx=0 tx=0).stop 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 shutdown_connections 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555589f35780 0x555589f34490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555589eb6510 0x555589f2f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555589eabc50 0x555589eb0550 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 --2- 172.21.15.38:0/4136697033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555589eab330 0x555589eb0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe5e000640 0 client.24655 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 >> 172.21.15.38:0/4136697033 conn(0x555589ea78c0 msgr2=0x555589ec62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 shutdown_connections 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 1 -- 172.21.15.38:0/4136697033 wait complete. 2024-09-12T12:23:18.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.720+0000 7efe79abb740 20 client.24655 trim_cache size 0 max 16384 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24557, 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 22.416736662000002, 2024-09-12T12:23:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 17, 2024-09-12T12:23:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 89, 2024-09-12T12:23:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 89, 2024-09-12T12:23:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 35.670609628000001 2024-09-12T12:23:18.726 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:23:18.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe540a2b80 msgr2=0x7efe540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe540a2b80 0x7efe540a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efe60005ab0 tx=0x7efe6002a410 comp rx=0 tx=0).stop 2024-09-12T12:23:18.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe70103ff0 msgr2=0x7efe7019a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe70103ff0 0x7efe7019a6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe60006010 tx=0x7efe600042f0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 shutdown_connections 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe540a2b80 0x7efe540a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe70109120 0x7efe7019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe701049a0 0x7efe7019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 --2- 172.21.15.38:0/766689054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe70103ff0 0x7efe7019a6c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 >> 172.21.15.38:0/766689054 conn(0x7efe700ffa90 msgr2=0x7efe70100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 shutdown_connections 2024-09-12T12:23:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:18.721+0000 7efe77000640 1 -- 172.21.15.38:0/766689054 wait complete. 2024-09-12T12:23:19.701 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:23:19.701 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:19.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T12:23:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:20.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:20 smithi071 ceph-mon[34859]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:20.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:20 smithi038 ceph-mon[30810]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:20.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:20 smithi154 ceph-mon[35578]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 -- 172.21.15.38:0/3765937237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 msgr2=0x7f13041043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 --2- 172.21.15.38:0/3765937237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 0x7f13041043d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009900 tx=0x7f12f802a410 comp rx=0 tx=0).stop 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 -- 172.21.15.38:0/3765937237 shutdown_connections 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 --2- 172.21.15.38:0/3765937237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1304109120 0x7f1304110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 --2- 172.21.15.38:0/3765937237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13041049a0 0x7f13041089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 --2- 172.21.15.38:0/3765937237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 0x7f13041043d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 -- 172.21.15.38:0/3765937237 >> 172.21.15.38:0/3765937237 conn(0x7f13040ffa90 msgr2=0x7f1304101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 -- 172.21.15.38:0/3765937237 shutdown_connections 2024-09-12T12:23:20.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.627+0000 7f130b400640 1 -- 172.21.15.38:0/3765937237 wait complete. 2024-09-12T12:23:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.628+0000 7f130b400640 1 Processor -- start 2024-09-12T12:23:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.628+0000 7f130b400640 1 -- start start 2024-09-12T12:23:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f130b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 0x7f130419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f130b400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13041049a0 0x7f130419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f130b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1304109120 0x7f130419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f130b400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1304114150 con 0x7f1304103ff0 2024-09-12T12:23:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f130b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1304113fd0 con 0x7f1304109120 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f130b400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13041142d0 con 0x7f13041049a0 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f1308a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 0x7f130419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f1303e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13041049a0 0x7f130419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f1303e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13041049a0 0x7f130419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:46920/0 (socket says 172.21.15.38:46920) 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f1303e00640 1 -- 172.21.15.38:0/2662821854 learned_addr learned my addr 172.21.15.38:0/2662821854 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.629+0000 7f1309400640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1304109120 0x7f130419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1303e00640 1 -- 172.21.15.38:0/2662821854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1304109120 msgr2=0x7f130419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1303e00640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1304109120 0x7f130419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1303e00640 1 -- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 msgr2=0x7f130419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1303e00640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 0x7f130419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1303e00640 1 -- 172.21.15.38:0/2662821854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130419f5a0 con 0x7f13041049a0 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1303e00640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13041049a0 0x7f130419ab30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12f000e9f0 tx=0x7f12f000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:20.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1301600640 1 -- 172.21.15.38:0/2662821854 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f000cd80 con 0x7f13041049a0 2024-09-12T12:23:20.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130419f890 con 0x7f13041049a0 2024-09-12T12:23:20.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1301600640 1 -- 172.21.15.38:0/2662821854 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12f0010910 con 0x7f13041049a0 2024-09-12T12:23:20.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13041a7170 con 0x7f13041049a0 2024-09-12T12:23:20.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.630+0000 7f1301600640 1 -- 172.21.15.38:0/2662821854 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0018980 con 0x7f13041049a0 2024-09-12T12:23:20.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.631+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13041043d0 con 0x7f13041049a0 2024-09-12T12:23:20.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.633+0000 7f1301600640 1 -- 172.21.15.38:0/2662821854 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f12f0010ac0 con 0x7f13041049a0 2024-09-12T12:23:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.635+0000 7f1301600640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12ec0a2c00 0x7f12ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.635+0000 7f1301600640 1 -- 172.21.15.38:0/2662821854 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f12f00cf950 con 0x7f13041049a0 2024-09-12T12:23:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.635+0000 7f1308a00640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12ec0a2c00 0x7f12ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:20.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.636+0000 7f1308a00640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12ec0a2c00 0x7f12ec0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009230 tx=0x7f12f80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:20.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.637+0000 7f1301600640 1 -- 172.21.15.38:0/2662821854 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12f009bfc0 con 0x7f13041049a0 2024-09-12T12:23:20.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.858+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f130410bd70 con 0x7f13041049a0 2024-09-12T12:23:20.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.859+0000 7f1301600640 1 -- 172.21.15.38:0/2662821854 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f12f00a02c0 con 0x7f13041049a0 2024-09-12T12:23:20.859 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12ec0a2c00 msgr2=0x7f12ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12ec0a2c00 0x7f12ec0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009230 tx=0x7f12f80058d0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13041049a0 msgr2=0x7f130419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13041049a0 0x7f130419ab30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12f000e9f0 tx=0x7f12f000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 shutdown_connections 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12ec0a2c00 0x7f12ec0a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1304109120 0x7f130419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13041049a0 0x7f130419ab30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 --2- 172.21.15.38:0/2662821854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1304103ff0 0x7f130419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 >> 172.21.15.38:0/2662821854 conn(0x7f13040ffa90 msgr2=0x7f1304100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 shutdown_connections 2024-09-12T12:23:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:20.861+0000 7f130b400640 1 -- 172.21.15.38:0/2662821854 wait complete. 2024-09-12T12:23:21.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:21 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2662821854' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:23:21.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:21 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2662821854' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:23:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:21 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2662821854' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:23:21.786 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:23:21.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:23:21.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2024-09-12T12:23:21.787 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T12:23:21.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:21.787 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:23:21.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:23:21.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:23:21.787 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T12:23:21.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:21.787 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2024-09-12T12:23:21.823 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:23:21.824 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42191sec preferred_lft 42191sec 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:21.825 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2024-09-12T12:23:21.826 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:23:21.826 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:23:21.826 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:23:21.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:23:21.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2024-09-12T12:23:21.827 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2024-09-12T12:23:21.827 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:23:21.827 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:23:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:23:22.181 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:22 smithi038 ceph-mon[30810]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:22.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:22.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:22.246 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:23:22.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:22 smithi071 ceph-mon[34859]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:22.303 INFO:teuthology.orchestra.run.smithi038.stdout:1 2024-09-12T12:23:22.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:22.306 DEBUG:teuthology.orchestra.run.smithi038:> route 2024-09-12T12:23:22.351 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2024-09-12T12:23:22.352 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:23:22.352 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T12:23:22.352 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T12:23:22.352 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:23:22.352 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:23:22.352 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:23:22.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T12:23:22.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T12:23:22.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T12:23:22.353 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:23:22.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:22 smithi154 ceph-mon[35578]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:22.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:23:22.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:22.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:23.000 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-12T12:23:23.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:23.037 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2024-09-12T12:23:23.113 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:23:23.113 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:23:23.113 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:23:23.113 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T12:23:23.113 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:23:23.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:23:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:23.294 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T12:23:23.294 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:23:23.294 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:23:23.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T12:23:23.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:23:23.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T12:23:23.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T12:23:23.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T12:23:23.295 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:23:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:23:23.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:23.541 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:23:23.541 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:23:23.541 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2024-09-12T12:23:23.541 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:23:23.541 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:23:23.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:23:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:23.709 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T12:23:23.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:23:23.709 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:23.745 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T12:23:23.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:23:23.745 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:23.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo modprobe fuse 2024-09-12T12:23:23.918 DEBUG:teuthology.orchestra.run.smithi038:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/proc 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/sys 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/dev 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/security 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/shm 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/pts 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/run 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/cgroup 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/pstore 2024-09-12T12:23:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/bpf 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/ 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/selinux 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/mqueue 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/hugepages 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/debug 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/tracing 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/fuse/connections 2024-09-12T12:23:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/config 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/run/user/1000 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/ceph 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/3b272250a8486399ce594245550c106017c986fd074b6e804a4b8ddaea754b0c/merged 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/79e0a94ea41dd040a595954dd46959ca716f8953c1537ad09d6e23d82c4e740b/merged 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/run/user/0 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/caa4beb861274e9f51ed6d11e5ca1da20fb90c57fb001d7a4682ddbc3b8f507d/merged 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/10674fc1ace021df69dea4870ee4bae98ef32276b382dd68b17bbf5781e5b457/merged 2024-09-12T12:23:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/5a7bff539e23d781e03a55bd705af6c97da5a99f9f6838e16a5bda1a067b7dbe/merged 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/79c498f486f9dd545f8f9e015adf033cfc46dd067a6192d4509c7951b5691808/merged 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/6e85cdc6dc26222cb2714aa1198f683a9772111edea67ed0d63af4112b8a1242/merged 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/a060d524ef8db99595b65f48a88c4e724e70ee2dcd896e1e1befd5e7b8c69b7e/merged 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/9ac140f691e20fed2373146a49d3f1d8647324d49c1ab7e623d89ec0ee8cd87f/merged 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/95dc28a87c9fb9b8dcbef2150857f96f45c9e407b01788745966f4553beea045/merged 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:23:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:23:23.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:23.959 DEBUG:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2024-09-12T12:23:24.035 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T12:23:24.035 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T12:23:24.079 DEBUG:teuthology.orchestra.run.smithi038:> sudo modprobe fuse 2024-09-12T12:23:24.138 DEBUG:teuthology.orchestra.run.smithi038:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:23:24.176 INFO:teuthology.orchestra.run.smithi038.stdout:/proc 2024-09-12T12:23:24.176 INFO:teuthology.orchestra.run.smithi038.stdout:/sys 2024-09-12T12:23:24.176 INFO:teuthology.orchestra.run.smithi038.stdout:/dev 2024-09-12T12:23:24.176 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/security 2024-09-12T12:23:24.176 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/shm 2024-09-12T12:23:24.176 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/pts 2024-09-12T12:23:24.176 INFO:teuthology.orchestra.run.smithi038.stdout:/run 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/cgroup 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/pstore 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/bpf 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/ 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/selinux 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/mqueue 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/hugepages 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/debug 2024-09-12T12:23:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/tracing 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/fuse/connections 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/config 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/run/user/1000 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/ceph 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/3b272250a8486399ce594245550c106017c986fd074b6e804a4b8ddaea754b0c/merged 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/79e0a94ea41dd040a595954dd46959ca716f8953c1537ad09d6e23d82c4e740b/merged 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/run/user/0 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:23:24.178 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/caa4beb861274e9f51ed6d11e5ca1da20fb90c57fb001d7a4682ddbc3b8f507d/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/10674fc1ace021df69dea4870ee4bae98ef32276b382dd68b17bbf5781e5b457/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/5a7bff539e23d781e03a55bd705af6c97da5a99f9f6838e16a5bda1a067b7dbe/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/79c498f486f9dd545f8f9e015adf033cfc46dd067a6192d4509c7951b5691808/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/6e85cdc6dc26222cb2714aa1198f683a9772111edea67ed0d63af4112b8a1242/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/a060d524ef8db99595b65f48a88c4e724e70ee2dcd896e1e1befd5e7b8c69b7e/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/9ac140f691e20fed2373146a49d3f1d8647324d49c1ab7e623d89ec0ee8cd87f/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/95dc28a87c9fb9b8dcbef2150857f96f45c9e407b01788745966f4553beea045/merged 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:23:24.179 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:23:24.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:24.180 DEBUG:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2024-09-12T12:23:24.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:24 smithi038 ceph-mon[30810]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:24.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:2024-09-12T12:23:24.254+0000 7fb8a107c480 -1 init, newargv = 0x55f0c37de390 newargc=15 2024-09-12T12:23:24.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:ceph-fuse[74653]: starting ceph client 2024-09-12T12:23:24.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:ceph-fuse[74653]: starting fuse 2024-09-12T12:23:24.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:24 smithi154 ceph-mon[35578]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:24.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:24 smithi071 ceph-mon[34859]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:25.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo modprobe fuse 2024-09-12T12:23:25.422 DEBUG:teuthology.orchestra.run.smithi038:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:23:25.460 INFO:teuthology.orchestra.run.smithi038.stdout:/proc 2024-09-12T12:23:25.460 INFO:teuthology.orchestra.run.smithi038.stdout:/sys 2024-09-12T12:23:25.460 INFO:teuthology.orchestra.run.smithi038.stdout:/dev 2024-09-12T12:23:25.460 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/security 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/shm 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/pts 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/run 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/cgroup 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/pstore 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/bpf 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/ 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/selinux 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/mqueue 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/dev/hugepages 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/debug 2024-09-12T12:23:25.461 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/tracing 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/fs/fuse/connections 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/sys/kernel/config 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/run/user/1000 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/ceph 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/3b272250a8486399ce594245550c106017c986fd074b6e804a4b8ddaea754b0c/merged 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/79e0a94ea41dd040a595954dd46959ca716f8953c1537ad09d6e23d82c4e740b/merged 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/run/user/0 2024-09-12T12:23:25.462 INFO:teuthology.orchestra.run.smithi038.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/caa4beb861274e9f51ed6d11e5ca1da20fb90c57fb001d7a4682ddbc3b8f507d/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/10674fc1ace021df69dea4870ee4bae98ef32276b382dd68b17bbf5781e5b457/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/5a7bff539e23d781e03a55bd705af6c97da5a99f9f6838e16a5bda1a067b7dbe/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/79c498f486f9dd545f8f9e015adf033cfc46dd067a6192d4509c7951b5691808/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/6e85cdc6dc26222cb2714aa1198f683a9772111edea67ed0d63af4112b8a1242/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/a060d524ef8db99595b65f48a88c4e724e70ee2dcd896e1e1befd5e7b8c69b7e/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/9ac140f691e20fed2373146a49d3f1d8647324d49c1ab7e623d89ec0ee8cd87f/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/var/lib/containers/storage/overlay/95dc28a87c9fb9b8dcbef2150857f96f45c9e407b01788745966f4553beea045/merged 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:23:25.463 INFO:teuthology.orchestra.run.smithi038.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:25.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:25.464 DEBUG:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2024-09-12T12:23:25.541 INFO:teuthology.orchestra.run.smithi038.stdout:120 2024-09-12T12:23:25.541 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-12T12:23:25.541 DEBUG:teuthology.orchestra.run.smithi038:> sudo stdin-killer -- python3 -c ' 2024-09-12T12:23:25.541 DEBUG:teuthology.orchestra.run.smithi038:> import glob 2024-09-12T12:23:25.541 DEBUG:teuthology.orchestra.run.smithi038:> import re 2024-09-12T12:23:25.541 DEBUG:teuthology.orchestra.run.smithi038:> import os 2024-09-12T12:23:25.541 DEBUG:teuthology.orchestra.run.smithi038:> import subprocess 2024-09-12T12:23:25.541 DEBUG:teuthology.orchestra.run.smithi038:> 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> def _find_admin_socket(client_name): 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> files = glob.glob(asok_path) 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> # Given a non-glob path, it better be there 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> if "*" not in asok_path: 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> assert(len(files) == 1) 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> return files[0] 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> for f in files: 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T12:23:25.542 DEBUG:teuthology.orchestra.run.smithi038:> contents = proc_f.read() 2024-09-12T12:23:25.543 DEBUG:teuthology.orchestra.run.smithi038:> if mountpoint in contents: 2024-09-12T12:23:25.543 DEBUG:teuthology.orchestra.run.smithi038:> return f 2024-09-12T12:23:25.543 DEBUG:teuthology.orchestra.run.smithi038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T12:23:25.543 DEBUG:teuthology.orchestra.run.smithi038:> 2024-09-12T12:23:25.543 DEBUG:teuthology.orchestra.run.smithi038:> print(_find_admin_socket("client.admin")) 2024-09-12T12:23:25.543 DEBUG:teuthology.orchestra.run.smithi038:> ' 2024-09-12T12:23:25.706 INFO:teuthology.orchestra.run.smithi038.stdout:/var/run/ceph/ceph-client.admin.74653.asok 2024-09-12T12:23:25.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:25.721 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74653.asok 2024-09-12T12:23:25.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:25.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74653.asok status 2024-09-12T12:23:25.907 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:23:25.907 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": { 2024-09-12T12:23:25.907 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "entity_id": "admin", 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": "smithi038", 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "pid": "74653", 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "root": "/" 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_count": 0, 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_pinned_count": 0, 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24667, 2024-09-12T12:23:25.908 INFO:teuthology.orchestra.run.smithi038.stdout: "inst": { 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "name": { 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "client", 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "num": 24667 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2027844822 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:23:25.909 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2027844822 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "inst_str": "client.24667 192.168.0.1:0/2027844822", 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "addr_str": "192.168.0.1:0/2027844822", 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "inode_count": 1, 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_epoch": 17, 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch": 89, 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch_barrier": 0, 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklisted": false, 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs" 2024-09-12T12:23:25.910 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:23:25.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:25.921 DEBUG:teuthology.orchestra.run.smithi038:> stat --file-system '--printf=%T 2024-09-12T12:23:25.921 DEBUG:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:25.958 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2024-09-12T12:23:25.958 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:25.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:25.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:26.057 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T12:23:26.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:26.166 INFO:teuthology.orchestra.run.smithi038.stdout:# file: . 2024-09-12T12:23:26.166 INFO:teuthology.orchestra.run.smithi038.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T12:23:26.166 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:26.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:26.174 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:23:26.174 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:23:26.211 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:23:26.300 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:26 smithi038 ceph-mon[30810]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:26.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:26 smithi154 ceph-mon[35578]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:26.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:26 smithi071 ceph-mon[34859]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:26.638 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:27.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.213+0000 7fdd6dc00640 1 -- 172.21.15.38:0/797870346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 msgr2=0x7fdd681043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:27.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.213+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/797870346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 0x7fdd681043d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009860 tx=0x7fdd5802a340 comp rx=0 tx=0).stop 2024-09-12T12:23:27.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.213+0000 7fdd6dc00640 1 -- 172.21.15.38:0/797870346 shutdown_connections 2024-09-12T12:23:27.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.213+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/797870346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd68109120 0x7fdd68110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.213+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/797870346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd681049a0 0x7fdd681089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.213+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/797870346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 0x7fdd681043d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.213+0000 7fdd6dc00640 1 -- 172.21.15.38:0/797870346 >> 172.21.15.38:0/797870346 conn(0x7fdd680ffa90 msgr2=0x7fdd68101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:27.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.214+0000 7fdd6dc00640 1 -- 172.21.15.38:0/797870346 shutdown_connections 2024-09-12T12:23:27.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.214+0000 7fdd6dc00640 1 -- 172.21.15.38:0/797870346 wait complete. 2024-09-12T12:23:27.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 Processor -- start 2024-09-12T12:23:27.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 -- start start 2024-09-12T12:23:27.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 0x7fdd6819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:27.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd681049a0 0x7fdd6819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:27.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd68109120 0x7fdd6819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68114120 con 0x7fdd681049a0 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68113fa0 con 0x7fdd68103ff0 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd6dc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681142a0 con 0x7fdd68109120 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd66000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd681049a0 0x7fdd6819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd66000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd681049a0 0x7fdd6819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37866/0 (socket says 172.21.15.38:37866) 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd67400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd68109120 0x7fdd6819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.215+0000 7fdd66000640 1 -- 172.21.15.38:0/3371453530 learned_addr learned my addr 172.21.15.38:0/3371453530 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd66a00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 0x7fdd6819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd67400640 1 -- 172.21.15.38:0/3371453530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 msgr2=0x7fdd6819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd67400640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 0x7fdd6819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd67400640 1 -- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd681049a0 msgr2=0x7fdd6819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd67400640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd681049a0 0x7fdd6819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd67400640 1 -- 172.21.15.38:0/3371453530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6819f5d0 con 0x7fdd68109120 2024-09-12T12:23:27.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd66a00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 0x7fdd6819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:27.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.216+0000 7fdd67400640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd68109120 0x7fdd6819eef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009fd0 tx=0x7fdd6000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:27.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.217+0000 7fdd5f400640 1 -- 172.21.15.38:0/3371453530 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000ce20 con 0x7fdd68109120 2024-09-12T12:23:27.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.217+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6819f8c0 con 0x7fdd68109120 2024-09-12T12:23:27.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.217+0000 7fdd5f400640 1 -- 172.21.15.38:0/3371453530 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd60005020 con 0x7fdd68109120 2024-09-12T12:23:27.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.217+0000 7fdd5f400640 1 -- 172.21.15.38:0/3371453530 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60010720 con 0x7fdd68109120 2024-09-12T12:23:27.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.217+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd681a71a0 con 0x7fdd68109120 2024-09-12T12:23:27.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.218+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd681043d0 con 0x7fdd68109120 2024-09-12T12:23:27.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.220+0000 7fdd5f400640 1 -- 172.21.15.38:0/3371453530 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdd60005540 con 0x7fdd68109120 2024-09-12T12:23:27.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.221+0000 7fdd5f400640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdd4c0a2b80 0x7fdd4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:27.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.221+0000 7fdd5f400640 1 -- 172.21.15.38:0/3371453530 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fdd600cfa70 con 0x7fdd68109120 2024-09-12T12:23:27.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.221+0000 7fdd66a00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdd4c0a2b80 0x7fdd4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:27.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.222+0000 7fdd66a00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdd4c0a2b80 0x7fdd4c0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdd5802a930 tx=0x7fdd580056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:27.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.223+0000 7fdd5f400640 1 -- 172.21.15.38:0/3371453530 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd6009c730 con 0x7fdd68109120 2024-09-12T12:23:27.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.423+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdd6810bd70 con 0x7fdd68109120 2024-09-12T12:23:27.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.424+0000 7fdd5f400640 1 -- 172.21.15.38:0/3371453530 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+589 (secure 0 0 0) 0x7fdd6009c030 con 0x7fdd68109120 2024-09-12T12:23:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/2462218902 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/2462218902 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/780591637 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:27.426 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2321943199 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:27.426 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/271793937 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:27.426 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2979922122 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:27.426 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/746177485 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:27.426 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3674823086 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:27.426 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3803178885 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:27.427 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3803178885 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi038.stderr:listed 10 entries 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdd4c0a2b80 msgr2=0x7fdd4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdd4c0a2b80 0x7fdd4c0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdd5802a930 tx=0x7fdd580056d0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd68109120 msgr2=0x7fdd6819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd68109120 0x7fdd6819eef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009fd0 tx=0x7fdd6000ef10 comp rx=0 tx=0).stop 2024-09-12T12:23:27.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 shutdown_connections 2024-09-12T12:23:27.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdd4c0a2b80 0x7fdd4c0a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd68109120 0x7fdd6819eef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd681049a0 0x7fdd6819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 --2- 172.21.15.38:0/3371453530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd68103ff0 0x7fdd6819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:27.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 >> 172.21.15.38:0/3371453530 conn(0x7fdd680ffa90 msgr2=0x7fdd68100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:27.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 shutdown_connections 2024-09-12T12:23:27.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:27.426+0000 7fdd6dc00640 1 -- 172.21.15.38:0/3371453530 wait complete. 2024-09-12T12:23:28.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:28 smithi154 ceph-mon[35578]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:28.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:28 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3371453530' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:23:28.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:28 smithi038 ceph-mon[30810]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:28.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:28 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3371453530' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:23:28.512 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:23:28.512 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:23:28.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:28 smithi071 ceph-mon[34859]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:28.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:28 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3371453530' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:23:28.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:23:28.974 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:29.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 -- 172.21.15.38:0/206469707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441019c0 msgr2=0x7f1744101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 --2- 172.21.15.38:0/206469707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441019c0 0x7f1744101e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f172c009930 tx=0x7f172c02a420 comp rx=0 tx=0).stop 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 -- 172.21.15.38:0/206469707 shutdown_connections 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 --2- 172.21.15.38:0/206469707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1744102360 0x7f174410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 --2- 172.21.15.38:0/206469707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441019c0 0x7f1744101e20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 --2- 172.21.15.38:0/206469707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441079c0 0x7f1744107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 -- 172.21.15.38:0/206469707 >> 172.21.15.38:0/206469707 conn(0x7f17440fd740 msgr2=0x7f17440ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 -- 172.21.15.38:0/206469707 shutdown_connections 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.525+0000 7f1748e00640 1 -- 172.21.15.38:0/206469707 wait complete. 2024-09-12T12:23:29.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.526+0000 7f1748e00640 1 Processor -- start 2024-09-12T12:23:29.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1748e00640 1 -- start start 2024-09-12T12:23:29.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1748e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441019c0 0x7f17441982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1748e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1744102360 0x7f1744198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1748e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441079c0 0x7f174419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1748e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1744111de0 con 0x7f17441079c0 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1748e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1744111c60 con 0x7f17441019c0 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1748e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1744111f60 con 0x7f1744102360 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1743e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441079c0 0x7f174419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1743400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441019c0 0x7f17441982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1743400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441019c0 0x7f17441982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57884/0 (socket says 172.21.15.38:57884) 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.527+0000 7f1743400640 1 -- 172.21.15.38:0/3609493123 learned_addr learned my addr 172.21.15.38:0/3609493123 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f173be00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1744102360 0x7f1744198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1743400640 1 -- 172.21.15.38:0/3609493123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1744102360 msgr2=0x7f1744198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1743400640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1744102360 0x7f1744198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1743400640 1 -- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441079c0 msgr2=0x7f174419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1743400640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441079c0 0x7f174419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1743400640 1 -- 172.21.15.38:0/3609493123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174419d270 con 0x7f17441019c0 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1743e00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441079c0 0x7f174419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1743400640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441019c0 0x7f17441982c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f173400e9f0 tx=0x7f173400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.528+0000 7f1740c00640 1 -- 172.21.15.38:0/3609493123 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173400cd80 con 0x7f17441019c0 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.529+0000 7f1740c00640 1 -- 172.21.15.38:0/3609493123 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1734010910 con 0x7f17441019c0 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.529+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174419d560 con 0x7f17441019c0 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.529+0000 7f1740c00640 1 -- 172.21.15.38:0/3609493123 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734018990 con 0x7f17441019c0 2024-09-12T12:23:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.529+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17441a4e40 con 0x7f17441019c0 2024-09-12T12:23:29.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.530+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1744101e20 con 0x7f17441019c0 2024-09-12T12:23:29.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.532+0000 7f1740c00640 1 -- 172.21.15.38:0/3609493123 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1734010ac0 con 0x7f17441019c0 2024-09-12T12:23:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.533+0000 7f1740c00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17280a2b80 0x7f17280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.533+0000 7f1740c00640 1 -- 172.21.15.38:0/3609493123 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f17340cfaf0 con 0x7f17441019c0 2024-09-12T12:23:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.533+0000 7f173be00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17280a2b80 0x7f17280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.534+0000 7f173be00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17280a2b80 0x7f17280a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f172c009900 tx=0x7f172c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:29.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.535+0000 7f1740c00640 1 -- 172.21.15.38:0/3609493123 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f173409c160 con 0x7f17441019c0 2024-09-12T12:23:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.733+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1744109f30 con 0x7f17441019c0 2024-09-12T12:23:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.734+0000 7f1740c00640 1 -- 172.21.15.38:0/3609493123 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+589 (secure 0 0 0) 0x7f17340a0460 con 0x7f17441019c0 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/2462218902 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/2462218902 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/780591637 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2321943199 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/271793937 2024-09-13T12:15:33.976954+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2979922122 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/746177485 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3674823086 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3803178885 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3803178885 2024-09-13T12:15:04.820922+0000 2024-09-12T12:23:29.736 INFO:teuthology.orchestra.run.smithi038.stderr:listed 10 entries 2024-09-12T12:23:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17280a2b80 msgr2=0x7f17280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17280a2b80 0x7f17280a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f172c009900 tx=0x7f172c0058d0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441019c0 msgr2=0x7f17441982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441019c0 0x7f17441982c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f173400e9f0 tx=0x7f173400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 shutdown_connections 2024-09-12T12:23:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17280a2b80 0x7f17280a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17441079c0 0x7f174419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1744102360 0x7f1744198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 --2- 172.21.15.38:0/3609493123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17441019c0 0x7f17441982c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.736+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 >> 172.21.15.38:0/3609493123 conn(0x7f17440fd740 msgr2=0x7f17440fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.737+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 shutdown_connections 2024-09-12T12:23:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:29.737+0000 7f1748e00640 1 -- 172.21.15.38:0/3609493123 wait complete. 2024-09-12T12:23:30.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:30 smithi154 ceph-mon[35578]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T12:23:30.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:30 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3609493123' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:23:30.429 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:30 smithi038 ceph-mon[30810]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T12:23:30.429 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:30 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3609493123' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:23:30.467 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi038.front.sepia.ceph.com... 2024-09-12T12:23:30.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:30.468 DEBUG:teuthology.orchestra.run.smithi038:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:23:30.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:30 smithi071 ceph-mon[34859]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T12:23:30.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:30 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3609493123' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:23:30.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:ceph-fuse[74653]: fuse finished with error 0 and tester_r 0 2024-09-12T12:23:30.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:23:32.314 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:32 smithi038 ceph-mon[30810]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T12:23:32.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:32 smithi154 ceph-mon[35578]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T12:23:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:32 smithi071 ceph-mon[34859]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-12T12:23:34.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-12T12:23:34.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-09-12T12:23:34.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-09-12T12:23:34.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-12T12:23:34.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:23:34.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T12:23:34.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-09-12T12:23:34.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-12T12:23:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:23:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T12:23:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]: dispatch 2024-09-12T12:23:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-12T12:23:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-12T12:23:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-12T12:23:34.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-12T12:23:34.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-12T12:23:34.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]: dispatch 2024-09-12T12:23:34.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2024-09-12T12:23:34.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-12T12:23:35.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T12:23:35.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-12T12:23:35.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-12T12:23:35.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-12T12:23:35.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-12T12:23:35.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-12T12:23:35.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-12T12:23:35.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-09-12T12:23:35.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-12T12:23:35.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-12T12:23:35.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:23:35.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:35 smithi154 ceph-mon[35578]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-12T12:23:35.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-09-12T12:23:35.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-12T12:23:35.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-12T12:23:35.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:23:35.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:35 smithi038 ceph-mon[30810]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-12T12:23:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T12:23:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-09-12T12:23:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-12T12:23:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-12T12:23:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-12T12:23:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-12T12:23:35.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-12T12:23:35.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [5, 8]}]': finished 2024-09-12T12:23:35.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-12T12:23:35.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-12T12:23:35.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:23:35.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:35 smithi071 ceph-mon[34859]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-12T12:23:36.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:36 smithi154 ceph-mon[35578]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:23:36.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:36 smithi038 ceph-mon[30810]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:23:36.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:36 smithi071 ceph-mon[34859]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:23:36.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2024-09-12T12:23:36.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:36.631 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T12:23:36.683 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:23:37.071 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:37.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:37 smithi154 ceph-mon[35578]: pgmap v322: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T12:23:37.433 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:37 smithi038 ceph-mon[30810]: pgmap v322: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T12:23:37.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:37 smithi071 ceph-mon[34859]: pgmap v322: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 -- 172.21.15.38:0/4147908408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 msgr2=0x7f52c0110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 --2- 172.21.15.38:0/4147908408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 0x7f52c0110840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009ca0 tx=0x7f52b802a950 comp rx=0 tx=0).stop 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 -- 172.21.15.38:0/4147908408 shutdown_connections 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 --2- 172.21.15.38:0/4147908408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 0x7f52c0110840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 --2- 172.21.15.38:0/4147908408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074e30 0x7f52c010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 --2- 172.21.15.38:0/4147908408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52c0074510 0x7f52c00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 -- 172.21.15.38:0/4147908408 >> 172.21.15.38:0/4147908408 conn(0x7f52c00fd8b0 msgr2=0x7f52c00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:37.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 -- 172.21.15.38:0/4147908408 shutdown_connections 2024-09-12T12:23:37.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.688+0000 7f52c4a00640 1 -- 172.21.15.38:0/4147908408 wait complete. 2024-09-12T12:23:37.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.689+0000 7f52c4a00640 1 Processor -- start 2024-09-12T12:23:37.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.689+0000 7f52c4a00640 1 -- start start 2024-09-12T12:23:37.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52c4a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074510 0x7f52c019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52c4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52c0074e30 0x7f52c019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52c4a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 0x7f52c019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52c4a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f52c01141d0 con 0x7f52c010e450 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52c4a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f52c0114050 con 0x7f52c0074e30 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52c4a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52c0114350 con 0x7f52c0074510 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074510 0x7f52c019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52be800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 0x7f52c019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074510 0x7f52c019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:41870/0 (socket says 172.21.15.38:41870) 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 -- 172.21.15.38:0/2806183408 learned_addr learned my addr 172.21.15.38:0/2806183408 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bd400640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52c0074e30 0x7f52c019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 -- 172.21.15.38:0/2806183408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52c0074e30 msgr2=0x7f52c019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52c0074e30 0x7f52c019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 -- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 msgr2=0x7f52c019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 0x7f52c019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.690+0000 7f52bde00640 1 -- 172.21.15.38:0/2806183408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c019f660 con 0x7f52c0074510 2024-09-12T12:23:37.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.691+0000 7f52bde00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074510 0x7f52c019a6b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52b000d950 tx=0x7f52b000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.691+0000 7f52b6a00640 1 -- 172.21.15.38:0/2806183408 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b0017030 con 0x7f52c0074510 2024-09-12T12:23:37.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.691+0000 7f52b6a00640 1 -- 172.21.15.38:0/2806183408 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52b0004020 con 0x7f52c0074510 2024-09-12T12:23:37.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.691+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c019f950 con 0x7f52c0074510 2024-09-12T12:23:37.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.691+0000 7f52b6a00640 1 -- 172.21.15.38:0/2806183408 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b00047a0 con 0x7f52c0074510 2024-09-12T12:23:37.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.691+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c01a7230 con 0x7f52c0074510 2024-09-12T12:23:37.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.692+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c00748f0 con 0x7f52c0074510 2024-09-12T12:23:37.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.694+0000 7f52b6a00640 1 -- 172.21.15.38:0/2806183408 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f52b00041d0 con 0x7f52c0074510 2024-09-12T12:23:37.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.695+0000 7f52b6a00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f52a40a2b80 0x7f52a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.696+0000 7f52b6a00640 1 -- 172.21.15.38:0/2806183408 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f52b00cf3b0 con 0x7f52c0074510 2024-09-12T12:23:37.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.696+0000 7f52bd400640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f52a40a2b80 0x7f52a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.696+0000 7f52bd400640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f52a40a2b80 0x7f52a40a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52c0101300 tx=0x7f52ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.698+0000 7f52b6a00640 1 -- 172.21.15.38:0/2806183408 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52b009bf50 con 0x7f52c0074510 2024-09-12T12:23:37.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.884+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52c019ba10 con 0x7f52c0074510 2024-09-12T12:23:37.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.886+0000 7f52b6a00640 1 -- 172.21.15.38:0/2806183408 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24668 (secure 0 0 0) 0x7f52b009b850 con 0x7f52c0074510 2024-09-12T12:23:37.887 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:37.887 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":91,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:35.061031+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f52a40a2b80 msgr2=0x7f52a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f52a40a2b80 0x7f52a40a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52c0101300 tx=0x7f52ac005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074510 msgr2=0x7f52c019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074510 0x7f52c019a6b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52b000d950 tx=0x7f52b000de10 comp rx=0 tx=0).stop 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 shutdown_connections 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f52a40a2b80 0x7f52a40a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c010e450 0x7f52c019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f52c0074e30 0x7f52c019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 --2- 172.21.15.38:0/2806183408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c0074510 0x7f52c019a6b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.888+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 >> 172.21.15.38:0/2806183408 conn(0x7f52c00fd8b0 msgr2=0x7f52c00fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:37.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.889+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 shutdown_connections 2024-09-12T12:23:37.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:37.889+0000 7f52c4a00640 1 -- 172.21.15.38:0/2806183408 wait complete. 2024-09-12T12:23:38.409 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:38 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2806183408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:38.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:38 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2806183408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:38.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:38 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2806183408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:38.774 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:23:39.087 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:39 smithi038 ceph-mon[30810]: pgmap v323: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T12:23:39.155 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:39.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:39 smithi154 ceph-mon[35578]: pgmap v323: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T12:23:39.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:39 smithi071 ceph-mon[34859]: pgmap v323: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T12:23:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 -- 172.21.15.38:0/1492009302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb340ffff0 msgr2=0x7feb341003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 --2- 172.21.15.38:0/1492009302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb340ffff0 0x7feb341003d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb24009370 tx=0x7feb2402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 -- 172.21.15.38:0/1492009302 shutdown_connections 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 --2- 172.21.15.38:0/1492009302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb34105120 0x7feb3410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 --2- 172.21.15.38:0/1492009302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb341009a0 0x7feb341049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 --2- 172.21.15.38:0/1492009302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb340ffff0 0x7feb341003d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 -- 172.21.15.38:0/1492009302 >> 172.21.15.38:0/1492009302 conn(0x7feb340fba90 msgr2=0x7feb340fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 -- 172.21.15.38:0/1492009302 shutdown_connections 2024-09-12T12:23:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.719+0000 7feb3b200640 1 -- 172.21.15.38:0/1492009302 wait complete. 2024-09-12T12:23:39.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.720+0000 7feb3b200640 1 Processor -- start 2024-09-12T12:23:39.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.720+0000 7feb3b200640 1 -- start start 2024-09-12T12:23:39.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.720+0000 7feb3b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb340ffff0 0x7feb3419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb3b200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb341009a0 0x7feb3419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb3b200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb34105120 0x7feb3419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb3b200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feb3410fd50 con 0x7feb341009a0 2024-09-12T12:23:39.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb3b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feb3410fbd0 con 0x7feb340ffff0 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb3b200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb3410fed0 con 0x7feb34105120 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb341009a0 0x7feb3419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb341009a0 0x7feb3419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38050/0 (socket says 172.21.15.38:38050) 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 -- 172.21.15.38:0/634289554 learned_addr learned my addr 172.21.15.38:0/634289554 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33e00640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb340ffff0 0x7feb3419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb39200640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb34105120 0x7feb3419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 -- 172.21.15.38:0/634289554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb34105120 msgr2=0x7feb3419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb34105120 0x7feb3419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 -- 172.21.15.38:0/634289554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb340ffff0 msgr2=0x7feb3419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb340ffff0 0x7feb3419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33400640 1 -- 172.21.15.38:0/634289554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3419f680 con 0x7feb341009a0 2024-09-12T12:23:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.721+0000 7feb33e00640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb340ffff0 0x7feb3419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.722+0000 7feb33400640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb341009a0 0x7feb3419ac10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb2000d950 tx=0x7feb2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.722+0000 7feb30c00640 1 -- 172.21.15.38:0/634289554 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20017070 con 0x7feb341009a0 2024-09-12T12:23:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.722+0000 7feb30c00640 1 -- 172.21.15.38:0/634289554 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb20009c30 con 0x7feb341009a0 2024-09-12T12:23:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.722+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3419f970 con 0x7feb341009a0 2024-09-12T12:23:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.722+0000 7feb30c00640 1 -- 172.21.15.38:0/634289554 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2000f6b0 con 0x7feb341009a0 2024-09-12T12:23:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.722+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb341a7250 con 0x7feb341009a0 2024-09-12T12:23:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.723+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb341003d0 con 0x7feb341009a0 2024-09-12T12:23:39.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.725+0000 7feb30c00640 1 -- 172.21.15.38:0/634289554 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feb200109d0 con 0x7feb341009a0 2024-09-12T12:23:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.726+0000 7feb30c00640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feb180a2b80 0x7feb180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.727+0000 7feb30c00640 1 -- 172.21.15.38:0/634289554 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7feb200cf2f0 con 0x7feb341009a0 2024-09-12T12:23:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.727+0000 7feb33e00640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feb180a2b80 0x7feb180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.727+0000 7feb33e00640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feb180a2b80 0x7feb180a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb24004730 tx=0x7feb240046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.731+0000 7feb30c00640 1 -- 172.21.15.38:0/634289554 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb20009de0 con 0x7feb341009a0 2024-09-12T12:23:39.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.919+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb341a74f0 con 0x7feb341009a0 2024-09-12T12:23:39.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.921+0000 7feb30c00640 1 -- 172.21.15.38:0/634289554 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24668 (secure 0 0 0) 0x7feb2009b840 con 0x7feb341009a0 2024-09-12T12:23:39.922 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:23:39.922 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":91,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:35.061031+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:39.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.923+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feb180a2b80 msgr2=0x7feb180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feb180a2b80 0x7feb180a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb24004730 tx=0x7feb240046c0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb341009a0 msgr2=0x7feb3419ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb341009a0 0x7feb3419ac10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb2000d950 tx=0x7feb2000de10 comp rx=0 tx=0).stop 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 shutdown_connections 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feb180a2b80 0x7feb180a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb34105120 0x7feb3419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb341009a0 0x7feb3419ac10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 --2- 172.21.15.38:0/634289554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb340ffff0 0x7feb3419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 >> 172.21.15.38:0/634289554 conn(0x7feb340fba90 msgr2=0x7feb340fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 shutdown_connections 2024-09-12T12:23:39.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:39.924+0000 7feb3b200640 1 -- 172.21.15.38:0/634289554 wait complete. 2024-09-12T12:23:40.323 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:40 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/634289554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:40.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:40 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/634289554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:40.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:40 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/634289554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:40.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:23:41.126 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:41.408 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:41 smithi038 ceph-mon[30810]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:41.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:41 smithi154 ceph-mon[35578]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:41.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:41 smithi071 ceph-mon[34859]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 -- 172.21.15.38:0/72837904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd484102360 msgr2=0x7fd48410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 --2- 172.21.15.38:0/72837904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd484102360 0x7fd48410e890 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009cd0 tx=0x7fd47c02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 -- 172.21.15.38:0/72837904 shutdown_connections 2024-09-12T12:23:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 --2- 172.21.15.38:0/72837904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd484102360 0x7fd48410e890 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 --2- 172.21.15.38:0/72837904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4841019c0 0x7fd484101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 --2- 172.21.15.38:0/72837904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4841079c0 0x7fd484107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 -- 172.21.15.38:0/72837904 >> 172.21.15.38:0/72837904 conn(0x7fd4840fd740 msgr2=0x7fd4840ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 -- 172.21.15.38:0/72837904 shutdown_connections 2024-09-12T12:23:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.689+0000 7fd483e00640 1 -- 172.21.15.38:0/72837904 wait complete. 2024-09-12T12:23:41.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.690+0000 7fd483e00640 1 Processor -- start 2024-09-12T12:23:41.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.690+0000 7fd483e00640 1 -- start start 2024-09-12T12:23:41.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4841019c0 0x7fd4840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484102360 0x7fd484074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4841079c0 0x7fd484074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd484111e10 con 0x7fd4841079c0 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd484111c90 con 0x7fd484102360 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd484111f90 con 0x7fd4841019c0 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4841079c0 0x7fd484074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4841079c0 0x7fd484074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38068/0 (socket says 172.21.15.38:38068) 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd483400640 1 -- 172.21.15.38:0/3025203719 learned_addr learned my addr 172.21.15.38:0/3025203719 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd47a000640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484102360 0x7fd484074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.691+0000 7fd482a00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4841019c0 0x7fd4840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd483400640 1 -- 172.21.15.38:0/3025203719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4841019c0 msgr2=0x7fd4840744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd483400640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4841019c0 0x7fd4840744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd483400640 1 -- 172.21.15.38:0/3025203719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484102360 msgr2=0x7fd484074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd483400640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484102360 0x7fd484074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd483400640 1 -- 172.21.15.38:0/3025203719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4841a6750 con 0x7fd4841079c0 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd47a000640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484102360 0x7fd484074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd483400640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4841079c0 0x7fd484074f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd47c033040 tx=0x7fd47c031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd47be00640 1 -- 172.21.15.38:0/3025203719 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c004040 con 0x7fd4841079c0 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd47be00640 1 -- 172.21.15.38:0/3025203719 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47c0046c0 con 0x7fd4841079c0 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd47be00640 1 -- 172.21.15.38:0/3025203719 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c030ed0 con 0x7fd4841079c0 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.692+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4841a69e0 con 0x7fd4841079c0 2024-09-12T12:23:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.693+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841a6f20 con 0x7fd4841079c0 2024-09-12T12:23:41.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.694+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484101e20 con 0x7fd4841079c0 2024-09-12T12:23:41.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.695+0000 7fd47be00640 1 -- 172.21.15.38:0/3025203719 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd47c0041e0 con 0x7fd4841079c0 2024-09-12T12:23:41.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.697+0000 7fd47be00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4680a2c00 0x7fd4680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.697+0000 7fd47be00640 1 -- 172.21.15.38:0/3025203719 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd47c02e030 con 0x7fd4841079c0 2024-09-12T12:23:41.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.697+0000 7fd482a00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4680a2c00 0x7fd4680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.698+0000 7fd482a00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4680a2c00 0x7fd4680a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd474009b50 tx=0x7fd474005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:41.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.701+0000 7fd47be00640 1 -- 172.21.15.38:0/3025203719 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd47c04b060 con 0x7fd4841079c0 2024-09-12T12:23:41.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:41.922+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd48402d7c0 con 0x7fd4841079c0 2024-09-12T12:23:42.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.107+0000 7fd47be00640 1 -- 172.21.15.38:0/3025203719 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fd47c0bd530 con 0x7fd4841079c0 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.109+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4680a2c00 msgr2=0x7fd4680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.109+0000 7fd483e00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4680a2c00 0x7fd4680a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd474009b50 tx=0x7fd474005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.109+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4841079c0 msgr2=0x7fd484074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.109+0000 7fd483e00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4841079c0 0x7fd484074f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd47c033040 tx=0x7fd47c031e60 comp rx=0 tx=0).stop 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 shutdown_connections 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4680a2c00 0x7fd4680a50c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4841079c0 0x7fd484074f70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484102360 0x7fd484074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 --2- 172.21.15.38:0/3025203719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4841019c0 0x7fd4840744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 >> 172.21.15.38:0/3025203719 conn(0x7fd4840fd740 msgr2=0x7fd4840fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:42.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 shutdown_connections 2024-09-12T12:23:42.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:42.110+0000 7fd483e00640 1 -- 172.21.15.38:0/3025203719 wait complete. 2024-09-12T12:23:42.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:42 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3025203719' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:23:42.465 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:42 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3025203719' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:23:42.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:42 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3025203719' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:23:42.860 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T12:23:42.860 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-12T12:23:43.240 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:43.379 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:43 smithi038 ceph-mon[30810]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:43.379 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:43 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3025203719' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:23:43.379 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:43 smithi038 ceph-mon[30810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:43.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:43 smithi154 ceph-mon[35578]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:43.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:43 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3025203719' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:23:43.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:43 smithi154 ceph-mon[35578]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:43.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:43 smithi071 ceph-mon[34859]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:43.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:43 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3025203719' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:23:43.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:43 smithi071 ceph-mon[34859]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 -- 172.21.15.38:0/1465988840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68103e50 msgr2=0x7fad68104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 --2- 172.21.15.38:0/1465988840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68103e50 0x7fad68104230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fad58009900 tx=0x7fad5802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 -- 172.21.15.38:0/1465988840 shutdown_connections 2024-09-12T12:23:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 --2- 172.21.15.38:0/1465988840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad68109090 0x7fad68110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 --2- 172.21.15.38:0/1465988840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68104800 0x7fad68108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 --2- 172.21.15.38:0/1465988840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68103e50 0x7fad68104230 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 -- 172.21.15.38:0/1465988840 >> 172.21.15.38:0/1465988840 conn(0x7fad680ff8b0 msgr2=0x7fad68101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 -- 172.21.15.38:0/1465988840 shutdown_connections 2024-09-12T12:23:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.800+0000 7fad6d000640 1 -- 172.21.15.38:0/1465988840 wait complete. 2024-09-12T12:23:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.801+0000 7fad6d000640 1 Processor -- start 2024-09-12T12:23:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad6d000640 1 -- start start 2024-09-12T12:23:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad6d000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68103e50 0x7fad6819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad6d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68104800 0x7fad6819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad6d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad68109090 0x7fad6819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad6d000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fad681140b0 con 0x7fad68103e50 2024-09-12T12:23:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad6d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad68113f30 con 0x7fad68104800 2024-09-12T12:23:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad6d000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad68114230 con 0x7fad68109090 2024-09-12T12:23:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad67400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68103e50 0x7fad6819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad67400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68103e50 0x7fad6819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38086/0 (socket says 172.21.15.38:38086) 2024-09-12T12:23:43.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad67400640 1 -- 172.21.15.38:0/2225218656 learned_addr learned my addr 172.21.15.38:0/2225218656 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:43.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad67e00640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad68109090 0x7fad6819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.802+0000 7fad5fe00640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68104800 0x7fad6819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad67400640 1 -- 172.21.15.38:0/2225218656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad68109090 msgr2=0x7fad6819ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad67400640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad68109090 0x7fad6819ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad67400640 1 -- 172.21.15.38:0/2225218656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68104800 msgr2=0x7fad6819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad67400640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68104800 0x7fad6819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad67400640 1 -- 172.21.15.38:0/2225218656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6819f500 con 0x7fad68103e50 2024-09-12T12:23:43.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad67400640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68103e50 0x7fad6819a550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad58006010 tx=0x7fad58004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:43.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad64c00640 1 -- 172.21.15.38:0/2225218656 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5803f030 con 0x7fad68103e50 2024-09-12T12:23:43.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad64c00640 1 -- 172.21.15.38:0/2225218656 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad58004440 con 0x7fad68103e50 2024-09-12T12:23:43.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6819f790 con 0x7fad68103e50 2024-09-12T12:23:43.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad64c00640 1 -- 172.21.15.38:0/2225218656 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58035070 con 0x7fad68103e50 2024-09-12T12:23:43.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.803+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad681a70d0 con 0x7fad68103e50 2024-09-12T12:23:43.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.805+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad68105330 con 0x7fad68103e50 2024-09-12T12:23:43.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.806+0000 7fad64c00640 1 -- 172.21.15.38:0/2225218656 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fad58042030 con 0x7fad68103e50 2024-09-12T12:23:43.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.807+0000 7fad64c00640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fad4c0a2b80 0x7fad4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.808+0000 7fad64c00640 1 -- 172.21.15.38:0/2225218656 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fad580ef750 con 0x7fad68103e50 2024-09-12T12:23:43.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.808+0000 7fad5fe00640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fad4c0a2b80 0x7fad4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.809+0000 7fad5fe00640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fad4c0a2b80 0x7fad4c0a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fad680ffcd0 tx=0x7fad50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:43.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:43.812+0000 7fad64c00640 1 -- 172.21.15.38:0/2225218656 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad580bbca0 con 0x7fad68103e50 2024-09-12T12:23:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.035+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fad6819b8e0 con 0x7fad68103e50 2024-09-12T12:23:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.121+0000 7fad64c00640 1 -- 172.21.15.38:0/2225218656 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fad6819b8e0 con 0x7fad68103e50 2024-09-12T12:23:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fad4c0a2b80 msgr2=0x7fad4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fad4c0a2b80 0x7fad4c0a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fad680ffcd0 tx=0x7fad50005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68103e50 msgr2=0x7fad6819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68103e50 0x7fad6819a550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad58006010 tx=0x7fad58004040 comp rx=0 tx=0).stop 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 shutdown_connections 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fad4c0a2b80 0x7fad4c0a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad68109090 0x7fad6819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad68104800 0x7fad6819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 --2- 172.21.15.38:0/2225218656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68103e50 0x7fad6819a550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 >> 172.21.15.38:0/2225218656 conn(0x7fad680ff8b0 msgr2=0x7fad68100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.123+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 shutdown_connections 2024-09-12T12:23:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:44.124+0000 7fad6d000640 1 -- 172.21.15.38:0/2225218656 wait complete. 2024-09-12T12:23:44.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:44 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2225218656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T12:23:44.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:44 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2225218656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T12:23:44.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:44 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2225218656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T12:23:44.862 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T12:23:45.246 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:45.384 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:45 smithi038 ceph-mon[30810]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:45.384 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:45 smithi038 ceph-mon[30810]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:23:45.384 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:45 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2225218656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T12:23:45.384 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:45 smithi038 ceph-mon[30810]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:23:45.384 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:45 smithi038 ceph-mon[30810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:45.384 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:45 smithi038 ceph-mon[30810]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T12:23:45.385 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:45 smithi038 ceph-mon[30810]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T12:23:45.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:45 smithi154 ceph-mon[35578]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:45 smithi154 ceph-mon[35578]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:23:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:45 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2225218656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T12:23:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:45 smithi154 ceph-mon[35578]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:23:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:45 smithi154 ceph-mon[35578]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:45 smithi154 ceph-mon[35578]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T12:23:45.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:45 smithi154 ceph-mon[35578]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T12:23:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:45 smithi071 ceph-mon[34859]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:45 smithi071 ceph-mon[34859]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:23:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:45 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2225218656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T12:23:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:45 smithi071 ceph-mon[34859]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:23:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:45 smithi071 ceph-mon[34859]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:23:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:45 smithi071 ceph-mon[34859]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T12:23:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:45 smithi071 ceph-mon[34859]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T12:23:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 -- 172.21.15.38:0/3010029883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c1049a0 msgr2=0x7fa40c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 --2- 172.21.15.38:0/3010029883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c1049a0 0x7fa40c1089f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009900 tx=0x7fa3f402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 -- 172.21.15.38:0/3010029883 shutdown_connections 2024-09-12T12:23:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 --2- 172.21.15.38:0/3010029883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c109120 0x7fa40c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 --2- 172.21.15.38:0/3010029883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c1049a0 0x7fa40c1089f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 --2- 172.21.15.38:0/3010029883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa40c103ff0 0x7fa40c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 -- 172.21.15.38:0/3010029883 >> 172.21.15.38:0/3010029883 conn(0x7fa40c0ffa90 msgr2=0x7fa40c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 -- 172.21.15.38:0/3010029883 shutdown_connections 2024-09-12T12:23:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.752+0000 7fa411800640 1 -- 172.21.15.38:0/3010029883 wait complete. 2024-09-12T12:23:45.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.753+0000 7fa411800640 1 Processor -- start 2024-09-12T12:23:45.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.753+0000 7fa411800640 1 -- start start 2024-09-12T12:23:45.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa411800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c103ff0 0x7fa40c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:45.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa411800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa40c1049a0 0x7fa40c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:45.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa411800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c109120 0x7fa40c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:45.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa411800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c114120 con 0x7fa40c1049a0 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa411800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c113fa0 con 0x7fa40c109120 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa411800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c1142a0 con 0x7fa40c103ff0 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa40aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c103ff0 0x7fa40c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa403e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa40c1049a0 0x7fa40c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa40aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c103ff0 0x7fa40c19a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:46064/0 (socket says 172.21.15.38:46064) 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa40aa00640 1 -- 172.21.15.38:0/535227289 learned_addr learned my addr 172.21.15.38:0/535227289 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.754+0000 7fa40b400640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c109120 0x7fa40c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa40aa00640 1 -- 172.21.15.38:0/535227289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c109120 msgr2=0x7fa40c19ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa40aa00640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c109120 0x7fa40c19ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa40aa00640 1 -- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa40c1049a0 msgr2=0x7fa40c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa40aa00640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa40c1049a0 0x7fa40c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:45.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa40aa00640 1 -- 172.21.15.38:0/535227289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c19f670 con 0x7fa40c103ff0 2024-09-12T12:23:45.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa40b400640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c109120 0x7fa40c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:45.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa40aa00640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c103ff0 0x7fa40c19a6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00e9f0 tx=0x7fa3fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:45.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa403400640 1 -- 172.21.15.38:0/535227289 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00cd80 con 0x7fa40c103ff0 2024-09-12T12:23:45.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40c19f960 con 0x7fa40c103ff0 2024-09-12T12:23:45.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa403400640 1 -- 172.21.15.38:0/535227289 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3fc010910 con 0x7fa40c103ff0 2024-09-12T12:23:45.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa403400640 1 -- 172.21.15.38:0/535227289 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0188f0 con 0x7fa40c103ff0 2024-09-12T12:23:45.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.755+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40c1a7240 con 0x7fa40c103ff0 2024-09-12T12:23:45.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.757+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40c1043d0 con 0x7fa40c103ff0 2024-09-12T12:23:45.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.759+0000 7fa403400640 1 -- 172.21.15.38:0/535227289 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa3fc010ac0 con 0x7fa40c103ff0 2024-09-12T12:23:45.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.760+0000 7fa403400640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa3f00a2c00 0x7fa3f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:45.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.760+0000 7fa403400640 1 -- 172.21.15.38:0/535227289 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa3fc0cfc40 con 0x7fa40c103ff0 2024-09-12T12:23:45.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.760+0000 7fa403e00640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa3f00a2c00 0x7fa3f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:45.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.761+0000 7fa403e00640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa3f00a2c00 0x7fa3f00a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009230 tx=0x7fa3f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:45.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.762+0000 7fa403400640 1 -- 172.21.15.38:0/535227289 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3fc09c190 con 0x7fa40c103ff0 2024-09-12T12:23:45.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:45.985+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa40c10c360 con 0x7fa40c103ff0 2024-09-12T12:23:46.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.155+0000 7fa403400640 1 -- 172.21.15.38:0/535227289 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fa3fc0a0490 con 0x7fa40c103ff0 2024-09-12T12:23:46.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa3f00a2c00 msgr2=0x7fa3f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:46.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa3f00a2c00 0x7fa3f00a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009230 tx=0x7fa3f40058d0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c103ff0 msgr2=0x7fa40c19a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:46.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c103ff0 0x7fa40c19a6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00e9f0 tx=0x7fa3fc00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 shutdown_connections 2024-09-12T12:23:46.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa3f00a2c00 0x7fa3f00a50c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa40c109120 0x7fa40c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa40c1049a0 0x7fa40c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 --2- 172.21.15.38:0/535227289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c103ff0 0x7fa40c19a6c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 >> 172.21.15.38:0/535227289 conn(0x7fa40c0ffa90 msgr2=0x7fa40c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:46.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 shutdown_connections 2024-09-12T12:23:46.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:46.158+0000 7fa411800640 1 -- 172.21.15.38:0/535227289 wait complete. 2024-09-12T12:23:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:46 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] up:active 2024-09-12T12:23:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:46 smithi154 ceph-mon[35578]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:23:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:46 smithi154 ceph-mon[35578]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T12:23:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:46 smithi154 ceph-mon[35578]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T12:23:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:46 smithi154 ceph-mon[35578]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T12:23:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:46 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/535227289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:23:46.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:46 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:23:46.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:46 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] up:active 2024-09-12T12:23:46.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:46 smithi038 ceph-mon[30810]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:23:46.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:46 smithi038 ceph-mon[30810]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T12:23:46.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:46 smithi038 ceph-mon[30810]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T12:23:46.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:46 smithi038 ceph-mon[30810]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T12:23:46.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:46 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/535227289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:23:46.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:46 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:23:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:46 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] up:active 2024-09-12T12:23:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:46 smithi071 ceph-mon[34859]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:23:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:46 smithi071 ceph-mon[34859]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T12:23:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:46 smithi071 ceph-mon[34859]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T12:23:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:46 smithi071 ceph-mon[34859]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T12:23:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:46 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/535227289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:23:46.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:46 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:23:46.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T12:23:47.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:47 smithi038 ceph-mon[30810]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 92 B/s wr, 0 op/s 2024-09-12T12:23:47.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:47 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:23:47.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:47 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] up:active 2024-09-12T12:23:47.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:47 smithi038 ceph-mon[30810]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T12:23:47.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:47 smithi038 ceph-mon[30810]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T12:23:47.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:47 smithi038 ceph-mon[30810]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T12:23:47.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:47 smithi038 ceph-mon[30810]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T12:23:47.369 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:47.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:47 smithi154 ceph-mon[35578]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 92 B/s wr, 0 op/s 2024-09-12T12:23:47.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:47 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:23:47.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:47 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] up:active 2024-09-12T12:23:47.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:47 smithi154 ceph-mon[35578]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T12:23:47.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:47 smithi154 ceph-mon[35578]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T12:23:47.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:47 smithi154 ceph-mon[35578]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T12:23:47.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:47 smithi154 ceph-mon[35578]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T12:23:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:47 smithi071 ceph-mon[34859]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 92 B/s wr, 0 op/s 2024-09-12T12:23:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:47 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:23:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:47 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] up:active 2024-09-12T12:23:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:47 smithi071 ceph-mon[34859]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T12:23:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:47 smithi071 ceph-mon[34859]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T12:23:47.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:47 smithi071 ceph-mon[34859]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T12:23:47.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:47 smithi071 ceph-mon[34859]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T12:23:47.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.979+0000 7fc631800640 1 -- 172.21.15.38:0/647805195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c1049a0 msgr2=0x7fc62c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:47.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.979+0000 7fc631800640 1 --2- 172.21.15.38:0/647805195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c1049a0 0x7fc62c1089f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc614009900 tx=0x7fc61402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.980+0000 7fc631800640 1 -- 172.21.15.38:0/647805195 shutdown_connections 2024-09-12T12:23:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.980+0000 7fc631800640 1 --2- 172.21.15.38:0/647805195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c109120 0x7fc62c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.980+0000 7fc631800640 1 --2- 172.21.15.38:0/647805195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c1049a0 0x7fc62c1089f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.980+0000 7fc631800640 1 --2- 172.21.15.38:0/647805195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 0x7fc62c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.980+0000 7fc631800640 1 -- 172.21.15.38:0/647805195 >> 172.21.15.38:0/647805195 conn(0x7fc62c0ffa90 msgr2=0x7fc62c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.980+0000 7fc631800640 1 -- 172.21.15.38:0/647805195 shutdown_connections 2024-09-12T12:23:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.980+0000 7fc631800640 1 -- 172.21.15.38:0/647805195 wait complete. 2024-09-12T12:23:47.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 Processor -- start 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 -- start start 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 0x7fc62c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c1049a0 0x7fc62c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c109120 0x7fc62c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c114170 con 0x7fc62c109120 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c113ff0 con 0x7fc62c103ff0 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.981+0000 7fc631800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c1142f0 con 0x7fc62c1049a0 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c109120 0x7fc62c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 0x7fc62c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 0x7fc62c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55292/0 (socket says 172.21.15.38:55292) 2024-09-12T12:23:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 -- 172.21.15.38:0/1093320052 learned_addr learned my addr 172.21.15.38:0/1093320052 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:47.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c109120 0x7fc62c19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59610/0 (socket says 172.21.15.38:59610) 2024-09-12T12:23:47.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc622000640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c1049a0 0x7fc62c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:47.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 -- 172.21.15.38:0/1093320052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c1049a0 msgr2=0x7fc62c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:47.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c1049a0 0x7fc62c19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:47.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 -- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c109120 msgr2=0x7fc62c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:47.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c109120 0x7fc62c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:47.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 -- 172.21.15.38:0/1093320052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c19f600 con 0x7fc62c103ff0 2024-09-12T12:23:47.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.982+0000 7fc62aa00640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 0x7fc62c19a650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00e9f0 tx=0x7fc61c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.983+0000 7fc623e00640 1 -- 172.21.15.38:0/1093320052 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00cd80 con 0x7fc62c103ff0 2024-09-12T12:23:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.983+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c19f8f0 con 0x7fc62c103ff0 2024-09-12T12:23:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.983+0000 7fc623e00640 1 -- 172.21.15.38:0/1093320052 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc61c010910 con 0x7fc62c103ff0 2024-09-12T12:23:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.983+0000 7fc623e00640 1 -- 172.21.15.38:0/1093320052 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c018980 con 0x7fc62c103ff0 2024-09-12T12:23:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.983+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c1a71d0 con 0x7fc62c103ff0 2024-09-12T12:23:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.984+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62c1043d0 con 0x7fc62c103ff0 2024-09-12T12:23:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.986+0000 7fc623e00640 1 -- 172.21.15.38:0/1093320052 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc61c010ac0 con 0x7fc62c103ff0 2024-09-12T12:23:47.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.987+0000 7fc623e00640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6100a2c00 0x7fc6100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:47.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.987+0000 7fc623e00640 1 -- 172.21.15.38:0/1093320052 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc61c0cf900 con 0x7fc62c103ff0 2024-09-12T12:23:47.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.988+0000 7fc622000640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6100a2c00 0x7fc6100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:47.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.988+0000 7fc622000640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6100a2c00 0x7fc6100a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc614000c00 tx=0x7fc614005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:47.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:47.989+0000 7fc623e00640 1 -- 172.21.15.38:0/1093320052 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc61c09be50 con 0x7fc62c103ff0 2024-09-12T12:23:48.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:48.218+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc62c10c360 con 0x7fc62c103ff0 2024-09-12T12:23:48.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:48 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] up:active 2024-09-12T12:23:48.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:48 smithi038 ceph-mon[30810]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T12:23:48.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:48 smithi038 ceph-mon[30810]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:23:48.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:48 smithi038 ceph-mon[30810]: Cluster is now healthy 2024-09-12T12:23:48.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:48 smithi038 ceph-mon[30810]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T12:23:48.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:48 smithi038 ceph-mon[30810]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T12:23:48.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:48 smithi038 ceph-mon[30810]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T12:23:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] up:active 2024-09-12T12:23:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-mon[34859]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T12:23:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-mon[34859]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:23:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-mon[34859]: Cluster is now healthy 2024-09-12T12:23:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-mon[34859]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T12:23:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-mon[34859]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T12:23:48.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-mon[34859]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T12:23:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:48 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] up:active 2024-09-12T12:23:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:48 smithi154 ceph-mon[35578]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T12:23:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:48 smithi154 ceph-mon[35578]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:23:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:48 smithi154 ceph-mon[35578]: Cluster is now healthy 2024-09-12T12:23:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:48 smithi154 ceph-mon[35578]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T12:23:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:48 smithi154 ceph-mon[35578]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T12:23:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:48 smithi154 ceph-mon[35578]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T12:23:49.014 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:23:48 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: 2024-09-12T12:23:48.620+0000 7f0b4b86a640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-12T12:23:49.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.194+0000 7fc623e00640 1 -- 172.21.15.38:0/1093320052 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7fc61c0a0150 con 0x7fc62c103ff0 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6100a2c00 msgr2=0x7fc6100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6100a2c00 0x7fc6100a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc614000c00 tx=0x7fc614005b50 comp rx=0 tx=0).stop 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 msgr2=0x7fc62c19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 0x7fc62c19a650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00e9f0 tx=0x7fc61c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 shutdown_connections 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6100a2c00 0x7fc6100a50c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c109120 0x7fc62c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c1049a0 0x7fc62c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 --2- 172.21.15.38:0/1093320052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c103ff0 0x7fc62c19a650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 >> 172.21.15.38:0/1093320052 conn(0x7fc62c0ffa90 msgr2=0x7fc62c100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 shutdown_connections 2024-09-12T12:23:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:49.198+0000 7fc631800640 1 -- 172.21.15.38:0/1093320052 wait complete. 2024-09-12T12:23:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:49 smithi038 ceph-mon[30810]: pgmap v328: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 11 op/s 2024-09-12T12:23:49.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] up:active 2024-09-12T12:23:49.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:49 smithi038 ceph-mon[30810]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T12:23:49.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:49 smithi038 ceph-mon[30810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:23:49.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:49 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1093320052' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:23:49.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:49 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:23:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:49 smithi071 ceph-mon[34859]: pgmap v328: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 11 op/s 2024-09-12T12:23:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] up:active 2024-09-12T12:23:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:49 smithi071 ceph-mon[34859]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T12:23:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:49 smithi071 ceph-mon[34859]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:23:49.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:49 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1093320052' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:23:49.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:49 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:23:49.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:49 smithi154 ceph-mon[35578]: pgmap v328: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 11 op/s 2024-09-12T12:23:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] up:active 2024-09-12T12:23:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:49 smithi154 ceph-mon[35578]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T12:23:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:49 smithi154 ceph-mon[35578]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:23:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:49 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1093320052' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:23:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:49 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:23:49.971 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-12T12:23:49.972 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T12:23:50.360 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:50.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:50 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:23:50.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:50 smithi038 ceph-mon[30810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:23:50.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:50 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:23:50.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:50 smithi071 ceph-mon[34859]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:23:50.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:50 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:23:50.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:50 smithi154 ceph-mon[35578]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:23:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 -- 172.21.15.38:0/1939902475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9978109120 msgr2=0x7f9978110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 --2- 172.21.15.38:0/1939902475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9978109120 0x7f9978110ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9970009ca0 tx=0x7f997002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 -- 172.21.15.38:0/1939902475 shutdown_connections 2024-09-12T12:23:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 --2- 172.21.15.38:0/1939902475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9978109120 0x7f9978110ca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 --2- 172.21.15.38:0/1939902475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99781049a0 0x7f99781089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 --2- 172.21.15.38:0/1939902475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9978103ff0 0x7f99781043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 -- 172.21.15.38:0/1939902475 >> 172.21.15.38:0/1939902475 conn(0x7f99780ffa90 msgr2=0x7f9978101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:50.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 -- 172.21.15.38:0/1939902475 shutdown_connections 2024-09-12T12:23:50.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.911+0000 7f997d200640 1 -- 172.21.15.38:0/1939902475 wait complete. 2024-09-12T12:23:50.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.912+0000 7f997d200640 1 Processor -- start 2024-09-12T12:23:50.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.912+0000 7f997d200640 1 -- start start 2024-09-12T12:23:50.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f997d200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9978103ff0 0x7f997819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f997d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99781049a0 0x7f997819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f997d200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9978109120 0x7f997819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f997d200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f99781141a0 con 0x7f9978109120 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f997d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9978114020 con 0x7f99781049a0 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f997d200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9978114320 con 0x7f9978103ff0 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9978103ff0 0x7f997819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9976800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9978109120 0x7f997819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9978103ff0 0x7f997819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:46114/0 (socket says 172.21.15.38:46114) 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 -- 172.21.15.38:0/821415554 learned_addr learned my addr 172.21.15.38:0/821415554 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f996fe00640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99781049a0 0x7f997819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 -- 172.21.15.38:0/821415554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99781049a0 msgr2=0x7f997819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99781049a0 0x7f997819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 -- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9978109120 msgr2=0x7f997819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9978109120 0x7f997819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.913+0000 7f9975e00640 1 -- 172.21.15.38:0/821415554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997819f5b0 con 0x7f9978103ff0 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.914+0000 7f9975e00640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9978103ff0 0x7f997819a600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f996800e9f0 tx=0x7f996800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.914+0000 7f996ea00640 1 -- 172.21.15.38:0/821415554 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996800cd80 con 0x7f9978103ff0 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.914+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997819f8a0 con 0x7f9978103ff0 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.914+0000 7f996ea00640 1 -- 172.21.15.38:0/821415554 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9968010910 con 0x7f9978103ff0 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.914+0000 7f996ea00640 1 -- 172.21.15.38:0/821415554 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99680188f0 con 0x7f9978103ff0 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.914+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99781a7180 con 0x7f9978103ff0 2024-09-12T12:23:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.915+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99781043d0 con 0x7f9978103ff0 2024-09-12T12:23:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.917+0000 7f996ea00640 1 -- 172.21.15.38:0/821415554 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9968010ac0 con 0x7f9978103ff0 2024-09-12T12:23:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.919+0000 7f996ea00640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f995c0a2b80 0x7f995c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.919+0000 7f996ea00640 1 -- 172.21.15.38:0/821415554 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f99680cfb90 con 0x7f9978103ff0 2024-09-12T12:23:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.919+0000 7f996fe00640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f995c0a2b80 0x7f995c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.919+0000 7f996fe00640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f995c0a2b80 0x7f995c0a5040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9978101840 tx=0x7f9960005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:50.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:50.921+0000 7f996ea00640 1 -- 172.21.15.38:0/821415554 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f996809c0e0 con 0x7f9978103ff0 2024-09-12T12:23:51.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.142+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9978100cc0 con 0x7f995c0a2b80 2024-09-12T12:23:51.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.172+0000 7f996ea00640 1 -- 172.21.15.38:0/821415554 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9978100cc0 con 0x7f995c0a2b80 2024-09-12T12:23:51.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f995c0a2b80 msgr2=0x7f995c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:51.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f995c0a2b80 0x7f995c0a5040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9978101840 tx=0x7f9960005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9978103ff0 msgr2=0x7f997819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9978103ff0 0x7f997819a600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f996800e9f0 tx=0x7f996800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 shutdown_connections 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f995c0a2b80 0x7f995c0a5040 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9978109120 0x7f997819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99781049a0 0x7f997819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 --2- 172.21.15.38:0/821415554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9978103ff0 0x7f997819a600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 >> 172.21.15.38:0/821415554 conn(0x7f99780ffa90 msgr2=0x7f99781005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 shutdown_connections 2024-09-12T12:23:51.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:51.175+0000 7f997d200640 1 -- 172.21.15.38:0/821415554 wait complete. 2024-09-12T12:23:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:51 smithi038 ceph-mon[30810]: pgmap v329: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 11 op/s 2024-09-12T12:23:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:51 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:51.469 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:23:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:23:51.151+0000 7f6bdf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:23:51.469 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:23:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:23:51.151+0000 7f6bdf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:23:51.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:23:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:23:51.151+0000 7f6bdf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:23:51.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:23:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:23:51.151+0000 7f6bdf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:23:51.470 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:23:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:23:51.151+0000 7f6bdf600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:23:51.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:51 smithi071 ceph-mon[34859]: pgmap v329: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 11 op/s 2024-09-12T12:23:51.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:51 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:51.624 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:51 smithi154 ceph-mon[35578]: pgmap v329: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 11 op/s 2024-09-12T12:23:51.625 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:51 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:51.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T12:23:52.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:52 smithi038 ceph-mon[30810]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:52.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:52 smithi071 ceph-mon[34859]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:52.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:52 smithi154 ceph-mon[35578]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:52.911 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:53.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:53 smithi038 ceph-mon[30810]: pgmap v330: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.9 KiB/s wr, 16 op/s 2024-09-12T12:23:53.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:53 smithi038 ceph-mon[30810]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T12:23:53.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:53 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:53 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:53 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.313 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:53 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:53 smithi071 ceph-mon[34859]: pgmap v330: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.9 KiB/s wr, 16 op/s 2024-09-12T12:23:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:53 smithi071 ceph-mon[34859]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T12:23:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:53 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:53 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:53 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:53 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2816953468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc109120 msgr2=0x7fa0dc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2816953468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc109120 0x7fa0dc110ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009ca0 tx=0x7fa0d402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2816953468 shutdown_connections 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2816953468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc109120 0x7fa0dc110ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2816953468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0dc1049a0 0x7fa0dc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2816953468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0dc103ff0 0x7fa0dc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2816953468 >> 172.21.15.38:0/2816953468 conn(0x7fa0dc0ffa90 msgr2=0x7fa0dc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2816953468 shutdown_connections 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.579+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2816953468 wait complete. 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.580+0000 7fa0e1c00640 1 Processor -- start 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.580+0000 7fa0e1c00640 1 -- start start 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0e1c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0dc103ff0 0x7fa0dc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0e1c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc1049a0 0x7fa0dc19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0e1c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0dc109120 0x7fa0dc19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0e1c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc114150 con 0x7fa0dc1049a0 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0e1c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc113fd0 con 0x7fa0dc103ff0 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0e1c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc1142d0 con 0x7fa0dc109120 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc1049a0 0x7fa0dc19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc1049a0 0x7fa0dc19aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59674/0 (socket says 172.21.15.38:59674) 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 -- 172.21.15.38:0/2305282621 learned_addr learned my addr 172.21.15.38:0/2305282621 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0daa00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0dc103ff0 0x7fa0dc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0db400640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0dc109120 0x7fa0dc19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 -- 172.21.15.38:0/2305282621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0dc109120 msgr2=0x7fa0dc19ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0dc109120 0x7fa0dc19ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 -- 172.21.15.38:0/2305282621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0dc103ff0 msgr2=0x7fa0dc19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0dc103ff0 0x7fa0dc19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.581+0000 7fa0d3e00640 1 -- 172.21.15.38:0/2305282621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc19f560 con 0x7fa0dc1049a0 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.582+0000 7fa0d3e00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc1049a0 0x7fa0dc19aaf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400e9f0 tx=0x7fa0c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.582+0000 7fa0d3400640 1 -- 172.21.15.38:0/2305282621 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c400cd80 con 0x7fa0dc1049a0 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.582+0000 7fa0d3400640 1 -- 172.21.15.38:0/2305282621 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0c4005500 con 0x7fa0dc1049a0 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.582+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc19f850 con 0x7fa0dc1049a0 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.582+0000 7fa0d3400640 1 -- 172.21.15.38:0/2305282621 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4010690 con 0x7fa0dc1049a0 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.582+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc1a7130 con 0x7fa0dc1049a0 2024-09-12T12:23:53.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.583+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc1043d0 con 0x7fa0dc1049a0 2024-09-12T12:23:53.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.585+0000 7fa0d3400640 1 -- 172.21.15.38:0/2305282621 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa0c40046c0 con 0x7fa0dc1049a0 2024-09-12T12:23:53.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.587+0000 7fa0d3400640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa0c00a2c10 0x7fa0c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.587+0000 7fa0d3400640 1 -- 172.21.15.38:0/2305282621 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa0c40cf930 con 0x7fa0dc1049a0 2024-09-12T12:23:53.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.587+0000 7fa0daa00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa0c00a2c10 0x7fa0c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.588+0000 7fa0daa00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa0c00a2c10 0x7fa0c00a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0095f0 tx=0x7fa0cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:53.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.591+0000 7fa0d3400640 1 -- 172.21.15.38:0/2305282621 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0c409c370 con 0x7fa0dc1049a0 2024-09-12T12:23:53.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:53 smithi154 ceph-mon[35578]: pgmap v330: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.9 KiB/s wr, 16 op/s 2024-09-12T12:23:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:53 smithi154 ceph-mon[35578]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T12:23:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:53 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:53 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:53 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:53 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:53.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.836+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa0dc100d90 con 0x7fa0c00a2c10 2024-09-12T12:23:53.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.862+0000 7fa0d3400640 1 -- 172.21.15.38:0/2305282621 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa0dc100d90 con 0x7fa0c00a2c10 2024-09-12T12:23:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.864+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa0c00a2c10 msgr2=0x7fa0c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.864+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa0c00a2c10 0x7fa0c00a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0095f0 tx=0x7fa0cc005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.864+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc1049a0 msgr2=0x7fa0dc19aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.864+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc1049a0 0x7fa0dc19aaf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400e9f0 tx=0x7fa0c400edf0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 shutdown_connections 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa0c00a2c10 0x7fa0c00a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0dc109120 0x7fa0dc19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc1049a0 0x7fa0dc19aaf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 --2- 172.21.15.38:0/2305282621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0dc103ff0 0x7fa0dc19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 >> 172.21.15.38:0/2305282621 conn(0x7fa0dc0ffa90 msgr2=0x7fa0dc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 shutdown_connections 2024-09-12T12:23:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:53.865+0000 7fa0e1c00640 1 -- 172.21.15.38:0/2305282621 wait complete. 2024-09-12T12:23:54.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:54 smithi038 ceph-mon[30810]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:54.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:54.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:54 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:54.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:54 smithi071 ceph-mon[34859]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:54.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:54 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:54.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:54 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:54.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T12:23:54.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:54 smithi154 ceph-mon[35578]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:54.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:54 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:54.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:54 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:55.025 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:55.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:55 smithi038 ceph-mon[30810]: pgmap v331: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-12T12:23:55.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:55.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:55.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:55.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:55 smithi071 ceph-mon[34859]: pgmap v331: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-12T12:23:55.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:55.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:55.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 -- 172.21.15.38:0/3159981573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c112a50 msgr2=0x7f032c114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 --2- 172.21.15.38:0/3159981573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c112a50 0x7f032c114e40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0324009ca0 tx=0x7f032402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 -- 172.21.15.38:0/3159981573 shutdown_connections 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 --2- 172.21.15.38:0/3159981573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c112a50 0x7f032c114e40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 --2- 172.21.15.38:0/3159981573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f032c077040 0x7f032c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 --2- 172.21.15.38:0/3159981573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f032c076720 0x7f032c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 -- 172.21.15.38:0/3159981573 >> 172.21.15.38:0/3159981573 conn(0x7f032c0ffa50 msgr2=0x7f032c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 -- 172.21.15.38:0/3159981573 shutdown_connections 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.609+0000 7f0330a00640 1 -- 172.21.15.38:0/3159981573 wait complete. 2024-09-12T12:23:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 Processor -- start 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 -- start start 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c076720 0x7f032c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f032c077040 0x7f032c19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f032c112a50 0x7f032c1a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f032c1185f0 con 0x7f032c076720 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f032c118470 con 0x7f032c112a50 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.610+0000 7f0330a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f032c118770 con 0x7f032c077040 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c076720 0x7f032c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f032a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f032c112a50 0x7f032c1a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c076720 0x7f032c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55836/0 (socket says 172.21.15.38:55836) 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 -- 172.21.15.38:0/2331785562 learned_addr learned my addr 172.21.15.38:0/2331785562 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0323e00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f032c077040 0x7f032c19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 -- 172.21.15.38:0/2331785562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f032c077040 msgr2=0x7f032c19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f032c077040 0x7f032c19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 -- 172.21.15.38:0/2331785562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f032c112a50 msgr2=0x7f032c1a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f032c112a50 0x7f032c1a3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.611+0000 7f0329e00640 1 -- 172.21.15.38:0/2331785562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c1a3bc0 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.612+0000 7f0329e00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c076720 0x7f032c19eb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e9f0 tx=0x7f031c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.612+0000 7f0322a00640 1 -- 172.21.15.38:0/2331785562 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c00cd80 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.612+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c1a3eb0 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.612+0000 7f0322a00640 1 -- 172.21.15.38:0/2331785562 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f031c005500 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.612+0000 7f0322a00640 1 -- 172.21.15.38:0/2331785562 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c010690 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.612+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c1ab740 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.613+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c076b00 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.615+0000 7f0322a00640 1 -- 172.21.15.38:0/2331785562 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f031c0046c0 con 0x7f032c076720 2024-09-12T12:23:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.616+0000 7f0322a00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03100a2c10 0x7f03100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.616+0000 7f0322a00640 1 -- 172.21.15.38:0/2331785562 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f031c0cf970 con 0x7f032c076720 2024-09-12T12:23:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.616+0000 7f0323e00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03100a2c10 0x7f03100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.617+0000 7f0323e00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03100a2c10 0x7f03100a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f032c079360 tx=0x7f0314005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.621+0000 7f0322a00640 1 -- 172.21.15.38:0/2331785562 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f031c09c3b0 con 0x7f032c076720 2024-09-12T12:23:55.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:55 smithi154 ceph-mon[35578]: pgmap v331: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-12T12:23:55.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:55.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:55.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:23:55.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.832+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f032c062630 con 0x7f03100a2c10 2024-09-12T12:23:55.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.839+0000 7f0322a00640 1 -- 172.21.15.38:0/2331785562 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f032c062630 con 0x7f03100a2c10 2024-09-12T12:23:55.840 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/qa/sv_0/20db09c1-7a25-4d32-9961-c25e9e36e537 2024-09-12T12:23:55.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.841+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03100a2c10 msgr2=0x7f03100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.841+0000 7f0330a00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03100a2c10 0x7f03100a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f032c079360 tx=0x7f0314005f90 comp rx=0 tx=0).stop 2024-09-12T12:23:55.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.841+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c076720 msgr2=0x7f032c19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.841+0000 7f0330a00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c076720 0x7f032c19eb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e9f0 tx=0x7f031c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 shutdown_connections 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03100a2c10 0x7f03100a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f032c112a50 0x7f032c1a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f032c077040 0x7f032c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 --2- 172.21.15.38:0/2331785562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c076720 0x7f032c19eb90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 >> 172.21.15.38:0/2331785562 conn(0x7f032c0ffa50 msgr2=0x7f032c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 shutdown_connections 2024-09-12T12:23:55.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:55.842+0000 7f0330a00640 1 -- 172.21.15.38:0/2331785562 wait complete. 2024-09-12T12:23:56.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:56 smithi038 ceph-mon[30810]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:56.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:56 smithi071 ceph-mon[34859]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:56.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T12:23:56.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:56 smithi154 ceph-mon[35578]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:56.963 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:57.386 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:57 smithi038 ceph-mon[30810]: pgmap v332: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-12T12:23:57.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 -- 172.21.15.38:0/2050895280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c103ff0 msgr2=0x7f179c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 --2- 172.21.15.38:0/2050895280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c103ff0 0x7f179c1043d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f178c009900 tx=0x7f178c02a410 comp rx=0 tx=0).stop 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 -- 172.21.15.38:0/2050895280 shutdown_connections 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 --2- 172.21.15.38:0/2050895280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f179c109120 0x7f179c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 --2- 172.21.15.38:0/2050895280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179c1049a0 0x7f179c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 --2- 172.21.15.38:0/2050895280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c103ff0 0x7f179c1043d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 -- 172.21.15.38:0/2050895280 >> 172.21.15.38:0/2050895280 conn(0x7f179c0ffa90 msgr2=0x7f179c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 -- 172.21.15.38:0/2050895280 shutdown_connections 2024-09-12T12:23:57.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.503+0000 7f17a2600640 1 -- 172.21.15.38:0/2050895280 wait complete. 2024-09-12T12:23:57.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 Processor -- start 2024-09-12T12:23:57.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 -- start start 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f179c103ff0 0x7f179c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c1049a0 0x7f179c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179c109120 0x7f179c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f179c114170 con 0x7f179c1049a0 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f179c113ff0 con 0x7f179c103ff0 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.504+0000 7f17a2600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f179c1142f0 con 0x7f179c109120 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c1049a0 0x7f179c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c1049a0 0x7f179c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55856/0 (socket says 172.21.15.38:55856) 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f179b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f179c103ff0 0x7f179c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 -- 172.21.15.38:0/2789669203 learned_addr learned my addr 172.21.15.38:0/2789669203 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:57.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f179be00640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179c109120 0x7f179c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 -- 172.21.15.38:0/2789669203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179c109120 msgr2=0x7f179c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179c109120 0x7f179c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 -- 172.21.15.38:0/2789669203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f179c103ff0 msgr2=0x7f179c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f179c103ff0 0x7f179c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f1792a00640 1 -- 172.21.15.38:0/2789669203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179c19f620 con 0x7f179c1049a0 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.505+0000 7f179b400640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f179c103ff0 0x7f179c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.506+0000 7f1792a00640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c1049a0 0x7f179c19abb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f178400d950 tx=0x7f178400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.506+0000 7f1798c00640 1 -- 172.21.15.38:0/2789669203 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784017030 con 0x7f179c1049a0 2024-09-12T12:23:57.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.506+0000 7f1798c00640 1 -- 172.21.15.38:0/2789669203 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1784004020 con 0x7f179c1049a0 2024-09-12T12:23:57.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.506+0000 7f1798c00640 1 -- 172.21.15.38:0/2789669203 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840047a0 con 0x7f179c1049a0 2024-09-12T12:23:57.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.506+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179c19f910 con 0x7f179c1049a0 2024-09-12T12:23:57.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.506+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179c1a71f0 con 0x7f179c1049a0 2024-09-12T12:23:57.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.507+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179c1043d0 con 0x7f179c1049a0 2024-09-12T12:23:57.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.510+0000 7f1798c00640 1 -- 172.21.15.38:0/2789669203 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f17840041d0 con 0x7f179c1049a0 2024-09-12T12:23:57.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.512+0000 7f1798c00640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17800a2c90 0x7f17800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.512+0000 7f1798c00640 1 -- 172.21.15.38:0/2789669203 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f17840cee50 con 0x7f179c1049a0 2024-09-12T12:23:57.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.512+0000 7f179b400640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17800a2c90 0x7f17800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.513+0000 7f179b400640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17800a2c90 0x7f17800a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:57.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:57 smithi071 ceph-mon[34859]: pgmap v332: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-12T12:23:57.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.516+0000 7f1798c00640 1 -- 172.21.15.38:0/2789669203 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f178409b890 con 0x7f179c1049a0 2024-09-12T12:23:57.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:57 smithi154 ceph-mon[35578]: pgmap v332: 129 pgs: 129 active+clean; 593 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-12T12:23:57.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.730+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f179c062630 con 0x7f17800a2c90 2024-09-12T12:23:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.757+0000 7f1798c00640 1 -- 172.21.15.38:0/2789669203 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f179c062630 con 0x7f17800a2c90 2024-09-12T12:23:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17800a2c90 msgr2=0x7f17800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17800a2c90 0x7f17800a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c031510 comp rx=0 tx=0).stop 2024-09-12T12:23:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c1049a0 msgr2=0x7f179c19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c1049a0 0x7f179c19abb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f178400d950 tx=0x7f178400de10 comp rx=0 tx=0).stop 2024-09-12T12:23:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 shutdown_connections 2024-09-12T12:23:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f17800a2c90 0x7f17800a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179c109120 0x7f179c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f179c1049a0 0x7f179c19abb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 --2- 172.21.15.38:0/2789669203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f179c103ff0 0x7f179c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 >> 172.21.15.38:0/2789669203 conn(0x7f179c0ffa90 msgr2=0x7f179c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 shutdown_connections 2024-09-12T12:23:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:57.759+0000 7f17a2600640 1 -- 172.21.15.38:0/2789669203 wait complete. 2024-09-12T12:23:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:58 smithi038 ceph-mon[30810]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:58 smithi071 ceph-mon[34859]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:58.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T12:23:58.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:58 smithi154 ceph-mon[35578]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:58.948 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:59.389 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:23:59 smithi038 ceph-mon[30810]: pgmap v333: 129 pgs: 129 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 24 op/s 2024-09-12T12:23:59.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:23:59 smithi071 ceph-mon[34859]: pgmap v333: 129 pgs: 129 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 24 op/s 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 -- 172.21.15.38:0/3711425574 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc278101df0 msgr2=0x7fc2781021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 --2- 172.21.15.38:0/3711425574 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc278101df0 0x7fc2781021d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc268009900 tx=0x7fc26802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 -- 172.21.15.38:0/3711425574 shutdown_connections 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 --2- 172.21.15.38:0/3711425574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc278106f20 0x7fc27810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 --2- 172.21.15.38:0/3711425574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2781027a0 0x7fc2781067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 --2- 172.21.15.38:0/3711425574 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc278101df0 0x7fc2781021d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 -- 172.21.15.38:0/3711425574 >> 172.21.15.38:0/3711425574 conn(0x7fc2780fd8b0 msgr2=0x7fc2780ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 -- 172.21.15.38:0/3711425574 shutdown_connections 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.510+0000 7fc27e800640 1 -- 172.21.15.38:0/3711425574 wait complete. 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.511+0000 7fc27e800640 1 Processor -- start 2024-09-12T12:23:59.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.511+0000 7fc27e800640 1 -- start start 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc27e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc278101df0 0x7fc278198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc27e800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2781027a0 0x7fc2781989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc27e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc278106f20 0x7fc27819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc27e800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc278111f90 con 0x7fc2781027a0 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc27e800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc278111e10 con 0x7fc278101df0 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc27e800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc278112110 con 0x7fc278106f20 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc276a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2781027a0 0x7fc2781989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc276a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2781027a0 0x7fc2781989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55878/0 (socket says 172.21.15.38:55878) 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc276a00640 1 -- 172.21.15.38:0/1289163557 learned_addr learned my addr 172.21.15.38:0/1289163557 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc277400640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc278101df0 0x7fc278198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.512+0000 7fc277e00640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc278106f20 0x7fc27819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc276a00640 1 -- 172.21.15.38:0/1289163557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc278106f20 msgr2=0x7fc27819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc276a00640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc278106f20 0x7fc27819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc276a00640 1 -- 172.21.15.38:0/1289163557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc278101df0 msgr2=0x7fc278198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc276a00640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc278101df0 0x7fc278198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc276a00640 1 -- 172.21.15.38:0/1289163557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27819d420 con 0x7fc2781027a0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc276a00640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2781027a0 0x7fc2781989b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc26400e9f0 tx=0x7fc26400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc26fe00640 1 -- 172.21.15.38:0/1289163557 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26400cd80 con 0x7fc2781027a0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc26fe00640 1 -- 172.21.15.38:0/1289163557 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc264010910 con 0x7fc2781027a0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27819d710 con 0x7fc2781027a0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.513+0000 7fc26fe00640 1 -- 172.21.15.38:0/1289163557 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264018990 con 0x7fc2781027a0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.514+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2781a4ff0 con 0x7fc2781027a0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.515+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2781021d0 con 0x7fc2781027a0 2024-09-12T12:23:59.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.517+0000 7fc26fe00640 1 -- 172.21.15.38:0/1289163557 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc264010ac0 con 0x7fc2781027a0 2024-09-12T12:23:59.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.518+0000 7fc26fe00640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc25c0a2c90 0x7fc25c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.518+0000 7fc26fe00640 1 -- 172.21.15.38:0/1289163557 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc2640cf800 con 0x7fc2781027a0 2024-09-12T12:23:59.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.518+0000 7fc277400640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc25c0a2c90 0x7fc25c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.519+0000 7fc277400640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc25c0a2c90 0x7fc25c0a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c00 tx=0x7fc268005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:59.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.522+0000 7fc26fe00640 1 -- 172.21.15.38:0/1289163557 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc26409bbf0 con 0x7fc2781027a0 2024-09-12T12:23:59.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:23:59 smithi154 ceph-mon[35578]: pgmap v333: 129 pgs: 129 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 24 op/s 2024-09-12T12:23:59.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.737+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fc278062630 con 0x7fc25c0a2c90 2024-09-12T12:23:59.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.744+0000 7fc26fe00640 1 -- 172.21.15.38:0/1289163557 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc278062630 con 0x7fc25c0a2c90 2024-09-12T12:23:59.744 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/qa/sv_1/fe7beb60-a0f0-4540-a5e6-b697364df4c7 2024-09-12T12:23:59.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.746+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc25c0a2c90 msgr2=0x7fc25c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.746+0000 7fc27e800640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc25c0a2c90 0x7fc25c0a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c00 tx=0x7fc268005b50 comp rx=0 tx=0).stop 2024-09-12T12:23:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.746+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2781027a0 msgr2=0x7fc2781989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.746+0000 7fc27e800640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2781027a0 0x7fc2781989b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc26400e9f0 tx=0x7fc26400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.746+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 shutdown_connections 2024-09-12T12:23:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.747+0000 7fc27e800640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc25c0a2c90 0x7fc25c0a5150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.747+0000 7fc27e800640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc278106f20 0x7fc27819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.747+0000 7fc27e800640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2781027a0 0x7fc2781989b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.747+0000 7fc27e800640 1 --2- 172.21.15.38:0/1289163557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc278101df0 0x7fc278198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.747+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 >> 172.21.15.38:0/1289163557 conn(0x7fc2780fd8b0 msgr2=0x7fc2780feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.747+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 shutdown_connections 2024-09-12T12:23:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:23:59.747+0000 7fc27e800640 1 -- 172.21.15.38:0/1289163557 wait complete. 2024-09-12T12:24:00.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:00 smithi038 ceph-mon[30810]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:00.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:00 smithi071 ceph-mon[34859]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:00.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:24:00.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:00 smithi154 ceph-mon[35578]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:00.916 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:01.400 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:01 smithi038 ceph-mon[30810]: pgmap v334: 129 pgs: 129 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-12T12:24:01.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:01 smithi071 ceph-mon[34859]: pgmap v334: 129 pgs: 129 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-12T12:24:01.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 -- 172.21.15.38:0/1208162287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00077040 msgr2=0x7fcb001124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 --2- 172.21.15.38:0/1208162287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00077040 0x7fcb001124f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009900 tx=0x7fcaec02a410 comp rx=0 tx=0).stop 2024-09-12T12:24:01.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 -- 172.21.15.38:0/1208162287 shutdown_connections 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 --2- 172.21.15.38:0/1208162287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb00112a30 0x7fcb00114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 --2- 172.21.15.38:0/1208162287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00077040 0x7fcb001124f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 --2- 172.21.15.38:0/1208162287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb00076720 0x7fcb00076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 -- 172.21.15.38:0/1208162287 >> 172.21.15.38:0/1208162287 conn(0x7fcb000ffa90 msgr2=0x7fcb00101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 -- 172.21.15.38:0/1208162287 shutdown_connections 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.521+0000 7fcb07e00640 1 -- 172.21.15.38:0/1208162287 wait complete. 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.522+0000 7fcb07e00640 1 Processor -- start 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.522+0000 7fcb07e00640 1 -- start start 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb07e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb00076720 0x7fcb001a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb07e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb00077040 0x7fcb001a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb07e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00112a30 0x7fcb0019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb07e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001185f0 con 0x7fcb00112a30 2024-09-12T12:24:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb07e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00118470 con 0x7fcb00077040 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb07e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00118770 con 0x7fcb00076720 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb00076720 0x7fcb001a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00112a30 0x7fcb0019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb00076720 0x7fcb001a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:36162/0 (socket says 172.21.15.38:36162) 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05400640 1 -- 172.21.15.38:0/3433592860 learned_addr learned my addr 172.21.15.38:0/3433592860 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb04a00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb00077040 0x7fcb001a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05e00640 1 -- 172.21.15.38:0/3433592860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb00076720 msgr2=0x7fcb001a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb00076720 0x7fcb001a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05e00640 1 -- 172.21.15.38:0/3433592860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb00077040 msgr2=0x7fcb001a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb00077040 0x7fcb001a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.523+0000 7fcb05e00640 1 -- 172.21.15.38:0/3433592860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0019f010 con 0x7fcb00112a30 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.524+0000 7fcb05e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00112a30 0x7fcb0019e8e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb0007aa10 tx=0x7fcaf800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.524+0000 7fcafe000640 1 -- 172.21.15.38:0/3433592860 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800cdf0 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.524+0000 7fcafe000640 1 -- 172.21.15.38:0/3433592860 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf8005020 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.524+0000 7fcafe000640 1 -- 172.21.15.38:0/3433592860 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8010670 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.524+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0019f300 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.524+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001ab5f0 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.525+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb00076b00 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.527+0000 7fcafe000640 1 -- 172.21.15.38:0/3433592860 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcaf80054d0 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.529+0000 7fcafe000640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcae80a2c90 0x7fcae80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.529+0000 7fcafe000640 1 -- 172.21.15.38:0/3433592860 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fcaf80cfb50 con 0x7fcb00112a30 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.529+0000 7fcb05400640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcae80a2c90 0x7fcae80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.530+0000 7fcb05400640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcae80a2c90 0x7fcae80a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb0019fa20 tx=0x7fcaf400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.533+0000 7fcafe000640 1 -- 172.21.15.38:0/3433592860 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcaf809c590 con 0x7fcb00112a30 2024-09-12T12:24:01.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:01 smithi154 ceph-mon[35578]: pgmap v334: 129 pgs: 129 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-12T12:24:01.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.755+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb0002d7c0 con 0x7fcb00112a30 2024-09-12T12:24:01.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.756+0000 7fcafe000640 1 -- 172.21.15.38:0/3433592860 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11968 (secure 0 0 0) 0x7fcaf809be90 con 0x7fcb00112a30 2024-09-12T12:24:01.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:01.756 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"btime":"2024-09-12T12:23:49:190760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:48.221685+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24502,24515,24508,24529,24557]},"id":1}]} 2024-09-12T12:24:01.757 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-12T12:24:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.758+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcae80a2c90 msgr2=0x7fcae80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.758+0000 7fcb07e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcae80a2c90 0x7fcae80a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb0019fa20 tx=0x7fcaf400b4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.758+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00112a30 msgr2=0x7fcb0019e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.758+0000 7fcb07e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00112a30 0x7fcb0019e8e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb0007aa10 tx=0x7fcaf800ef10 comp rx=0 tx=0).stop 2024-09-12T12:24:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 shutdown_connections 2024-09-12T12:24:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcae80a2c90 0x7fcae80a5150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb00112a30 0x7fcb0019e8e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb00077040 0x7fcb001a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 --2- 172.21.15.38:0/3433592860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb00076720 0x7fcb001a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 >> 172.21.15.38:0/3433592860 conn(0x7fcb000ffa90 msgr2=0x7fcb00101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 shutdown_connections 2024-09-12T12:24:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:01.759+0000 7fcb07e00640 1 -- 172.21.15.38:0/3433592860 wait complete. 2024-09-12T12:24:02.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:02 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3433592860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:02.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:02 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3433592860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:02.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:02.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:02 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3433592860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:02.937 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:03.412 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:03 smithi038 ceph-mon[30810]: pgmap v335: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2024-09-12T12:24:03.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:03 smithi071 ceph-mon[34859]: pgmap v335: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 -- 172.21.15.38:0/3403955540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4074590 msgr2=0x7f11c4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 --2- 172.21.15.38:0/3403955540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4074590 0x7f11c4074970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009900 tx=0x7f11b402a480 comp rx=0 tx=0).stop 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 -- 172.21.15.38:0/3403955540 shutdown_connections 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 --2- 172.21.15.38:0/3403955540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c4112b90 0x7f11c4114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 --2- 172.21.15.38:0/3403955540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11c4074eb0 0x7f11c4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 --2- 172.21.15.38:0/3403955540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4074590 0x7f11c4074970 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 -- 172.21.15.38:0/3403955540 >> 172.21.15.38:0/3403955540 conn(0x7f11c40fd8c0 msgr2=0x7f11c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 -- 172.21.15.38:0/3403955540 shutdown_connections 2024-09-12T12:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.526+0000 7f11ca200640 1 -- 172.21.15.38:0/3403955540 wait complete. 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 Processor -- start 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 -- start start 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11c4074590 0x7f11c41a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c4074eb0 0x7f11c41a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4112b90 0x7f11c419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f11c4118570 con 0x7f11c4112b90 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f11c41183f0 con 0x7f11c4074590 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.527+0000 7f11ca200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11c41186f0 con 0x7f11c4074eb0 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4112b90 0x7f11c419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4112b90 0x7f11c419e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55906/0 (socket says 172.21.15.38:55906) 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 -- 172.21.15.38:0/3062179583 learned_addr learned my addr 172.21.15.38:0/3062179583 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3400640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11c4074590 0x7f11c41a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11bbe00640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c4074eb0 0x7f11c41a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 -- 172.21.15.38:0/3062179583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c4074eb0 msgr2=0x7f11c41a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c4074eb0 0x7f11c41a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 -- 172.21.15.38:0/3062179583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11c4074590 msgr2=0x7f11c41a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11c4074590 0x7f11c41a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11c3e00640 1 -- 172.21.15.38:0/3062179583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c419f0a0 con 0x7f11c4112b90 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.528+0000 7f11bbe00640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c4074eb0 0x7f11c41a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.529+0000 7f11c3e00640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4112b90 0x7f11c419e970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00eb40 tx=0x7f11bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.529+0000 7f11c0c00640 1 -- 172.21.15.38:0/3062179583 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc004b20 con 0x7f11c4112b90 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.529+0000 7f11c0c00640 1 -- 172.21.15.38:0/3062179583 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11bc004cc0 con 0x7f11c4112b90 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.529+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c419f390 con 0x7f11c4112b90 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.529+0000 7f11c0c00640 1 -- 172.21.15.38:0/3062179583 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc010850 con 0x7f11c4112b90 2024-09-12T12:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.529+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c41ab680 con 0x7f11c4112b90 2024-09-12T12:24:03.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.530+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c4074970 con 0x7f11c4112b90 2024-09-12T12:24:03.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.533+0000 7f11c0c00640 1 -- 172.21.15.38:0/3062179583 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f11bc005020 con 0x7f11c4112b90 2024-09-12T12:24:03.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.533+0000 7f11c0c00640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11a80a2c10 0x7f11a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.534+0000 7f11c0c00640 1 -- 172.21.15.38:0/3062179583 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f11bc0cfc50 con 0x7f11c4112b90 2024-09-12T12:24:03.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.534+0000 7f11c3400640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11a80a2c10 0x7f11a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.535+0000 7f11c3400640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11a80a2c10 0x7f11a80a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f11c419fab0 tx=0x7f11b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.538+0000 7f11c0c00640 1 -- 172.21.15.38:0/3062179583 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11bc09c690 con 0x7f11c4112b90 2024-09-12T12:24:03.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:03 smithi154 ceph-mon[35578]: pgmap v335: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2024-09-12T12:24:03.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.728+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11c419fea0 con 0x7f11c4112b90 2024-09-12T12:24:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.730+0000 7f11c0c00640 1 -- 172.21.15.38:0/3062179583 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24668 (secure 0 0 0) 0x7f11bc09bf90 con 0x7f11c4112b90 2024-09-12T12:24:03.731 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:03.731 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":91,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:35.061031+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:03.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11a80a2c10 msgr2=0x7f11a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11a80a2c10 0x7f11a80a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f11c419fab0 tx=0x7f11b40058d0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4112b90 msgr2=0x7f11c419e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4112b90 0x7f11c419e970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00eb40 tx=0x7f11bc00c2d0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 shutdown_connections 2024-09-12T12:24:03.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11a80a2c10 0x7f11a80a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c4112b90 0x7f11c419e970 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c4074eb0 0x7f11c41a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 --2- 172.21.15.38:0/3062179583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11c4074590 0x7f11c41a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 >> 172.21.15.38:0/3062179583 conn(0x7f11c40fd8c0 msgr2=0x7f11c40ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 shutdown_connections 2024-09-12T12:24:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:03.733+0000 7f11ca200640 1 -- 172.21.15.38:0/3062179583 wait complete. 2024-09-12T12:24:04.440 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:04 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3062179583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:04.479 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T12:24:04.479 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:24:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:04 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3062179583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:04.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:04 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3062179583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:04.855 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 -- 172.21.15.38:0/2232299189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444106f10 msgr2=0x7fd44410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 --2- 172.21.15.38:0/2232299189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444106f10 0x7fd44410ea90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009ca0 tx=0x7fd43c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 -- 172.21.15.38:0/2232299189 shutdown_connections 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 --2- 172.21.15.38:0/2232299189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444106f10 0x7fd44410ea90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 --2- 172.21.15.38:0/2232299189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd444102790 0x7fd4441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 --2- 172.21.15.38:0/2232299189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd444101de0 0x7fd4441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 -- 172.21.15.38:0/2232299189 >> 172.21.15.38:0/2232299189 conn(0x7fd4440fd8c0 msgr2=0x7fd4440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 -- 172.21.15.38:0/2232299189 shutdown_connections 2024-09-12T12:24:05.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.484+0000 7fd44ac00640 1 -- 172.21.15.38:0/2232299189 wait complete. 2024-09-12T12:24:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.485+0000 7fd44ac00640 1 Processor -- start 2024-09-12T12:24:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.485+0000 7fd44ac00640 1 -- start start 2024-09-12T12:24:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd44ac00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444101de0 0x7fd44419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd44ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd444102790 0x7fd44419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd44ac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd444106f10 0x7fd44419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd44ac00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd444111f70 con 0x7fd444101de0 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd44ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd444111df0 con 0x7fd444102790 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd44ac00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441120f0 con 0x7fd444106f10 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd443e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444101de0 0x7fd44419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd443e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444101de0 0x7fd44419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55932/0 (socket says 172.21.15.38:55932) 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd443e00640 1 -- 172.21.15.38:0/3545107069 learned_addr learned my addr 172.21.15.38:0/3545107069 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd448c00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd444106f10 0x7fd44419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.486+0000 7fd443400640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd444102790 0x7fd44419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd443e00640 1 -- 172.21.15.38:0/3545107069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd444106f10 msgr2=0x7fd44419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd443e00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd444106f10 0x7fd44419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd443e00640 1 -- 172.21.15.38:0/3545107069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd444102790 msgr2=0x7fd44419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd443e00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd444102790 0x7fd44419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd443e00640 1 -- 172.21.15.38:0/3545107069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44419f580 con 0x7fd444101de0 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd448c00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd444106f10 0x7fd44419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd443e00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444101de0 0x7fd44419a5d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e9f0 tx=0x7fd43400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd440c00640 1 -- 172.21.15.38:0/3545107069 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400cd80 con 0x7fd444101de0 2024-09-12T12:24:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44419f870 con 0x7fd444101de0 2024-09-12T12:24:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd440c00640 1 -- 172.21.15.38:0/3545107069 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd434010910 con 0x7fd444101de0 2024-09-12T12:24:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd440c00640 1 -- 172.21.15.38:0/3545107069 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434018990 con 0x7fd444101de0 2024-09-12T12:24:05.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.487+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4441a7150 con 0x7fd444101de0 2024-09-12T12:24:05.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.488+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4441021c0 con 0x7fd444101de0 2024-09-12T12:24:05.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.490+0000 7fd440c00640 1 -- 172.21.15.38:0/3545107069 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd434010ac0 con 0x7fd444101de0 2024-09-12T12:24:05.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.492+0000 7fd440c00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4280a2c10 0x7fd4280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.493+0000 7fd440c00640 1 -- 172.21.15.38:0/3545107069 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd4340cf950 con 0x7fd444101de0 2024-09-12T12:24:05.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.493+0000 7fd443400640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4280a2c10 0x7fd4280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.493+0000 7fd443400640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4280a2c10 0x7fd4280a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd4440ff6f0 tx=0x7fd430005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.496+0000 7fd440c00640 1 -- 172.21.15.38:0/3545107069 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd43409c390 con 0x7fd444101de0 2024-09-12T12:24:05.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:05 smithi154 ceph-mon[35578]: pgmap v336: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-12T12:24:05.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.681+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd44410de00 con 0x7fd4280a2c10 2024-09-12T12:24:05.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:05 smithi038 ceph-mon[30810]: pgmap v336: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-12T12:24:05.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.692+0000 7fd440c00640 1 -- 172.21.15.38:0/3545107069 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340406 (secure 0 0 0) 0x7fd44410de00 con 0x7fd4280a2c10 2024-09-12T12:24:05.696 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:05.698 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-12T12:24:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4280a2c10 msgr2=0x7fd4280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4280a2c10 0x7fd4280a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd4440ff6f0 tx=0x7fd430005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444101de0 msgr2=0x7fd44419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444101de0 0x7fd44419a5d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e9f0 tx=0x7fd43400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 shutdown_connections 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd4280a2c10 0x7fd4280a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd444106f10 0x7fd44419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd444102790 0x7fd44419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 --2- 172.21.15.38:0/3545107069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd444101de0 0x7fd44419a5d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 >> 172.21.15.38:0/3545107069 conn(0x7fd4440fd8c0 msgr2=0x7fd4440feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 shutdown_connections 2024-09-12T12:24:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:05.696+0000 7fd44ac00640 1 -- 172.21.15.38:0/3545107069 wait complete. 2024-09-12T12:24:05.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:05 smithi071 ceph-mon[34859]: pgmap v336: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-12T12:24:06.472 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-12T12:24:04.089500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646515,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":304,"num_read_kb":260,"num_write":417,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388544,"kb_used_data":14336,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553280,"statfs":{"total":1151940427776,"available":1151542558720,"internally_reserved":0,"allocated":14680064,"data_stored":8073167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38886,"num_objects":3,"num_object_clones":0,"num_object_copies":11,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":112,"num_write":21,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003605"},"pg_stats":[{"pgid":"2.1f","version":"91'13","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.211931+0000","last_change":"2024-09-12T12:22:51.847865+0000","last_active":"2024-09-12T12:24:00.211931+0000","last_peered":"2024-09-12T12:24:00.211931+0000","last_clean":"2024-09-12T12:24:00.211931+0000","last_became_active":"2024-09-12T12:22:51.847437+0000","last_became_peered":"2024-09-12T12:22:51.847437+0000","last_unstale":"2024-09-12T12:24:00.211931+0000","last_undegraded":"2024-09-12T12:24:00.211931+0000","last_fullsized":"2024-09-12T12:24:00.211931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:34.486264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117866+0000","last_change":"2024-09-12T12:22:54.316759+0000","last_active":"2024-09-12T12:23:35.117866+0000","last_peered":"2024-09-12T12:23:35.117866+0000","last_clean":"2024-09-12T12:23:35.117866+0000","last_became_active":"2024-09-12T12:22:54.315906+0000","last_became_peered":"2024-09-12T12:22:54.315906+0000","last_unstale":"2024-09-12T12:23:35.117866+0000","last_undegraded":"2024-09-12T12:23:35.117866+0000","last_fullsized":"2024-09-12T12:23:35.117866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:54.465835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073063+0000","last_change":"2024-09-12T12:23:03.387327+0000","last_active":"2024-09-12T12:23:35.073063+0000","last_peered":"2024-09-12T12:23:35.073063+0000","last_clean":"2024-09-12T12:23:35.073063+0000","last_became_active":"2024-09-12T12:23:03.386929+0000","last_became_peered":"2024-09-12T12:23:03.386929+0000","last_unstale":"2024-09-12T12:23:35.073063+0000","last_undegraded":"2024-09-12T12:23:35.073063+0000","last_fullsized":"2024-09-12T12:23:35.073063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.033999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118152+0000","last_change":"2024-09-12T12:22:51.990331+0000","last_active":"2024-09-12T12:23:35.118152+0000","last_peered":"2024-09-12T12:23:35.118152+0000","last_clean":"2024-09-12T12:23:35.118152+0000","last_became_active":"2024-09-12T12:22:51.989844+0000","last_became_peered":"2024-09-12T12:22:51.989844+0000","last_unstale":"2024-09-12T12:23:35.118152+0000","last_undegraded":"2024-09-12T12:23:35.118152+0000","last_fullsized":"2024-09-12T12:23:35.118152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:47.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.082232+0000","last_change":"2024-09-12T12:22:54.317141+0000","last_active":"2024-09-12T12:23:35.082232+0000","last_peered":"2024-09-12T12:23:35.082232+0000","last_clean":"2024-09-12T12:23:35.082232+0000","last_became_active":"2024-09-12T12:22:54.312292+0000","last_became_peered":"2024-09-12T12:22:54.312292+0000","last_unstale":"2024-09-12T12:23:35.082232+0000","last_undegraded":"2024-09-12T12:23:35.082232+0000","last_fullsized":"2024-09-12T12:23:35.082232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.943100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075643+0000","last_change":"2024-09-12T12:23:03.379532+0000","last_active":"2024-09-12T12:23:35.075643+0000","last_peered":"2024-09-12T12:23:35.075643+0000","last_clean":"2024-09-12T12:23:35.075643+0000","last_became_active":"2024-09-12T12:23:03.379087+0000","last_became_peered":"2024-09-12T12:23:03.379087+0000","last_unstale":"2024-09-12T12:23:35.075643+0000","last_undegraded":"2024-09-12T12:23:35.075643+0000","last_fullsized":"2024-09-12T12:23:35.075643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.971474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:48.192556+0000","last_change":"2024-09-12T12:22:51.848327+0000","last_active":"2024-09-12T12:23:48.192556+0000","last_peered":"2024-09-12T12:23:48.192556+0000","last_clean":"2024-09-12T12:23:48.192556+0000","last_became_active":"2024-09-12T12:22:51.848010+0000","last_became_peered":"2024-09-12T12:22:51.848010+0000","last_unstale":"2024-09-12T12:23:48.192556+0000","last_undegraded":"2024-09-12T12:23:48.192556+0000","last_fullsized":"2024-09-12T12:23:48.192556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:23.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079509+0000","last_change":"2024-09-12T12:22:54.315178+0000","last_active":"2024-09-12T12:23:35.079509+0000","last_peered":"2024-09-12T12:23:35.079509+0000","last_clean":"2024-09-12T12:23:35.079509+0000","last_became_active":"2024-09-12T12:22:54.314408+0000","last_became_peered":"2024-09-12T12:22:54.314408+0000","last_unstale":"2024-09-12T12:23:35.079509+0000","last_undegraded":"2024-09-12T12:23:35.079509+0000","last_fullsized":"2024-09-12T12:23:35.079509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076476+0000","last_change":"2024-09-12T12:23:03.384629+0000","last_active":"2024-09-12T12:23:35.076476+0000","last_peered":"2024-09-12T12:23:35.076476+0000","last_clean":"2024-09-12T12:23:35.076476+0000","last_became_active":"2024-09-12T12:23:03.383750+0000","last_became_peered":"2024-09-12T12:23:03.383750+0000","last_unstale":"2024-09-12T12:23:35.076476+0000","last_undegraded":"2024-09-12T12:23:35.076476+0000","last_fullsized":"2024-09-12T12:23:35.076476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:24.377269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.187391+0000","last_change":"2024-09-12T12:22:51.847561+0000","last_active":"2024-09-12T12:23:47.187391+0000","last_peered":"2024-09-12T12:23:47.187391+0000","last_clean":"2024-09-12T12:23:47.187391+0000","last_became_active":"2024-09-12T12:22:51.846862+0000","last_became_peered":"2024-09-12T12:22:51.846862+0000","last_unstale":"2024-09-12T12:23:47.187391+0000","last_undegraded":"2024-09-12T12:23:47.187391+0000","last_fullsized":"2024-09-12T12:23:47.187391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:37.907652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076111+0000","last_change":"2024-09-12T12:22:54.313493+0000","last_active":"2024-09-12T12:23:35.076111+0000","last_peered":"2024-09-12T12:23:35.076111+0000","last_clean":"2024-09-12T12:23:35.076111+0000","last_became_active":"2024-09-12T12:22:54.313115+0000","last_became_peered":"2024-09-12T12:22:54.313115+0000","last_unstale":"2024-09-12T12:23:35.076111+0000","last_undegraded":"2024-09-12T12:23:35.076111+0000","last_fullsized":"2024-09-12T12:23:35.076111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:39.631537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075481+0000","last_change":"2024-09-12T12:23:03.383997+0000","last_active":"2024-09-12T12:23:35.075481+0000","last_peered":"2024-09-12T12:23:35.075481+0000","last_clean":"2024-09-12T12:23:35.075481+0000","last_became_active":"2024-09-12T12:23:03.382952+0000","last_became_peered":"2024-09-12T12:23:03.382952+0000","last_unstale":"2024-09-12T12:23:35.075481+0000","last_undegraded":"2024-09-12T12:23:35.075481+0000","last_fullsized":"2024-09-12T12:23:35.075481+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:37.949848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078172+0000","last_change":"2024-09-12T12:22:54.311875+0000","last_active":"2024-09-12T12:23:35.078172+0000","last_peered":"2024-09-12T12:23:35.078172+0000","last_clean":"2024-09-12T12:23:35.078172+0000","last_became_active":"2024-09-12T12:22:54.311301+0000","last_became_peered":"2024-09-12T12:22:54.311301+0000","last_unstale":"2024-09-12T12:23:35.078172+0000","last_undegraded":"2024-09-12T12:23:35.078172+0000","last_fullsized":"2024-09-12T12:23:35.078172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:47.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:44.140568+0000","last_change":"2024-09-12T12:22:51.849400+0000","last_active":"2024-09-12T12:23:44.140568+0000","last_peered":"2024-09-12T12:23:44.140568+0000","last_clean":"2024-09-12T12:23:44.140568+0000","last_became_active":"2024-09-12T12:22:51.848295+0000","last_became_peered":"2024-09-12T12:22:51.848295+0000","last_unstale":"2024-09-12T12:23:44.140568+0000","last_undegraded":"2024-09-12T12:23:44.140568+0000","last_fullsized":"2024-09-12T12:23:44.140568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077143+0000","last_change":"2024-09-12T12:23:03.779217+0000","last_active":"2024-09-12T12:23:35.077143+0000","last_peered":"2024-09-12T12:23:35.077143+0000","last_clean":"2024-09-12T12:23:35.077143+0000","last_became_active":"2024-09-12T12:23:03.778732+0000","last_became_peered":"2024-09-12T12:23:03.778732+0000","last_unstale":"2024-09-12T12:23:35.077143+0000","last_undegraded":"2024-09-12T12:23:35.077143+0000","last_fullsized":"2024-09-12T12:23:35.077143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:49.676157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117546+0000","last_change":"2024-09-12T12:22:54.323222+0000","last_active":"2024-09-12T12:23:35.117546+0000","last_peered":"2024-09-12T12:23:35.117546+0000","last_clean":"2024-09-12T12:23:35.117546+0000","last_became_active":"2024-09-12T12:22:54.321035+0000","last_became_peered":"2024-09-12T12:22:54.321035+0000","last_unstale":"2024-09-12T12:23:35.117546+0000","last_undegraded":"2024-09-12T12:23:35.117546+0000","last_fullsized":"2024-09-12T12:23:35.117546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:04.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:46.174467+0000","last_change":"2024-09-12T12:22:51.850014+0000","last_active":"2024-09-12T12:23:46.174467+0000","last_peered":"2024-09-12T12:23:46.174467+0000","last_clean":"2024-09-12T12:23:46.174467+0000","last_became_active":"2024-09-12T12:22:51.849640+0000","last_became_peered":"2024-09-12T12:22:51.849640+0000","last_unstale":"2024-09-12T12:23:46.174467+0000","last_undegraded":"2024-09-12T12:23:46.174467+0000","last_fullsized":"2024-09-12T12:23:46.174467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:32.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081092+0000","last_change":"2024-09-12T12:23:35.079820+0000","last_active":"2024-09-12T12:23:35.081092+0000","last_peered":"2024-09-12T12:23:35.081092+0000","last_clean":"2024-09-12T12:23:35.081092+0000","last_became_active":"2024-09-12T12:23:35.079362+0000","last_became_peered":"2024-09-12T12:23:35.079362+0000","last_unstale":"2024-09-12T12:23:35.081092+0000","last_undegraded":"2024-09-12T12:23:35.081092+0000","last_fullsized":"2024-09-12T12:23:35.081092+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:22.713646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117499+0000","last_change":"2024-09-12T12:22:54.307950+0000","last_active":"2024-09-12T12:23:35.117499+0000","last_peered":"2024-09-12T12:23:35.117499+0000","last_clean":"2024-09-12T12:23:35.117499+0000","last_became_active":"2024-09-12T12:22:54.307595+0000","last_became_peered":"2024-09-12T12:22:54.307595+0000","last_unstale":"2024-09-12T12:23:35.117499+0000","last_undegraded":"2024-09-12T12:23:35.117499+0000","last_fullsized":"2024-09-12T12:23:35.117499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:11.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.187308+0000","last_change":"2024-09-12T12:22:51.851424+0000","last_active":"2024-09-12T12:23:47.187308+0000","last_peered":"2024-09-12T12:23:47.187308+0000","last_clean":"2024-09-12T12:23:47.187308+0000","last_became_active":"2024-09-12T12:22:51.851043+0000","last_became_peered":"2024-09-12T12:22:51.851043+0000","last_unstale":"2024-09-12T12:23:47.187308+0000","last_undegraded":"2024-09-12T12:23:47.187308+0000","last_fullsized":"2024-09-12T12:23:47.187308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071580+0000","last_change":"2024-09-12T12:23:03.381773+0000","last_active":"2024-09-12T12:23:35.071580+0000","last_peered":"2024-09-12T12:23:35.071580+0000","last_clean":"2024-09-12T12:23:35.071580+0000","last_became_active":"2024-09-12T12:23:03.378442+0000","last_became_peered":"2024-09-12T12:23:03.378442+0000","last_unstale":"2024-09-12T12:23:35.071580+0000","last_undegraded":"2024-09-12T12:23:35.071580+0000","last_fullsized":"2024-09-12T12:23:35.071580+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.570787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072377+0000","last_change":"2024-09-12T12:22:54.310010+0000","last_active":"2024-09-12T12:23:35.072377+0000","last_peered":"2024-09-12T12:23:35.072377+0000","last_clean":"2024-09-12T12:23:35.072377+0000","last_became_active":"2024-09-12T12:22:54.309499+0000","last_became_peered":"2024-09-12T12:22:54.309499+0000","last_unstale":"2024-09-12T12:23:35.072377+0000","last_undegraded":"2024-09-12T12:23:35.072377+0000","last_fullsized":"2024-09-12T12:23:35.072377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.456842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:44.139168+0000","last_change":"2024-09-12T12:22:51.990294+0000","last_active":"2024-09-12T12:23:44.139168+0000","last_peered":"2024-09-12T12:23:44.139168+0000","last_clean":"2024-09-12T12:23:44.139168+0000","last_became_active":"2024-09-12T12:22:51.989925+0000","last_became_peered":"2024-09-12T12:22:51.989925+0000","last_unstale":"2024-09-12T12:23:44.139168+0000","last_undegraded":"2024-09-12T12:23:44.139168+0000","last_fullsized":"2024-09-12T12:23:44.139168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:56.754802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077723+0000","last_change":"2024-09-12T12:23:03.780256+0000","last_active":"2024-09-12T12:23:35.077723+0000","last_peered":"2024-09-12T12:23:35.077723+0000","last_clean":"2024-09-12T12:23:35.077723+0000","last_became_active":"2024-09-12T12:23:03.779808+0000","last_became_peered":"2024-09-12T12:23:03.779808+0000","last_unstale":"2024-09-12T12:23:35.077723+0000","last_undegraded":"2024-09-12T12:23:35.077723+0000","last_fullsized":"2024-09-12T12:23:35.077723+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:58.236749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.084287+0000","last_change":"2024-09-12T12:23:35.084287+0000","last_active":"2024-09-12T12:23:35.084287+0000","last_peered":"2024-09-12T12:23:35.084287+0000","last_clean":"2024-09-12T12:23:35.084287+0000","last_became_active":"2024-09-12T12:23:35.083828+0000","last_became_peered":"2024-09-12T12:23:35.083828+0000","last_unstale":"2024-09-12T12:23:35.084287+0000","last_undegraded":"2024-09-12T12:23:35.084287+0000","last_fullsized":"2024-09-12T12:23:35.084287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:36.183575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186235+0000","last_change":"2024-09-12T12:22:52.557264+0000","last_active":"2024-09-12T12:23:47.186235+0000","last_peered":"2024-09-12T12:23:47.186235+0000","last_clean":"2024-09-12T12:23:47.186235+0000","last_became_active":"2024-09-12T12:22:52.556783+0000","last_became_peered":"2024-09-12T12:22:52.556783+0000","last_unstale":"2024-09-12T12:23:47.186235+0000","last_undegraded":"2024-09-12T12:23:47.186235+0000","last_fullsized":"2024-09-12T12:23:47.186235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:08.815983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073179+0000","last_change":"2024-09-12T12:23:03.376129+0000","last_active":"2024-09-12T12:23:35.073179+0000","last_peered":"2024-09-12T12:23:35.073179+0000","last_clean":"2024-09-12T12:23:35.073179+0000","last_became_active":"2024-09-12T12:23:03.375200+0000","last_became_peered":"2024-09-12T12:23:03.375200+0000","last_unstale":"2024-09-12T12:23:35.073179+0000","last_undegraded":"2024-09-12T12:23:35.073179+0000","last_fullsized":"2024-09-12T12:23:35.073179+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.418366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118142+0000","last_change":"2024-09-12T12:22:54.314708+0000","last_active":"2024-09-12T12:23:35.118142+0000","last_peered":"2024-09-12T12:23:35.118142+0000","last_clean":"2024-09-12T12:23:35.118142+0000","last_became_active":"2024-09-12T12:22:54.314304+0000","last_became_peered":"2024-09-12T12:22:54.314304+0000","last_unstale":"2024-09-12T12:23:35.118142+0000","last_undegraded":"2024-09-12T12:23:35.118142+0000","last_fullsized":"2024-09-12T12:23:35.118142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:52.198831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:59.318633+0000","last_change":"2024-09-12T12:22:51.846753+0000","last_active":"2024-09-12T12:23:59.318633+0000","last_peered":"2024-09-12T12:23:59.318633+0000","last_clean":"2024-09-12T12:23:59.318633+0000","last_became_active":"2024-09-12T12:22:51.846388+0000","last_became_peered":"2024-09-12T12:22:51.846388+0000","last_unstale":"2024-09-12T12:23:59.318633+0000","last_undegraded":"2024-09-12T12:23:59.318633+0000","last_fullsized":"2024-09-12T12:23:59.318633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:34.511644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117057+0000","last_change":"2024-09-12T12:23:03.779254+0000","last_active":"2024-09-12T12:23:35.117057+0000","last_peered":"2024-09-12T12:23:35.117057+0000","last_clean":"2024-09-12T12:23:35.117057+0000","last_became_active":"2024-09-12T12:23:03.778801+0000","last_became_peered":"2024-09-12T12:23:03.778801+0000","last_unstale":"2024-09-12T12:23:35.117057+0000","last_undegraded":"2024-09-12T12:23:35.117057+0000","last_fullsized":"2024-09-12T12:23:35.117057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079397+0000","last_change":"2024-09-12T12:22:54.312002+0000","last_active":"2024-09-12T12:23:35.079397+0000","last_peered":"2024-09-12T12:23:35.079397+0000","last_clean":"2024-09-12T12:23:35.079397+0000","last_became_active":"2024-09-12T12:22:54.311670+0000","last_became_peered":"2024-09-12T12:22:54.311670+0000","last_unstale":"2024-09-12T12:23:35.079397+0000","last_undegraded":"2024-09-12T12:23:35.079397+0000","last_fullsized":"2024-09-12T12:23:35.079397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:08.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.187657+0000","last_change":"2024-09-12T12:22:51.991983+0000","last_active":"2024-09-12T12:23:47.187657+0000","last_peered":"2024-09-12T12:23:47.187657+0000","last_clean":"2024-09-12T12:23:47.187657+0000","last_became_active":"2024-09-12T12:22:51.991712+0000","last_became_peered":"2024-09-12T12:22:51.991712+0000","last_unstale":"2024-09-12T12:23:47.187657+0000","last_undegraded":"2024-09-12T12:23:47.187657+0000","last_fullsized":"2024-09-12T12:23:47.187657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:07.442638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117451+0000","last_change":"2024-09-12T12:23:03.379901+0000","last_active":"2024-09-12T12:23:35.117451+0000","last_peered":"2024-09-12T12:23:35.117451+0000","last_clean":"2024-09-12T12:23:35.117451+0000","last_became_active":"2024-09-12T12:23:03.379385+0000","last_became_peered":"2024-09-12T12:23:03.379385+0000","last_unstale":"2024-09-12T12:23:35.117451+0000","last_undegraded":"2024-09-12T12:23:35.117451+0000","last_fullsized":"2024-09-12T12:23:35.117451+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:47.939223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074870+0000","last_change":"2024-09-12T12:22:54.316450+0000","last_active":"2024-09-12T12:23:35.074870+0000","last_peered":"2024-09-12T12:23:35.074870+0000","last_clean":"2024-09-12T12:23:35.074870+0000","last_became_active":"2024-09-12T12:22:54.316058+0000","last_became_peered":"2024-09-12T12:22:54.316058+0000","last_unstale":"2024-09-12T12:23:35.074870+0000","last_undegraded":"2024-09-12T12:23:35.074870+0000","last_fullsized":"2024-09-12T12:23:35.074870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:38.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071341+0000","last_change":"2024-09-12T12:22:51.992564+0000","last_active":"2024-09-12T12:23:35.071341+0000","last_peered":"2024-09-12T12:23:35.071341+0000","last_clean":"2024-09-12T12:23:35.071341+0000","last_became_active":"2024-09-12T12:22:51.992012+0000","last_became_peered":"2024-09-12T12:22:51.992012+0000","last_unstale":"2024-09-12T12:23:35.071341+0000","last_undegraded":"2024-09-12T12:23:35.071341+0000","last_fullsized":"2024-09-12T12:23:35.071341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:26.190486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072486+0000","last_change":"2024-09-12T12:23:03.779309+0000","last_active":"2024-09-12T12:23:35.072486+0000","last_peered":"2024-09-12T12:23:35.072486+0000","last_clean":"2024-09-12T12:23:35.072486+0000","last_became_active":"2024-09-12T12:23:03.778812+0000","last_became_peered":"2024-09-12T12:23:03.778812+0000","last_unstale":"2024-09-12T12:23:35.072486+0000","last_undegraded":"2024-09-12T12:23:35.072486+0000","last_fullsized":"2024-09-12T12:23:35.072486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:56.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075512+0000","last_change":"2024-09-12T12:22:54.309745+0000","last_active":"2024-09-12T12:23:35.075512+0000","last_peered":"2024-09-12T12:23:35.075512+0000","last_clean":"2024-09-12T12:23:35.075512+0000","last_became_active":"2024-09-12T12:22:54.309388+0000","last_became_peered":"2024-09-12T12:22:54.309388+0000","last_unstale":"2024-09-12T12:23:35.075512+0000","last_undegraded":"2024-09-12T12:23:35.075512+0000","last_fullsized":"2024-09-12T12:23:35.075512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.268141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.212428+0000","last_change":"2024-09-12T12:22:51.850494+0000","last_active":"2024-09-12T12:24:00.212428+0000","last_peered":"2024-09-12T12:24:00.212428+0000","last_clean":"2024-09-12T12:24:00.212428+0000","last_became_active":"2024-09-12T12:22:51.849071+0000","last_became_peered":"2024-09-12T12:22:51.849071+0000","last_unstale":"2024-09-12T12:24:00.212428+0000","last_undegraded":"2024-09-12T12:24:00.212428+0000","last_fullsized":"2024-09-12T12:24:00.212428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:19.203267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079229+0000","last_change":"2024-09-12T12:23:03.383096+0000","last_active":"2024-09-12T12:23:35.079229+0000","last_peered":"2024-09-12T12:23:35.079229+0000","last_clean":"2024-09-12T12:23:35.079229+0000","last_became_active":"2024-09-12T12:23:03.382261+0000","last_became_peered":"2024-09-12T12:23:03.382261+0000","last_unstale":"2024-09-12T12:23:35.079229+0000","last_undegraded":"2024-09-12T12:23:35.079229+0000","last_fullsized":"2024-09-12T12:23:35.079229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:08.976679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081034+0000","last_change":"2024-09-12T12:23:35.079333+0000","last_active":"2024-09-12T12:23:35.081034+0000","last_peered":"2024-09-12T12:23:35.081034+0000","last_clean":"2024-09-12T12:23:35.081034+0000","last_became_active":"2024-09-12T12:23:35.078908+0000","last_became_peered":"2024-09-12T12:23:35.078908+0000","last_unstale":"2024-09-12T12:23:35.081034+0000","last_undegraded":"2024-09-12T12:23:35.081034+0000","last_fullsized":"2024-09-12T12:23:35.081034+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:55:59.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.210822+0000","last_change":"2024-09-12T12:22:51.990322+0000","last_active":"2024-09-12T12:24:00.210822+0000","last_peered":"2024-09-12T12:24:00.210822+0000","last_clean":"2024-09-12T12:24:00.210822+0000","last_became_active":"2024-09-12T12:22:51.989970+0000","last_became_peered":"2024-09-12T12:22:51.989970+0000","last_unstale":"2024-09-12T12:24:00.210822+0000","last_undegraded":"2024-09-12T12:24:00.210822+0000","last_fullsized":"2024-09-12T12:24:00.210822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:14.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.083806+0000","last_change":"2024-09-12T12:23:35.083806+0000","last_active":"2024-09-12T12:23:35.083806+0000","last_peered":"2024-09-12T12:23:35.083806+0000","last_clean":"2024-09-12T12:23:35.083806+0000","last_became_active":"2024-09-12T12:23:35.083379+0000","last_became_peered":"2024-09-12T12:23:35.083379+0000","last_unstale":"2024-09-12T12:23:35.083806+0000","last_undegraded":"2024-09-12T12:23:35.083806+0000","last_fullsized":"2024-09-12T12:23:35.083806+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:54.146429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078441+0000","last_change":"2024-09-12T12:22:54.305747+0000","last_active":"2024-09-12T12:23:35.078441+0000","last_peered":"2024-09-12T12:23:35.078441+0000","last_clean":"2024-09-12T12:23:35.078441+0000","last_became_active":"2024-09-12T12:22:54.305423+0000","last_became_peered":"2024-09-12T12:22:54.305423+0000","last_unstale":"2024-09-12T12:23:35.078441+0000","last_undegraded":"2024-09-12T12:23:35.078441+0000","last_fullsized":"2024-09-12T12:23:35.078441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.463661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:45.148441+0000","last_change":"2024-09-12T12:22:51.852216+0000","last_active":"2024-09-12T12:23:45.148441+0000","last_peered":"2024-09-12T12:23:45.148441+0000","last_clean":"2024-09-12T12:23:45.148441+0000","last_became_active":"2024-09-12T12:22:51.850495+0000","last_became_peered":"2024-09-12T12:22:51.850495+0000","last_unstale":"2024-09-12T12:23:45.148441+0000","last_undegraded":"2024-09-12T12:23:45.148441+0000","last_fullsized":"2024-09-12T12:23:45.148441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:51.711697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118914+0000","last_change":"2024-09-12T12:23:35.118914+0000","last_active":"2024-09-12T12:23:35.118914+0000","last_peered":"2024-09-12T12:23:35.118914+0000","last_clean":"2024-09-12T12:23:35.118914+0000","last_became_active":"2024-09-12T12:23:35.118411+0000","last_became_peered":"2024-09-12T12:23:35.118411+0000","last_unstale":"2024-09-12T12:23:35.118914+0000","last_undegraded":"2024-09-12T12:23:35.118914+0000","last_fullsized":"2024-09-12T12:23:35.118914+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:08.350538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117531+0000","last_change":"2024-09-12T12:22:54.320573+0000","last_active":"2024-09-12T12:23:35.117531+0000","last_peered":"2024-09-12T12:23:35.117531+0000","last_clean":"2024-09-12T12:23:35.117531+0000","last_became_active":"2024-09-12T12:22:54.320120+0000","last_became_peered":"2024-09-12T12:22:54.320120+0000","last_unstale":"2024-09-12T12:23:35.117531+0000","last_undegraded":"2024-09-12T12:23:35.117531+0000","last_fullsized":"2024-09-12T12:23:35.117531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:35.490584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:48.192125+0000","last_change":"2024-09-12T12:22:51.851098+0000","last_active":"2024-09-12T12:23:48.192125+0000","last_peered":"2024-09-12T12:23:48.192125+0000","last_clean":"2024-09-12T12:23:48.192125+0000","last_became_active":"2024-09-12T12:22:51.850725+0000","last_became_peered":"2024-09-12T12:22:51.850725+0000","last_unstale":"2024-09-12T12:23:48.192125+0000","last_undegraded":"2024-09-12T12:23:48.192125+0000","last_fullsized":"2024-09-12T12:23:48.192125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:18.308742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077342+0000","last_change":"2024-09-12T12:21:34.312000+0000","last_active":"2024-09-12T12:23:35.077342+0000","last_peered":"2024-09-12T12:23:35.077342+0000","last_clean":"2024-09-12T12:23:35.077342+0000","last_became_active":"2024-09-12T12:21:34.311472+0000","last_became_peered":"2024-09-12T12:21:34.311472+0000","last_unstale":"2024-09-12T12:23:35.077342+0000","last_undegraded":"2024-09-12T12:23:35.077342+0000","last_fullsized":"2024-09-12T12:23:35.077342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_clean_scrub_stamp":"2024-09-12T12:17:58.852566+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077576+0000","last_change":"2024-09-12T12:23:03.387802+0000","last_active":"2024-09-12T12:23:35.077576+0000","last_peered":"2024-09-12T12:23:35.077576+0000","last_clean":"2024-09-12T12:23:35.077576+0000","last_became_active":"2024-09-12T12:23:03.387391+0000","last_became_peered":"2024-09-12T12:23:03.387391+0000","last_unstale":"2024-09-12T12:23:35.077576+0000","last_undegraded":"2024-09-12T12:23:35.077576+0000","last_fullsized":"2024-09-12T12:23:35.077576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:24.741915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077820+0000","last_change":"2024-09-12T12:22:54.314326+0000","last_active":"2024-09-12T12:23:35.077820+0000","last_peered":"2024-09-12T12:23:35.077820+0000","last_clean":"2024-09-12T12:23:35.077820+0000","last_became_active":"2024-09-12T12:22:54.313892+0000","last_became_peered":"2024-09-12T12:22:54.313892+0000","last_unstale":"2024-09-12T12:23:35.077820+0000","last_undegraded":"2024-09-12T12:23:35.077820+0000","last_fullsized":"2024-09-12T12:23:35.077820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:50.980891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.212315+0000","last_change":"2024-09-12T12:22:52.557126+0000","last_active":"2024-09-12T12:24:00.212315+0000","last_peered":"2024-09-12T12:24:00.212315+0000","last_clean":"2024-09-12T12:24:00.212315+0000","last_became_active":"2024-09-12T12:22:52.556736+0000","last_became_peered":"2024-09-12T12:22:52.556736+0000","last_unstale":"2024-09-12T12:24:00.212315+0000","last_undegraded":"2024-09-12T12:24:00.212315+0000","last_fullsized":"2024-09-12T12:24:00.212315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:09.199871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079363+0000","last_change":"2024-09-12T12:23:03.380117+0000","last_active":"2024-09-12T12:23:35.079363+0000","last_peered":"2024-09-12T12:23:35.079363+0000","last_clean":"2024-09-12T12:23:35.079363+0000","last_became_active":"2024-09-12T12:23:03.379635+0000","last_became_peered":"2024-09-12T12:23:03.379635+0000","last_unstale":"2024-09-12T12:23:35.079363+0000","last_undegraded":"2024-09-12T12:23:35.079363+0000","last_fullsized":"2024-09-12T12:23:35.079363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:23.227681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077268+0000","last_change":"2024-09-12T12:22:54.316010+0000","last_active":"2024-09-12T12:23:35.077268+0000","last_peered":"2024-09-12T12:23:35.077268+0000","last_clean":"2024-09-12T12:23:35.077268+0000","last_became_active":"2024-09-12T12:22:54.315702+0000","last_became_peered":"2024-09-12T12:22:54.315702+0000","last_unstale":"2024-09-12T12:23:35.077268+0000","last_undegraded":"2024-09-12T12:23:35.077268+0000","last_fullsized":"2024-09-12T12:23:35.077268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:52.370650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186564+0000","last_change":"2024-09-12T12:22:51.854456+0000","last_active":"2024-09-12T12:23:47.186564+0000","last_peered":"2024-09-12T12:23:47.186564+0000","last_clean":"2024-09-12T12:23:47.186564+0000","last_became_active":"2024-09-12T12:22:51.854092+0000","last_became_peered":"2024-09-12T12:22:51.854092+0000","last_unstale":"2024-09-12T12:23:47.186564+0000","last_undegraded":"2024-09-12T12:23:47.186564+0000","last_fullsized":"2024-09-12T12:23:47.186564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:57.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081550+0000","last_change":"2024-09-12T12:23:03.390443+0000","last_active":"2024-09-12T12:23:35.081550+0000","last_peered":"2024-09-12T12:23:35.081550+0000","last_clean":"2024-09-12T12:23:35.081550+0000","last_became_active":"2024-09-12T12:23:03.389825+0000","last_became_peered":"2024-09-12T12:23:03.389825+0000","last_unstale":"2024-09-12T12:23:35.081550+0000","last_undegraded":"2024-09-12T12:23:35.081550+0000","last_fullsized":"2024-09-12T12:23:35.081550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.711075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077125+0000","last_change":"2024-09-12T12:22:54.311694+0000","last_active":"2024-09-12T12:23:35.077125+0000","last_peered":"2024-09-12T12:23:35.077125+0000","last_clean":"2024-09-12T12:23:35.077125+0000","last_became_active":"2024-09-12T12:22:54.311381+0000","last_became_peered":"2024-09-12T12:22:54.311381+0000","last_unstale":"2024-09-12T12:23:35.077125+0000","last_undegraded":"2024-09-12T12:23:35.077125+0000","last_fullsized":"2024-09-12T12:23:35.077125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.378495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186369+0000","last_change":"2024-09-12T12:22:51.852126+0000","last_active":"2024-09-12T12:23:47.186369+0000","last_peered":"2024-09-12T12:23:47.186369+0000","last_clean":"2024-09-12T12:23:47.186369+0000","last_became_active":"2024-09-12T12:22:51.851766+0000","last_became_peered":"2024-09-12T12:22:51.851766+0000","last_unstale":"2024-09-12T12:23:47.186369+0000","last_undegraded":"2024-09-12T12:23:47.186369+0000","last_fullsized":"2024-09-12T12:23:47.186369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:37.263329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075396+0000","last_change":"2024-09-12T12:23:03.375569+0000","last_active":"2024-09-12T12:23:35.075396+0000","last_peered":"2024-09-12T12:23:35.075396+0000","last_clean":"2024-09-12T12:23:35.075396+0000","last_became_active":"2024-09-12T12:23:03.375136+0000","last_became_peered":"2024-09-12T12:23:03.375136+0000","last_unstale":"2024-09-12T12:23:35.075396+0000","last_undegraded":"2024-09-12T12:23:35.075396+0000","last_fullsized":"2024-09-12T12:23:35.075396+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:05.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117792+0000","last_change":"2024-09-12T12:22:54.304943+0000","last_active":"2024-09-12T12:23:35.117792+0000","last_peered":"2024-09-12T12:23:35.117792+0000","last_clean":"2024-09-12T12:23:35.117792+0000","last_became_active":"2024-09-12T12:22:54.304573+0000","last_became_peered":"2024-09-12T12:22:54.304573+0000","last_unstale":"2024-09-12T12:23:35.117792+0000","last_undegraded":"2024-09-12T12:23:35.117792+0000","last_fullsized":"2024-09-12T12:23:35.117792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.145358+0000","last_change":"2024-09-12T12:22:51.846998+0000","last_active":"2024-09-12T12:23:47.145358+0000","last_peered":"2024-09-12T12:23:47.145358+0000","last_clean":"2024-09-12T12:23:47.145358+0000","last_became_active":"2024-09-12T12:22:51.846617+0000","last_became_peered":"2024-09-12T12:22:51.846617+0000","last_unstale":"2024-09-12T12:23:47.145358+0000","last_undegraded":"2024-09-12T12:23:47.145358+0000","last_fullsized":"2024-09-12T12:23:47.145358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.428244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074803+0000","last_change":"2024-09-12T12:23:03.383519+0000","last_active":"2024-09-12T12:23:35.074803+0000","last_peered":"2024-09-12T12:23:35.074803+0000","last_clean":"2024-09-12T12:23:35.074803+0000","last_became_active":"2024-09-12T12:23:03.383131+0000","last_became_peered":"2024-09-12T12:23:03.383131+0000","last_unstale":"2024-09-12T12:23:35.074803+0000","last_undegraded":"2024-09-12T12:23:35.074803+0000","last_fullsized":"2024-09-12T12:23:35.074803+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:59.602027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074945+0000","last_change":"2024-09-12T12:22:54.312418+0000","last_active":"2024-09-12T12:23:35.074945+0000","last_peered":"2024-09-12T12:23:35.074945+0000","last_clean":"2024-09-12T12:23:35.074945+0000","last_became_active":"2024-09-12T12:22:54.311932+0000","last_became_peered":"2024-09-12T12:22:54.311932+0000","last_unstale":"2024-09-12T12:23:35.074945+0000","last_undegraded":"2024-09-12T12:23:35.074945+0000","last_fullsized":"2024-09-12T12:23:35.074945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:48.395607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186588+0000","last_change":"2024-09-12T12:22:51.993506+0000","last_active":"2024-09-12T12:23:47.186588+0000","last_peered":"2024-09-12T12:23:47.186588+0000","last_clean":"2024-09-12T12:23:47.186588+0000","last_became_active":"2024-09-12T12:22:51.993204+0000","last_became_peered":"2024-09-12T12:22:51.993204+0000","last_unstale":"2024-09-12T12:23:47.186588+0000","last_undegraded":"2024-09-12T12:23:47.186588+0000","last_fullsized":"2024-09-12T12:23:47.186588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:34.670023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.080742+0000","last_change":"2024-09-12T12:23:03.388552+0000","last_active":"2024-09-12T12:23:35.080742+0000","last_peered":"2024-09-12T12:23:35.080742+0000","last_clean":"2024-09-12T12:23:35.080742+0000","last_became_active":"2024-09-12T12:23:03.388105+0000","last_became_peered":"2024-09-12T12:23:03.388105+0000","last_unstale":"2024-09-12T12:23:35.080742+0000","last_undegraded":"2024-09-12T12:23:35.080742+0000","last_fullsized":"2024-09-12T12:23:35.080742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:08.927714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081015+0000","last_change":"2024-09-12T12:23:35.081015+0000","last_active":"2024-09-12T12:23:35.081015+0000","last_peered":"2024-09-12T12:23:35.081015+0000","last_clean":"2024-09-12T12:23:35.081015+0000","last_became_active":"2024-09-12T12:23:35.080609+0000","last_became_peered":"2024-09-12T12:23:35.080609+0000","last_unstale":"2024-09-12T12:23:35.081015+0000","last_undegraded":"2024-09-12T12:23:35.081015+0000","last_fullsized":"2024-09-12T12:23:35.081015+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:26.700031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.212848+0000","last_change":"2024-09-12T12:22:51.848784+0000","last_active":"2024-09-12T12:24:01.212848+0000","last_peered":"2024-09-12T12:24:01.212848+0000","last_clean":"2024-09-12T12:24:01.212848+0000","last_became_active":"2024-09-12T12:22:51.848255+0000","last_became_peered":"2024-09-12T12:22:51.848255+0000","last_unstale":"2024-09-12T12:24:01.212848+0000","last_undegraded":"2024-09-12T12:24:01.212848+0000","last_fullsized":"2024-09-12T12:24:01.212848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:00.680332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071606+0000","last_change":"2024-09-12T12:23:03.386046+0000","last_active":"2024-09-12T12:23:35.071606+0000","last_peered":"2024-09-12T12:23:35.071606+0000","last_clean":"2024-09-12T12:23:35.071606+0000","last_became_active":"2024-09-12T12:23:03.384264+0000","last_became_peered":"2024-09-12T12:23:03.384264+0000","last_unstale":"2024-09-12T12:23:35.071606+0000","last_undegraded":"2024-09-12T12:23:35.071606+0000","last_fullsized":"2024-09-12T12:23:35.071606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:23.605769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077453+0000","last_change":"2024-09-12T12:22:54.315588+0000","last_active":"2024-09-12T12:23:35.077453+0000","last_peered":"2024-09-12T12:23:35.077453+0000","last_clean":"2024-09-12T12:23:35.077453+0000","last_became_active":"2024-09-12T12:22:54.315216+0000","last_became_peered":"2024-09-12T12:22:54.315216+0000","last_unstale":"2024-09-12T12:23:35.077453+0000","last_undegraded":"2024-09-12T12:23:35.077453+0000","last_fullsized":"2024-09-12T12:23:35.077453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:06.556373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186061+0000","last_change":"2024-09-12T12:22:51.851246+0000","last_active":"2024-09-12T12:23:47.186061+0000","last_peered":"2024-09-12T12:23:47.186061+0000","last_clean":"2024-09-12T12:23:47.186061+0000","last_became_active":"2024-09-12T12:22:51.850963+0000","last_became_peered":"2024-09-12T12:22:51.850963+0000","last_unstale":"2024-09-12T12:23:47.186061+0000","last_undegraded":"2024-09-12T12:23:47.186061+0000","last_fullsized":"2024-09-12T12:23:47.186061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:12.032126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117527+0000","last_change":"2024-09-12T12:23:03.382950+0000","last_active":"2024-09-12T12:23:35.117527+0000","last_peered":"2024-09-12T12:23:35.117527+0000","last_clean":"2024-09-12T12:23:35.117527+0000","last_became_active":"2024-09-12T12:23:03.382503+0000","last_became_peered":"2024-09-12T12:23:03.382503+0000","last_unstale":"2024-09-12T12:23:35.117527+0000","last_undegraded":"2024-09-12T12:23:35.117527+0000","last_fullsized":"2024-09-12T12:23:35.117527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:03.991304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078957+0000","last_change":"2024-09-12T12:22:54.315788+0000","last_active":"2024-09-12T12:23:35.078957+0000","last_peered":"2024-09-12T12:23:35.078957+0000","last_clean":"2024-09-12T12:23:35.078957+0000","last_became_active":"2024-09-12T12:22:54.315343+0000","last_became_peered":"2024-09-12T12:22:54.315343+0000","last_unstale":"2024-09-12T12:23:35.078957+0000","last_undegraded":"2024-09-12T12:23:35.078957+0000","last_fullsized":"2024-09-12T12:23:35.078957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:22.549415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:48.192118+0000","last_change":"2024-09-12T12:22:51.854532+0000","last_active":"2024-09-12T12:23:48.192118+0000","last_peered":"2024-09-12T12:23:48.192118+0000","last_clean":"2024-09-12T12:23:48.192118+0000","last_became_active":"2024-09-12T12:22:51.854206+0000","last_became_peered":"2024-09-12T12:22:51.854206+0000","last_unstale":"2024-09-12T12:23:48.192118+0000","last_undegraded":"2024-09-12T12:23:48.192118+0000","last_fullsized":"2024-09-12T12:23:48.192118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:46.908917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076206+0000","last_change":"2024-09-12T12:23:03.383647+0000","last_active":"2024-09-12T12:23:35.076206+0000","last_peered":"2024-09-12T12:23:35.076206+0000","last_clean":"2024-09-12T12:23:35.076206+0000","last_became_active":"2024-09-12T12:23:03.383094+0000","last_became_peered":"2024-09-12T12:23:03.383094+0000","last_unstale":"2024-09-12T12:23:35.076206+0000","last_undegraded":"2024-09-12T12:23:35.076206+0000","last_fullsized":"2024-09-12T12:23:35.076206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:03.754250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072954+0000","last_change":"2024-09-12T12:22:54.310717+0000","last_active":"2024-09-12T12:23:35.072954+0000","last_peered":"2024-09-12T12:23:35.072954+0000","last_clean":"2024-09-12T12:23:35.072954+0000","last_became_active":"2024-09-12T12:22:54.309485+0000","last_became_peered":"2024-09-12T12:22:54.309485+0000","last_unstale":"2024-09-12T12:23:35.072954+0000","last_undegraded":"2024-09-12T12:23:35.072954+0000","last_fullsized":"2024-09-12T12:23:35.072954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:10.293726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'28","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.212873+0000","last_change":"2024-09-12T12:22:51.856735+0000","last_active":"2024-09-12T12:24:01.212873+0000","last_peered":"2024-09-12T12:24:01.212873+0000","last_clean":"2024-09-12T12:24:01.212873+0000","last_became_active":"2024-09-12T12:22:51.856340+0000","last_became_peered":"2024-09-12T12:22:51.856340+0000","last_unstale":"2024-09-12T12:24:01.212873+0000","last_undegraded":"2024-09-12T12:24:01.212873+0000","last_fullsized":"2024-09-12T12:24:01.212873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:40.727645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":64,"num_write":30,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.070490+0000","last_change":"2024-09-12T12:23:03.379726+0000","last_active":"2024-09-12T12:23:35.070490+0000","last_peered":"2024-09-12T12:23:35.070490+0000","last_clean":"2024-09-12T12:23:35.070490+0000","last_became_active":"2024-09-12T12:23:03.378168+0000","last_became_peered":"2024-09-12T12:23:03.378168+0000","last_unstale":"2024-09-12T12:23:35.070490+0000","last_undegraded":"2024-09-12T12:23:35.070490+0000","last_fullsized":"2024-09-12T12:23:35.070490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.083119+0000","last_change":"2024-09-12T12:23:35.083119+0000","last_active":"2024-09-12T12:23:35.083119+0000","last_peered":"2024-09-12T12:23:35.083119+0000","last_clean":"2024-09-12T12:23:35.083119+0000","last_became_active":"2024-09-12T12:23:35.082800+0000","last_became_peered":"2024-09-12T12:23:35.082800+0000","last_unstale":"2024-09-12T12:23:35.083119+0000","last_undegraded":"2024-09-12T12:23:35.083119+0000","last_fullsized":"2024-09-12T12:23:35.083119+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.717540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:46.173997+0000","last_change":"2024-09-12T12:22:51.989886+0000","last_active":"2024-09-12T12:23:46.173997+0000","last_peered":"2024-09-12T12:23:46.173997+0000","last_clean":"2024-09-12T12:23:46.173997+0000","last_became_active":"2024-09-12T12:22:51.989524+0000","last_became_peered":"2024-09-12T12:22:51.989524+0000","last_unstale":"2024-09-12T12:23:46.173997+0000","last_undegraded":"2024-09-12T12:23:46.173997+0000","last_fullsized":"2024-09-12T12:23:46.173997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:26.409342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076639+0000","last_change":"2024-09-12T12:23:03.384583+0000","last_active":"2024-09-12T12:23:35.076639+0000","last_peered":"2024-09-12T12:23:35.076639+0000","last_clean":"2024-09-12T12:23:35.076639+0000","last_became_active":"2024-09-12T12:23:03.383639+0000","last_became_peered":"2024-09-12T12:23:03.383639+0000","last_unstale":"2024-09-12T12:23:35.076639+0000","last_undegraded":"2024-09-12T12:23:35.076639+0000","last_fullsized":"2024-09-12T12:23:35.076639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:09.755052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.082352+0000","last_change":"2024-09-12T12:22:54.309874+0000","last_active":"2024-09-12T12:23:35.082352+0000","last_peered":"2024-09-12T12:23:35.082352+0000","last_clean":"2024-09-12T12:23:35.082352+0000","last_became_active":"2024-09-12T12:22:54.309294+0000","last_became_peered":"2024-09-12T12:22:54.309294+0000","last_unstale":"2024-09-12T12:23:35.082352+0000","last_undegraded":"2024-09-12T12:23:35.082352+0000","last_fullsized":"2024-09-12T12:23:35.082352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:50.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186746+0000","last_change":"2024-09-12T12:22:51.849467+0000","last_active":"2024-09-12T12:23:47.186746+0000","last_peered":"2024-09-12T12:23:47.186746+0000","last_clean":"2024-09-12T12:23:47.186746+0000","last_became_active":"2024-09-12T12:22:51.849076+0000","last_became_peered":"2024-09-12T12:22:51.849076+0000","last_unstale":"2024-09-12T12:23:47.186746+0000","last_undegraded":"2024-09-12T12:23:47.186746+0000","last_fullsized":"2024-09-12T12:23:47.186746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:04.821105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.084184+0000","last_change":"2024-09-12T12:23:35.083542+0000","last_active":"2024-09-12T12:23:35.084184+0000","last_peered":"2024-09-12T12:23:35.084184+0000","last_clean":"2024-09-12T12:23:35.084184+0000","last_became_active":"2024-09-12T12:23:35.083095+0000","last_became_peered":"2024-09-12T12:23:35.083095+0000","last_unstale":"2024-09-12T12:23:35.084184+0000","last_undegraded":"2024-09-12T12:23:35.084184+0000","last_fullsized":"2024-09-12T12:23:35.084184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:06.750223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079701+0000","last_change":"2024-09-12T12:22:54.315215+0000","last_active":"2024-09-12T12:23:35.079701+0000","last_peered":"2024-09-12T12:23:35.079701+0000","last_clean":"2024-09-12T12:23:35.079701+0000","last_became_active":"2024-09-12T12:22:54.314879+0000","last_became_peered":"2024-09-12T12:22:54.314879+0000","last_unstale":"2024-09-12T12:23:35.079701+0000","last_undegraded":"2024-09-12T12:23:35.079701+0000","last_fullsized":"2024-09-12T12:23:35.079701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:35.501376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.212760+0000","last_change":"2024-09-12T12:22:51.851461+0000","last_active":"2024-09-12T12:24:01.212760+0000","last_peered":"2024-09-12T12:24:01.212760+0000","last_clean":"2024-09-12T12:24:01.212760+0000","last_became_active":"2024-09-12T12:22:51.851105+0000","last_became_peered":"2024-09-12T12:22:51.851105+0000","last_unstale":"2024-09-12T12:24:01.212760+0000","last_undegraded":"2024-09-12T12:24:01.212760+0000","last_fullsized":"2024-09-12T12:24:01.212760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:42.604983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117222+0000","last_change":"2024-09-12T12:23:03.383308+0000","last_active":"2024-09-12T12:23:35.117222+0000","last_peered":"2024-09-12T12:23:35.117222+0000","last_clean":"2024-09-12T12:23:35.117222+0000","last_became_active":"2024-09-12T12:23:03.382294+0000","last_became_peered":"2024-09-12T12:23:03.382294+0000","last_unstale":"2024-09-12T12:23:35.117222+0000","last_undegraded":"2024-09-12T12:23:35.117222+0000","last_fullsized":"2024-09-12T12:23:35.117222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:43.920306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081620+0000","last_change":"2024-09-12T12:23:03.386850+0000","last_active":"2024-09-12T12:23:35.081620+0000","last_peered":"2024-09-12T12:23:35.081620+0000","last_clean":"2024-09-12T12:23:35.081620+0000","last_became_active":"2024-09-12T12:23:03.386350+0000","last_became_peered":"2024-09-12T12:23:03.386350+0000","last_unstale":"2024-09-12T12:23:35.081620+0000","last_undegraded":"2024-09-12T12:23:35.081620+0000","last_fullsized":"2024-09-12T12:23:35.081620+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.295745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.070233+0000","last_change":"2024-09-12T12:22:54.320709+0000","last_active":"2024-09-12T12:23:35.070233+0000","last_peered":"2024-09-12T12:23:35.070233+0000","last_clean":"2024-09-12T12:23:35.070233+0000","last_became_active":"2024-09-12T12:22:54.320208+0000","last_became_peered":"2024-09-12T12:22:54.320208+0000","last_unstale":"2024-09-12T12:23:35.070233+0000","last_undegraded":"2024-09-12T12:23:35.070233+0000","last_fullsized":"2024-09-12T12:23:35.070233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:45.452449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186784+0000","last_change":"2024-09-12T12:22:51.853047+0000","last_active":"2024-09-12T12:23:47.186784+0000","last_peered":"2024-09-12T12:23:47.186784+0000","last_clean":"2024-09-12T12:23:47.186784+0000","last_became_active":"2024-09-12T12:22:51.852653+0000","last_became_peered":"2024-09-12T12:22:51.852653+0000","last_unstale":"2024-09-12T12:23:47.186784+0000","last_undegraded":"2024-09-12T12:23:47.186784+0000","last_fullsized":"2024-09-12T12:23:47.186784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:39.035009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117686+0000","last_change":"2024-09-12T12:23:03.382997+0000","last_active":"2024-09-12T12:23:35.117686+0000","last_peered":"2024-09-12T12:23:35.117686+0000","last_clean":"2024-09-12T12:23:35.117686+0000","last_became_active":"2024-09-12T12:23:03.382594+0000","last_became_peered":"2024-09-12T12:23:03.382594+0000","last_unstale":"2024-09-12T12:23:35.117686+0000","last_undegraded":"2024-09-12T12:23:35.117686+0000","last_fullsized":"2024-09-12T12:23:35.117686+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:25.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117695+0000","last_change":"2024-09-12T12:22:54.322595+0000","last_active":"2024-09-12T12:23:35.117695+0000","last_peered":"2024-09-12T12:23:35.117695+0000","last_clean":"2024-09-12T12:23:35.117695+0000","last_became_active":"2024-09-12T12:22:54.320182+0000","last_became_peered":"2024-09-12T12:22:54.320182+0000","last_unstale":"2024-09-12T12:23:35.117695+0000","last_undegraded":"2024-09-12T12:23:35.117695+0000","last_fullsized":"2024-09-12T12:23:35.117695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:45.151420+0000","last_change":"2024-09-12T12:22:51.850045+0000","last_active":"2024-09-12T12:23:45.151420+0000","last_peered":"2024-09-12T12:23:45.151420+0000","last_clean":"2024-09-12T12:23:45.151420+0000","last_became_active":"2024-09-12T12:22:51.849643+0000","last_became_peered":"2024-09-12T12:22:51.849643+0000","last_unstale":"2024-09-12T12:23:45.151420+0000","last_undegraded":"2024-09-12T12:23:45.151420+0000","last_fullsized":"2024-09-12T12:23:45.151420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:18.255368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:46.174327+0000","last_change":"2024-09-12T12:22:51.852692+0000","last_active":"2024-09-12T12:23:46.174327+0000","last_peered":"2024-09-12T12:23:46.174327+0000","last_clean":"2024-09-12T12:23:46.174327+0000","last_became_active":"2024-09-12T12:22:51.852265+0000","last_became_peered":"2024-09-12T12:22:51.852265+0000","last_unstale":"2024-09-12T12:23:46.174327+0000","last_undegraded":"2024-09-12T12:23:46.174327+0000","last_fullsized":"2024-09-12T12:23:46.174327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:55.853073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075682+0000","last_change":"2024-09-12T12:22:54.315519+0000","last_active":"2024-09-12T12:23:35.075682+0000","last_peered":"2024-09-12T12:23:35.075682+0000","last_clean":"2024-09-12T12:23:35.075682+0000","last_became_active":"2024-09-12T12:22:54.315158+0000","last_became_peered":"2024-09-12T12:22:54.315158+0000","last_unstale":"2024-09-12T12:23:35.075682+0000","last_undegraded":"2024-09-12T12:23:35.075682+0000","last_fullsized":"2024-09-12T12:23:35.075682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073601+0000","last_change":"2024-09-12T12:23:03.383443+0000","last_active":"2024-09-12T12:23:35.073601+0000","last_peered":"2024-09-12T12:23:35.073601+0000","last_clean":"2024-09-12T12:23:35.073601+0000","last_became_active":"2024-09-12T12:23:03.382865+0000","last_became_peered":"2024-09-12T12:23:03.382865+0000","last_unstale":"2024-09-12T12:23:35.073601+0000","last_undegraded":"2024-09-12T12:23:35.073601+0000","last_fullsized":"2024-09-12T12:23:35.073601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:26.339910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.213584+0000","last_change":"2024-09-12T12:22:51.849963+0000","last_active":"2024-09-12T12:24:01.213584+0000","last_peered":"2024-09-12T12:24:01.213584+0000","last_clean":"2024-09-12T12:24:01.213584+0000","last_became_active":"2024-09-12T12:22:51.849596+0000","last_became_peered":"2024-09-12T12:22:51.849596+0000","last_unstale":"2024-09-12T12:24:01.213584+0000","last_undegraded":"2024-09-12T12:24:01.213584+0000","last_fullsized":"2024-09-12T12:24:01.213584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:48.695657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072511+0000","last_change":"2024-09-12T12:22:54.312543+0000","last_active":"2024-09-12T12:23:35.072511+0000","last_peered":"2024-09-12T12:23:35.072511+0000","last_clean":"2024-09-12T12:23:35.072511+0000","last_became_active":"2024-09-12T12:22:54.312154+0000","last_became_peered":"2024-09-12T12:22:54.312154+0000","last_unstale":"2024-09-12T12:23:35.072511+0000","last_undegraded":"2024-09-12T12:23:35.072511+0000","last_fullsized":"2024-09-12T12:23:35.072511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:28.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073680+0000","last_change":"2024-09-12T12:23:03.376938+0000","last_active":"2024-09-12T12:23:35.073680+0000","last_peered":"2024-09-12T12:23:35.073680+0000","last_clean":"2024-09-12T12:23:35.073680+0000","last_became_active":"2024-09-12T12:23:03.376450+0000","last_became_peered":"2024-09-12T12:23:03.376450+0000","last_unstale":"2024-09-12T12:23:35.073680+0000","last_undegraded":"2024-09-12T12:23:35.073680+0000","last_fullsized":"2024-09-12T12:23:35.073680+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:35.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117421+0000","last_change":"2024-09-12T12:22:54.305562+0000","last_active":"2024-09-12T12:23:35.117421+0000","last_peered":"2024-09-12T12:23:35.117421+0000","last_clean":"2024-09-12T12:23:35.117421+0000","last_became_active":"2024-09-12T12:22:54.305208+0000","last_became_peered":"2024-09-12T12:22:54.305208+0000","last_unstale":"2024-09-12T12:23:35.117421+0000","last_undegraded":"2024-09-12T12:23:35.117421+0000","last_fullsized":"2024-09-12T12:23:35.117421+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:46.643949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073480+0000","last_change":"2024-09-12T12:22:54.310634+0000","last_active":"2024-09-12T12:23:35.073480+0000","last_peered":"2024-09-12T12:23:35.073480+0000","last_clean":"2024-09-12T12:23:35.073480+0000","last_became_active":"2024-09-12T12:22:54.310194+0000","last_became_peered":"2024-09-12T12:22:54.310194+0000","last_unstale":"2024-09-12T12:23:35.073480+0000","last_undegraded":"2024-09-12T12:23:35.073480+0000","last_fullsized":"2024-09-12T12:23:35.073480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:05.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074474+0000","last_change":"2024-09-12T12:22:54.315119+0000","last_active":"2024-09-12T12:23:35.074474+0000","last_peered":"2024-09-12T12:23:35.074474+0000","last_clean":"2024-09-12T12:23:35.074474+0000","last_became_active":"2024-09-12T12:22:54.314729+0000","last_became_peered":"2024-09-12T12:22:54.314729+0000","last_unstale":"2024-09-12T12:23:35.074474+0000","last_undegraded":"2024-09-12T12:23:35.074474+0000","last_fullsized":"2024-09-12T12:23:35.074474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:07.888005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.083672+0000","last_change":"2024-09-12T12:23:35.083672+0000","last_active":"2024-09-12T12:23:35.083672+0000","last_peered":"2024-09-12T12:23:35.083672+0000","last_clean":"2024-09-12T12:23:35.083672+0000","last_became_active":"2024-09-12T12:23:35.083222+0000","last_became_peered":"2024-09-12T12:23:35.083222+0000","last_unstale":"2024-09-12T12:23:35.083672+0000","last_undegraded":"2024-09-12T12:23:35.083672+0000","last_fullsized":"2024-09-12T12:23:35.083672+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079376+0000","last_change":"2024-09-12T12:22:54.321649+0000","last_active":"2024-09-12T12:23:35.079376+0000","last_peered":"2024-09-12T12:23:35.079376+0000","last_clean":"2024-09-12T12:23:35.079376+0000","last_became_active":"2024-09-12T12:22:54.320859+0000","last_became_peered":"2024-09-12T12:22:54.320859+0000","last_unstale":"2024-09-12T12:23:35.079376+0000","last_undegraded":"2024-09-12T12:23:35.079376+0000","last_fullsized":"2024-09-12T12:23:35.079376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:49.706632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117723+0000","last_change":"2024-09-12T12:22:54.306900+0000","last_active":"2024-09-12T12:23:35.117723+0000","last_peered":"2024-09-12T12:23:35.117723+0000","last_clean":"2024-09-12T12:23:35.117723+0000","last_became_active":"2024-09-12T12:22:54.306432+0000","last_became_peered":"2024-09-12T12:22:54.306432+0000","last_unstale":"2024-09-12T12:23:35.117723+0000","last_undegraded":"2024-09-12T12:23:35.117723+0000","last_fullsized":"2024-09-12T12:23:35.117723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:07.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074149+0000","last_change":"2024-09-12T12:22:54.318123+0000","last_active":"2024-09-12T12:23:35.074149+0000","last_peered":"2024-09-12T12:23:35.074149+0000","last_clean":"2024-09-12T12:23:35.074149+0000","last_became_active":"2024-09-12T12:22:54.317820+0000","last_became_peered":"2024-09-12T12:22:54.317820+0000","last_unstale":"2024-09-12T12:23:35.074149+0000","last_undegraded":"2024-09-12T12:23:35.074149+0000","last_fullsized":"2024-09-12T12:23:35.074149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:19.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118129+0000","last_change":"2024-09-12T12:22:54.318029+0000","last_active":"2024-09-12T12:23:35.118129+0000","last_peered":"2024-09-12T12:23:35.118129+0000","last_clean":"2024-09-12T12:23:35.118129+0000","last_became_active":"2024-09-12T12:22:54.316015+0000","last_became_peered":"2024-09-12T12:22:54.316015+0000","last_unstale":"2024-09-12T12:23:35.118129+0000","last_undegraded":"2024-09-12T12:23:35.118129+0000","last_fullsized":"2024-09-12T12:23:35.118129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075580+0000","last_change":"2024-09-12T12:22:54.325688+0000","last_active":"2024-09-12T12:23:35.075580+0000","last_peered":"2024-09-12T12:23:35.075580+0000","last_clean":"2024-09-12T12:23:35.075580+0000","last_became_active":"2024-09-12T12:22:54.325375+0000","last_became_peered":"2024-09-12T12:22:54.325375+0000","last_unstale":"2024-09-12T12:23:35.075580+0000","last_undegraded":"2024-09-12T12:23:35.075580+0000","last_fullsized":"2024-09-12T12:23:35.075580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:43.971575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117350+0000","last_change":"2024-09-12T12:22:54.315713+0000","last_active":"2024-09-12T12:23:35.117350+0000","last_peered":"2024-09-12T12:23:35.117350+0000","last_clean":"2024-09-12T12:23:35.117350+0000","last_became_active":"2024-09-12T12:22:54.315401+0000","last_became_peered":"2024-09-12T12:22:54.315401+0000","last_unstale":"2024-09-12T12:23:35.117350+0000","last_undegraded":"2024-09-12T12:23:35.117350+0000","last_fullsized":"2024-09-12T12:23:35.117350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:35:31.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079533+0000","last_change":"2024-09-12T12:22:54.314543+0000","last_active":"2024-09-12T12:23:35.079533+0000","last_peered":"2024-09-12T12:23:35.079533+0000","last_clean":"2024-09-12T12:23:35.079533+0000","last_became_active":"2024-09-12T12:22:54.314216+0000","last_became_peered":"2024-09-12T12:22:54.314216+0000","last_unstale":"2024-09-12T12:23:35.079533+0000","last_undegraded":"2024-09-12T12:23:35.079533+0000","last_fullsized":"2024-09-12T12:23:35.079533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:12.180355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079623+0000","last_change":"2024-09-12T12:22:54.313637+0000","last_active":"2024-09-12T12:23:35.079623+0000","last_peered":"2024-09-12T12:23:35.079623+0000","last_clean":"2024-09-12T12:23:35.079623+0000","last_became_active":"2024-09-12T12:22:54.313327+0000","last_became_peered":"2024-09-12T12:22:54.313327+0000","last_unstale":"2024-09-12T12:23:35.079623+0000","last_undegraded":"2024-09-12T12:23:35.079623+0000","last_fullsized":"2024-09-12T12:23:35.079623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:24.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117542+0000","last_change":"2024-09-12T12:22:54.306018+0000","last_active":"2024-09-12T12:23:35.117542+0000","last_peered":"2024-09-12T12:23:35.117542+0000","last_clean":"2024-09-12T12:23:35.117542+0000","last_became_active":"2024-09-12T12:22:54.305683+0000","last_became_peered":"2024-09-12T12:22:54.305683+0000","last_unstale":"2024-09-12T12:23:35.117542+0000","last_undegraded":"2024-09-12T12:23:35.117542+0000","last_fullsized":"2024-09-12T12:23:35.117542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:00.464765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073880+0000","last_change":"2024-09-12T12:22:54.319169+0000","last_active":"2024-09-12T12:23:35.073880+0000","last_peered":"2024-09-12T12:23:35.073880+0000","last_clean":"2024-09-12T12:23:35.073880+0000","last_became_active":"2024-09-12T12:22:54.318831+0000","last_became_peered":"2024-09-12T12:22:54.318831+0000","last_unstale":"2024-09-12T12:23:35.073880+0000","last_undegraded":"2024-09-12T12:23:35.073880+0000","last_fullsized":"2024-09-12T12:23:35.073880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:42.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071633+0000","last_change":"2024-09-12T12:22:54.305760+0000","last_active":"2024-09-12T12:23:35.071633+0000","last_peered":"2024-09-12T12:23:35.071633+0000","last_clean":"2024-09-12T12:23:35.071633+0000","last_became_active":"2024-09-12T12:22:54.305455+0000","last_became_peered":"2024-09-12T12:22:54.305455+0000","last_unstale":"2024-09-12T12:23:35.071633+0000","last_undegraded":"2024-09-12T12:23:35.071633+0000","last_fullsized":"2024-09-12T12:23:35.071633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:54.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117932+0000","last_change":"2024-09-12T12:22:54.311420+0000","last_active":"2024-09-12T12:23:35.117932+0000","last_peered":"2024-09-12T12:23:35.117932+0000","last_clean":"2024-09-12T12:23:35.117932+0000","last_became_active":"2024-09-12T12:22:54.311072+0000","last_became_peered":"2024-09-12T12:22:54.311072+0000","last_unstale":"2024-09-12T12:23:35.117932+0000","last_undegraded":"2024-09-12T12:23:35.117932+0000","last_fullsized":"2024-09-12T12:23:35.117932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:54.476587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078825+0000","last_change":"2024-09-12T12:22:54.313093+0000","last_active":"2024-09-12T12:23:35.078825+0000","last_peered":"2024-09-12T12:23:35.078825+0000","last_clean":"2024-09-12T12:23:35.078825+0000","last_became_active":"2024-09-12T12:22:54.312220+0000","last_became_peered":"2024-09-12T12:22:54.312220+0000","last_unstale":"2024-09-12T12:23:35.078825+0000","last_undegraded":"2024-09-12T12:23:35.078825+0000","last_fullsized":"2024-09-12T12:23:35.078825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:33.241798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081126+0000","last_change":"2024-09-12T12:22:54.310536+0000","last_active":"2024-09-12T12:23:35.081126+0000","last_peered":"2024-09-12T12:23:35.081126+0000","last_clean":"2024-09-12T12:23:35.081126+0000","last_became_active":"2024-09-12T12:22:54.310203+0000","last_became_peered":"2024-09-12T12:22:54.310203+0000","last_unstale":"2024-09-12T12:23:35.081126+0000","last_undegraded":"2024-09-12T12:23:35.081126+0000","last_fullsized":"2024-09-12T12:23:35.081126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:40.957367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081396+0000","last_change":"2024-09-12T12:22:54.312898+0000","last_active":"2024-09-12T12:23:35.081396+0000","last_peered":"2024-09-12T12:23:35.081396+0000","last_clean":"2024-09-12T12:23:35.081396+0000","last_became_active":"2024-09-12T12:22:54.312449+0000","last_became_peered":"2024-09-12T12:22:54.312449+0000","last_unstale":"2024-09-12T12:23:35.081396+0000","last_undegraded":"2024-09-12T12:23:35.081396+0000","last_fullsized":"2024-09-12T12:23:35.081396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:57.384949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079431+0000","last_change":"2024-09-12T12:22:54.312206+0000","last_active":"2024-09-12T12:23:35.079431+0000","last_peered":"2024-09-12T12:23:35.079431+0000","last_clean":"2024-09-12T12:23:35.079431+0000","last_became_active":"2024-09-12T12:22:54.311187+0000","last_became_peered":"2024-09-12T12:22:54.311187+0000","last_unstale":"2024-09-12T12:23:35.079431+0000","last_undegraded":"2024-09-12T12:23:35.079431+0000","last_fullsized":"2024-09-12T12:23:35.079431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:22.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077572+0000","last_change":"2024-09-12T12:22:54.312083+0000","last_active":"2024-09-12T12:23:35.077572+0000","last_peered":"2024-09-12T12:23:35.077572+0000","last_clean":"2024-09-12T12:23:35.077572+0000","last_became_active":"2024-09-12T12:22:54.310716+0000","last_became_peered":"2024-09-12T12:22:54.310716+0000","last_unstale":"2024-09-12T12:23:35.077572+0000","last_undegraded":"2024-09-12T12:23:35.077572+0000","last_fullsized":"2024-09-12T12:23:35.077572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:22.717416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077718+0000","last_change":"2024-09-12T12:22:54.315088+0000","last_active":"2024-09-12T12:23:35.077718+0000","last_peered":"2024-09-12T12:23:35.077718+0000","last_clean":"2024-09-12T12:23:35.077718+0000","last_became_active":"2024-09-12T12:22:54.314601+0000","last_became_peered":"2024-09-12T12:22:54.314601+0000","last_unstale":"2024-09-12T12:23:35.077718+0000","last_undegraded":"2024-09-12T12:23:35.077718+0000","last_fullsized":"2024-09-12T12:23:35.077718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:35.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075474+0000","last_change":"2024-09-12T12:22:54.305332+0000","last_active":"2024-09-12T12:23:35.075474+0000","last_peered":"2024-09-12T12:23:35.075474+0000","last_clean":"2024-09-12T12:23:35.075474+0000","last_became_active":"2024-09-12T12:22:54.305017+0000","last_became_peered":"2024-09-12T12:22:54.305017+0000","last_unstale":"2024-09-12T12:23:35.075474+0000","last_undegraded":"2024-09-12T12:23:35.075474+0000","last_fullsized":"2024-09-12T12:23:35.075474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:16.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079859+0000","last_change":"2024-09-12T12:22:54.319768+0000","last_active":"2024-09-12T12:23:35.079859+0000","last_peered":"2024-09-12T12:23:35.079859+0000","last_clean":"2024-09-12T12:23:35.079859+0000","last_became_active":"2024-09-12T12:22:54.319451+0000","last_became_peered":"2024-09-12T12:22:54.319451+0000","last_unstale":"2024-09-12T12:23:35.079859+0000","last_undegraded":"2024-09-12T12:23:35.079859+0000","last_fullsized":"2024-09-12T12:23:35.079859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:56.368891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117257+0000","last_change":"2024-09-12T12:22:54.323162+0000","last_active":"2024-09-12T12:23:35.117257+0000","last_peered":"2024-09-12T12:23:35.117257+0000","last_clean":"2024-09-12T12:23:35.117257+0000","last_became_active":"2024-09-12T12:22:54.322068+0000","last_became_peered":"2024-09-12T12:22:54.322068+0000","last_unstale":"2024-09-12T12:23:35.117257+0000","last_undegraded":"2024-09-12T12:23:35.117257+0000","last_fullsized":"2024-09-12T12:23:35.117257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:54.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077816+0000","last_change":"2024-09-12T12:22:54.306125+0000","last_active":"2024-09-12T12:23:35.077816+0000","last_peered":"2024-09-12T12:23:35.077816+0000","last_clean":"2024-09-12T12:23:35.077816+0000","last_became_active":"2024-09-12T12:22:54.305790+0000","last_became_peered":"2024-09-12T12:22:54.305790+0000","last_unstale":"2024-09-12T12:23:35.077816+0000","last_undegraded":"2024-09-12T12:23:35.077816+0000","last_fullsized":"2024-09-12T12:23:35.077816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:36.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074924+0000","last_change":"2024-09-12T12:22:54.305099+0000","last_active":"2024-09-12T12:23:35.074924+0000","last_peered":"2024-09-12T12:23:35.074924+0000","last_clean":"2024-09-12T12:23:35.074924+0000","last_became_active":"2024-09-12T12:22:54.304649+0000","last_became_peered":"2024-09-12T12:22:54.304649+0000","last_unstale":"2024-09-12T12:23:35.074924+0000","last_undegraded":"2024-09-12T12:23:35.074924+0000","last_fullsized":"2024-09-12T12:23:35.074924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:05.771434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072804+0000","last_change":"2024-09-12T12:22:54.319247+0000","last_active":"2024-09-12T12:23:35.072804+0000","last_peered":"2024-09-12T12:23:35.072804+0000","last_clean":"2024-09-12T12:23:35.072804+0000","last_became_active":"2024-09-12T12:22:54.318894+0000","last_became_peered":"2024-09-12T12:22:54.318894+0000","last_unstale":"2024-09-12T12:23:35.072804+0000","last_undegraded":"2024-09-12T12:23:35.072804+0000","last_fullsized":"2024-09-12T12:23:35.072804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:55.692071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078218+0000","last_change":"2024-09-12T12:23:35.076997+0000","last_active":"2024-09-12T12:23:35.078218+0000","last_peered":"2024-09-12T12:23:35.078218+0000","last_clean":"2024-09-12T12:23:35.078218+0000","last_became_active":"2024-09-12T12:23:35.076506+0000","last_became_peered":"2024-09-12T12:23:35.076506+0000","last_unstale":"2024-09-12T12:23:35.078218+0000","last_undegraded":"2024-09-12T12:23:35.078218+0000","last_fullsized":"2024-09-12T12:23:35.078218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081709+0000","last_change":"2024-09-12T12:22:54.314298+0000","last_active":"2024-09-12T12:23:35.081709+0000","last_peered":"2024-09-12T12:23:35.081709+0000","last_clean":"2024-09-12T12:23:35.081709+0000","last_became_active":"2024-09-12T12:22:54.311726+0000","last_became_peered":"2024-09-12T12:22:54.311726+0000","last_unstale":"2024-09-12T12:23:35.081709+0000","last_undegraded":"2024-09-12T12:23:35.081709+0000","last_fullsized":"2024-09-12T12:23:35.081709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:13.298082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081628+0000","last_change":"2024-09-12T12:22:54.304397+0000","last_active":"2024-09-12T12:23:35.081628+0000","last_peered":"2024-09-12T12:23:35.081628+0000","last_clean":"2024-09-12T12:23:35.081628+0000","last_became_active":"2024-09-12T12:22:54.304048+0000","last_became_peered":"2024-09-12T12:22:54.304048+0000","last_unstale":"2024-09-12T12:23:35.081628+0000","last_undegraded":"2024-09-12T12:23:35.081628+0000","last_fullsized":"2024-09-12T12:23:35.081628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:13.518433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117892+0000","last_change":"2024-09-12T12:22:54.312229+0000","last_active":"2024-09-12T12:23:35.117892+0000","last_peered":"2024-09-12T12:23:35.117892+0000","last_clean":"2024-09-12T12:23:35.117892+0000","last_became_active":"2024-09-12T12:22:54.311806+0000","last_became_peered":"2024-09-12T12:22:54.311806+0000","last_unstale":"2024-09-12T12:23:35.117892+0000","last_undegraded":"2024-09-12T12:23:35.117892+0000","last_fullsized":"2024-09-12T12:23:35.117892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:28.865595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55913,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":178,"num_read_kb":151,"num_write":234,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":167739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1044480,"data_stored":514144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1153761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":513681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135916,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":514059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1110165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561078,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":509185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1671168,"data_stored":1105747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":513259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":508893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":559926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":559313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":511034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":50850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":50834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:06.480 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:24:06.529 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:06 smithi038 ceph-mon[30810]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:06.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:06 smithi154 ceph-mon[35578]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:06.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:06 smithi071 ceph-mon[34859]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:06.859 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.436+0000 7f196b000640 1 -- 172.21.15.38:0/925653563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1964109140 msgr2=0x7f1964110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.436+0000 7f196b000640 1 --2- 172.21.15.38:0/925653563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1964109140 0x7f1964110cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f195c009ca0 tx=0x7f195c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.436+0000 7f196b000640 1 -- 172.21.15.38:0/925653563 shutdown_connections 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.436+0000 7f196b000640 1 --2- 172.21.15.38:0/925653563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1964109140 0x7f1964110cc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.436+0000 7f196b000640 1 --2- 172.21.15.38:0/925653563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19641049c0 0x7f1964108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.436+0000 7f196b000640 1 --2- 172.21.15.38:0/925653563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1964104010 0x7f19641043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.436+0000 7f196b000640 1 -- 172.21.15.38:0/925653563 >> 172.21.15.38:0/925653563 conn(0x7f19640ffa50 msgr2=0x7f1964101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.437+0000 7f196b000640 1 -- 172.21.15.38:0/925653563 shutdown_connections 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.437+0000 7f196b000640 1 -- 172.21.15.38:0/925653563 wait complete. 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.437+0000 7f196b000640 1 Processor -- start 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f196b000640 1 -- start start 2024-09-12T12:24:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f196b000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1964104010 0x7f196419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f196b000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19641049c0 0x7f196419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f196b000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1964109140 0x7f196419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f196b000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f19641141c0 con 0x7f19641049c0 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f196b000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1964114040 con 0x7f1964109140 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f196b000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1964114340 con 0x7f1964104010 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f1963400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19641049c0 0x7f196419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f1963400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19641049c0 0x7f196419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33166/0 (socket says 172.21.15.38:33166) 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f1963400640 1 -- 172.21.15.38:0/4104158195 learned_addr learned my addr 172.21.15.38:0/4104158195 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f1963e00640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1964104010 0x7f196419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.438+0000 7f1969000640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1964109140 0x7f196419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1963400640 1 -- 172.21.15.38:0/4104158195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1964104010 msgr2=0x7f196419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1963400640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1964104010 0x7f196419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1963400640 1 -- 172.21.15.38:0/4104158195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1964109140 msgr2=0x7f196419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1963400640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1964109140 0x7f196419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1963400640 1 -- 172.21.15.38:0/4104158195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196419f610 con 0x7f19641049c0 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1963400640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19641049c0 0x7f196419aba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f195000e9f0 tx=0x7f195000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1960c00640 1 -- 172.21.15.38:0/4104158195 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195000ccc0 con 0x7f19641049c0 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.439+0000 7f1960c00640 1 -- 172.21.15.38:0/4104158195 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1950010910 con 0x7f19641049c0 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.440+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196419f900 con 0x7f19641049c0 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.440+0000 7f1960c00640 1 -- 172.21.15.38:0/4104158195 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19500188a0 con 0x7f19641049c0 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.440+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19641a71e0 con 0x7f19641049c0 2024-09-12T12:24:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.441+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19641043f0 con 0x7f19641049c0 2024-09-12T12:24:07.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.443+0000 7f1960c00640 1 -- 172.21.15.38:0/4104158195 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1950010ac0 con 0x7f19641049c0 2024-09-12T12:24:07.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.444+0000 7f1960c00640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19480a2c90 0x7f19480a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.445+0000 7f1960c00640 1 -- 172.21.15.38:0/4104158195 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f19500cf940 con 0x7f19641049c0 2024-09-12T12:24:07.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.445+0000 7f1963e00640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19480a2c90 0x7f19480a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.445+0000 7f1963e00640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19480a2c90 0x7f19480a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1954009990 tx=0x7f1954009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.449+0000 7f1960c00640 1 -- 172.21.15.38:0/4104158195 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f195009c380 con 0x7f19641049c0 2024-09-12T12:24:07.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.630+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1964062630 con 0x7f19480a2c90 2024-09-12T12:24:07.629 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:07 smithi038 ceph-mon[30810]: pgmap v337: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-12T12:24:07.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.641+0000 7f1960c00640 1 -- 172.21.15.38:0/4104158195 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340404 (secure 0 0 0) 0x7f1964062630 con 0x7f19480a2c90 2024-09-12T12:24:07.644 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:07.649 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19480a2c90 msgr2=0x7f19480a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19480a2c90 0x7f19480a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1954009990 tx=0x7f1954009110 comp rx=0 tx=0).stop 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19641049c0 msgr2=0x7f196419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19641049c0 0x7f196419aba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f195000e9f0 tx=0x7f195000edf0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 shutdown_connections 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19480a2c90 0x7f19480a5150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1964109140 0x7f196419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19641049c0 0x7f196419aba0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 --2- 172.21.15.38:0/4104158195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1964104010 0x7f196419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.646+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 >> 172.21.15.38:0/4104158195 conn(0x7f19640ffa50 msgr2=0x7f1964100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:07.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.647+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 shutdown_connections 2024-09-12T12:24:07.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:07.647+0000 7f196b000640 1 -- 172.21.15.38:0/4104158195 wait complete. 2024-09-12T12:24:07.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:07 smithi154 ceph-mon[35578]: pgmap v337: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-12T12:24:07.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:07 smithi071 ceph-mon[34859]: pgmap v337: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-12T12:24:08.440 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-12T12:24:06.090040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646515,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":304,"num_read_kb":260,"num_write":417,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388544,"kb_used_data":14336,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553280,"statfs":{"total":1151940427776,"available":1151542558720,"internally_reserved":0,"allocated":14680064,"data_stored":8073167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38886,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":88,"num_write":20,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003507"},"pg_stats":[{"pgid":"2.1f","version":"91'13","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.211931+0000","last_change":"2024-09-12T12:22:51.847865+0000","last_active":"2024-09-12T12:24:00.211931+0000","last_peered":"2024-09-12T12:24:00.211931+0000","last_clean":"2024-09-12T12:24:00.211931+0000","last_became_active":"2024-09-12T12:22:51.847437+0000","last_became_peered":"2024-09-12T12:22:51.847437+0000","last_unstale":"2024-09-12T12:24:00.211931+0000","last_undegraded":"2024-09-12T12:24:00.211931+0000","last_fullsized":"2024-09-12T12:24:00.211931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:34.486264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117866+0000","last_change":"2024-09-12T12:22:54.316759+0000","last_active":"2024-09-12T12:23:35.117866+0000","last_peered":"2024-09-12T12:23:35.117866+0000","last_clean":"2024-09-12T12:23:35.117866+0000","last_became_active":"2024-09-12T12:22:54.315906+0000","last_became_peered":"2024-09-12T12:22:54.315906+0000","last_unstale":"2024-09-12T12:23:35.117866+0000","last_undegraded":"2024-09-12T12:23:35.117866+0000","last_fullsized":"2024-09-12T12:23:35.117866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:54.465835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073063+0000","last_change":"2024-09-12T12:23:03.387327+0000","last_active":"2024-09-12T12:23:35.073063+0000","last_peered":"2024-09-12T12:23:35.073063+0000","last_clean":"2024-09-12T12:23:35.073063+0000","last_became_active":"2024-09-12T12:23:03.386929+0000","last_became_peered":"2024-09-12T12:23:03.386929+0000","last_unstale":"2024-09-12T12:23:35.073063+0000","last_undegraded":"2024-09-12T12:23:35.073063+0000","last_fullsized":"2024-09-12T12:23:35.073063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.033999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118152+0000","last_change":"2024-09-12T12:22:51.990331+0000","last_active":"2024-09-12T12:23:35.118152+0000","last_peered":"2024-09-12T12:23:35.118152+0000","last_clean":"2024-09-12T12:23:35.118152+0000","last_became_active":"2024-09-12T12:22:51.989844+0000","last_became_peered":"2024-09-12T12:22:51.989844+0000","last_unstale":"2024-09-12T12:23:35.118152+0000","last_undegraded":"2024-09-12T12:23:35.118152+0000","last_fullsized":"2024-09-12T12:23:35.118152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:47.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.082232+0000","last_change":"2024-09-12T12:22:54.317141+0000","last_active":"2024-09-12T12:23:35.082232+0000","last_peered":"2024-09-12T12:23:35.082232+0000","last_clean":"2024-09-12T12:23:35.082232+0000","last_became_active":"2024-09-12T12:22:54.312292+0000","last_became_peered":"2024-09-12T12:22:54.312292+0000","last_unstale":"2024-09-12T12:23:35.082232+0000","last_undegraded":"2024-09-12T12:23:35.082232+0000","last_fullsized":"2024-09-12T12:23:35.082232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.943100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075643+0000","last_change":"2024-09-12T12:23:03.379532+0000","last_active":"2024-09-12T12:23:35.075643+0000","last_peered":"2024-09-12T12:23:35.075643+0000","last_clean":"2024-09-12T12:23:35.075643+0000","last_became_active":"2024-09-12T12:23:03.379087+0000","last_became_peered":"2024-09-12T12:23:03.379087+0000","last_unstale":"2024-09-12T12:23:35.075643+0000","last_undegraded":"2024-09-12T12:23:35.075643+0000","last_fullsized":"2024-09-12T12:23:35.075643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.971474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:48.192556+0000","last_change":"2024-09-12T12:22:51.848327+0000","last_active":"2024-09-12T12:23:48.192556+0000","last_peered":"2024-09-12T12:23:48.192556+0000","last_clean":"2024-09-12T12:23:48.192556+0000","last_became_active":"2024-09-12T12:22:51.848010+0000","last_became_peered":"2024-09-12T12:22:51.848010+0000","last_unstale":"2024-09-12T12:23:48.192556+0000","last_undegraded":"2024-09-12T12:23:48.192556+0000","last_fullsized":"2024-09-12T12:23:48.192556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:23.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079509+0000","last_change":"2024-09-12T12:22:54.315178+0000","last_active":"2024-09-12T12:23:35.079509+0000","last_peered":"2024-09-12T12:23:35.079509+0000","last_clean":"2024-09-12T12:23:35.079509+0000","last_became_active":"2024-09-12T12:22:54.314408+0000","last_became_peered":"2024-09-12T12:22:54.314408+0000","last_unstale":"2024-09-12T12:23:35.079509+0000","last_undegraded":"2024-09-12T12:23:35.079509+0000","last_fullsized":"2024-09-12T12:23:35.079509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076476+0000","last_change":"2024-09-12T12:23:03.384629+0000","last_active":"2024-09-12T12:23:35.076476+0000","last_peered":"2024-09-12T12:23:35.076476+0000","last_clean":"2024-09-12T12:23:35.076476+0000","last_became_active":"2024-09-12T12:23:03.383750+0000","last_became_peered":"2024-09-12T12:23:03.383750+0000","last_unstale":"2024-09-12T12:23:35.076476+0000","last_undegraded":"2024-09-12T12:23:35.076476+0000","last_fullsized":"2024-09-12T12:23:35.076476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:24.377269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.187391+0000","last_change":"2024-09-12T12:22:51.847561+0000","last_active":"2024-09-12T12:23:47.187391+0000","last_peered":"2024-09-12T12:23:47.187391+0000","last_clean":"2024-09-12T12:23:47.187391+0000","last_became_active":"2024-09-12T12:22:51.846862+0000","last_became_peered":"2024-09-12T12:22:51.846862+0000","last_unstale":"2024-09-12T12:23:47.187391+0000","last_undegraded":"2024-09-12T12:23:47.187391+0000","last_fullsized":"2024-09-12T12:23:47.187391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:37.907652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076111+0000","last_change":"2024-09-12T12:22:54.313493+0000","last_active":"2024-09-12T12:23:35.076111+0000","last_peered":"2024-09-12T12:23:35.076111+0000","last_clean":"2024-09-12T12:23:35.076111+0000","last_became_active":"2024-09-12T12:22:54.313115+0000","last_became_peered":"2024-09-12T12:22:54.313115+0000","last_unstale":"2024-09-12T12:23:35.076111+0000","last_undegraded":"2024-09-12T12:23:35.076111+0000","last_fullsized":"2024-09-12T12:23:35.076111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:39.631537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075481+0000","last_change":"2024-09-12T12:23:03.383997+0000","last_active":"2024-09-12T12:23:35.075481+0000","last_peered":"2024-09-12T12:23:35.075481+0000","last_clean":"2024-09-12T12:23:35.075481+0000","last_became_active":"2024-09-12T12:23:03.382952+0000","last_became_peered":"2024-09-12T12:23:03.382952+0000","last_unstale":"2024-09-12T12:23:35.075481+0000","last_undegraded":"2024-09-12T12:23:35.075481+0000","last_fullsized":"2024-09-12T12:23:35.075481+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:37.949848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078172+0000","last_change":"2024-09-12T12:22:54.311875+0000","last_active":"2024-09-12T12:23:35.078172+0000","last_peered":"2024-09-12T12:23:35.078172+0000","last_clean":"2024-09-12T12:23:35.078172+0000","last_became_active":"2024-09-12T12:22:54.311301+0000","last_became_peered":"2024-09-12T12:22:54.311301+0000","last_unstale":"2024-09-12T12:23:35.078172+0000","last_undegraded":"2024-09-12T12:23:35.078172+0000","last_fullsized":"2024-09-12T12:23:35.078172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:47.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:44.140568+0000","last_change":"2024-09-12T12:22:51.849400+0000","last_active":"2024-09-12T12:23:44.140568+0000","last_peered":"2024-09-12T12:23:44.140568+0000","last_clean":"2024-09-12T12:23:44.140568+0000","last_became_active":"2024-09-12T12:22:51.848295+0000","last_became_peered":"2024-09-12T12:22:51.848295+0000","last_unstale":"2024-09-12T12:23:44.140568+0000","last_undegraded":"2024-09-12T12:23:44.140568+0000","last_fullsized":"2024-09-12T12:23:44.140568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077143+0000","last_change":"2024-09-12T12:23:03.779217+0000","last_active":"2024-09-12T12:23:35.077143+0000","last_peered":"2024-09-12T12:23:35.077143+0000","last_clean":"2024-09-12T12:23:35.077143+0000","last_became_active":"2024-09-12T12:23:03.778732+0000","last_became_peered":"2024-09-12T12:23:03.778732+0000","last_unstale":"2024-09-12T12:23:35.077143+0000","last_undegraded":"2024-09-12T12:23:35.077143+0000","last_fullsized":"2024-09-12T12:23:35.077143+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:49.676157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117546+0000","last_change":"2024-09-12T12:22:54.323222+0000","last_active":"2024-09-12T12:23:35.117546+0000","last_peered":"2024-09-12T12:23:35.117546+0000","last_clean":"2024-09-12T12:23:35.117546+0000","last_became_active":"2024-09-12T12:22:54.321035+0000","last_became_peered":"2024-09-12T12:22:54.321035+0000","last_unstale":"2024-09-12T12:23:35.117546+0000","last_undegraded":"2024-09-12T12:23:35.117546+0000","last_fullsized":"2024-09-12T12:23:35.117546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:04.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:46.174467+0000","last_change":"2024-09-12T12:22:51.850014+0000","last_active":"2024-09-12T12:23:46.174467+0000","last_peered":"2024-09-12T12:23:46.174467+0000","last_clean":"2024-09-12T12:23:46.174467+0000","last_became_active":"2024-09-12T12:22:51.849640+0000","last_became_peered":"2024-09-12T12:22:51.849640+0000","last_unstale":"2024-09-12T12:23:46.174467+0000","last_undegraded":"2024-09-12T12:23:46.174467+0000","last_fullsized":"2024-09-12T12:23:46.174467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:32.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081092+0000","last_change":"2024-09-12T12:23:35.079820+0000","last_active":"2024-09-12T12:23:35.081092+0000","last_peered":"2024-09-12T12:23:35.081092+0000","last_clean":"2024-09-12T12:23:35.081092+0000","last_became_active":"2024-09-12T12:23:35.079362+0000","last_became_peered":"2024-09-12T12:23:35.079362+0000","last_unstale":"2024-09-12T12:23:35.081092+0000","last_undegraded":"2024-09-12T12:23:35.081092+0000","last_fullsized":"2024-09-12T12:23:35.081092+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:22.713646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117499+0000","last_change":"2024-09-12T12:22:54.307950+0000","last_active":"2024-09-12T12:23:35.117499+0000","last_peered":"2024-09-12T12:23:35.117499+0000","last_clean":"2024-09-12T12:23:35.117499+0000","last_became_active":"2024-09-12T12:22:54.307595+0000","last_became_peered":"2024-09-12T12:22:54.307595+0000","last_unstale":"2024-09-12T12:23:35.117499+0000","last_undegraded":"2024-09-12T12:23:35.117499+0000","last_fullsized":"2024-09-12T12:23:35.117499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:11.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.187308+0000","last_change":"2024-09-12T12:22:51.851424+0000","last_active":"2024-09-12T12:23:47.187308+0000","last_peered":"2024-09-12T12:23:47.187308+0000","last_clean":"2024-09-12T12:23:47.187308+0000","last_became_active":"2024-09-12T12:22:51.851043+0000","last_became_peered":"2024-09-12T12:22:51.851043+0000","last_unstale":"2024-09-12T12:23:47.187308+0000","last_undegraded":"2024-09-12T12:23:47.187308+0000","last_fullsized":"2024-09-12T12:23:47.187308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071580+0000","last_change":"2024-09-12T12:23:03.381773+0000","last_active":"2024-09-12T12:23:35.071580+0000","last_peered":"2024-09-12T12:23:35.071580+0000","last_clean":"2024-09-12T12:23:35.071580+0000","last_became_active":"2024-09-12T12:23:03.378442+0000","last_became_peered":"2024-09-12T12:23:03.378442+0000","last_unstale":"2024-09-12T12:23:35.071580+0000","last_undegraded":"2024-09-12T12:23:35.071580+0000","last_fullsized":"2024-09-12T12:23:35.071580+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.570787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072377+0000","last_change":"2024-09-12T12:22:54.310010+0000","last_active":"2024-09-12T12:23:35.072377+0000","last_peered":"2024-09-12T12:23:35.072377+0000","last_clean":"2024-09-12T12:23:35.072377+0000","last_became_active":"2024-09-12T12:22:54.309499+0000","last_became_peered":"2024-09-12T12:22:54.309499+0000","last_unstale":"2024-09-12T12:23:35.072377+0000","last_undegraded":"2024-09-12T12:23:35.072377+0000","last_fullsized":"2024-09-12T12:23:35.072377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.456842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:44.139168+0000","last_change":"2024-09-12T12:22:51.990294+0000","last_active":"2024-09-12T12:23:44.139168+0000","last_peered":"2024-09-12T12:23:44.139168+0000","last_clean":"2024-09-12T12:23:44.139168+0000","last_became_active":"2024-09-12T12:22:51.989925+0000","last_became_peered":"2024-09-12T12:22:51.989925+0000","last_unstale":"2024-09-12T12:23:44.139168+0000","last_undegraded":"2024-09-12T12:23:44.139168+0000","last_fullsized":"2024-09-12T12:23:44.139168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:56.754802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077723+0000","last_change":"2024-09-12T12:23:03.780256+0000","last_active":"2024-09-12T12:23:35.077723+0000","last_peered":"2024-09-12T12:23:35.077723+0000","last_clean":"2024-09-12T12:23:35.077723+0000","last_became_active":"2024-09-12T12:23:03.779808+0000","last_became_peered":"2024-09-12T12:23:03.779808+0000","last_unstale":"2024-09-12T12:23:35.077723+0000","last_undegraded":"2024-09-12T12:23:35.077723+0000","last_fullsized":"2024-09-12T12:23:35.077723+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:58.236749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.084287+0000","last_change":"2024-09-12T12:23:35.084287+0000","last_active":"2024-09-12T12:23:35.084287+0000","last_peered":"2024-09-12T12:23:35.084287+0000","last_clean":"2024-09-12T12:23:35.084287+0000","last_became_active":"2024-09-12T12:23:35.083828+0000","last_became_peered":"2024-09-12T12:23:35.083828+0000","last_unstale":"2024-09-12T12:23:35.084287+0000","last_undegraded":"2024-09-12T12:23:35.084287+0000","last_fullsized":"2024-09-12T12:23:35.084287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:36.183575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186235+0000","last_change":"2024-09-12T12:22:52.557264+0000","last_active":"2024-09-12T12:23:47.186235+0000","last_peered":"2024-09-12T12:23:47.186235+0000","last_clean":"2024-09-12T12:23:47.186235+0000","last_became_active":"2024-09-12T12:22:52.556783+0000","last_became_peered":"2024-09-12T12:22:52.556783+0000","last_unstale":"2024-09-12T12:23:47.186235+0000","last_undegraded":"2024-09-12T12:23:47.186235+0000","last_fullsized":"2024-09-12T12:23:47.186235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:08.815983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073179+0000","last_change":"2024-09-12T12:23:03.376129+0000","last_active":"2024-09-12T12:23:35.073179+0000","last_peered":"2024-09-12T12:23:35.073179+0000","last_clean":"2024-09-12T12:23:35.073179+0000","last_became_active":"2024-09-12T12:23:03.375200+0000","last_became_peered":"2024-09-12T12:23:03.375200+0000","last_unstale":"2024-09-12T12:23:35.073179+0000","last_undegraded":"2024-09-12T12:23:35.073179+0000","last_fullsized":"2024-09-12T12:23:35.073179+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.418366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118142+0000","last_change":"2024-09-12T12:22:54.314708+0000","last_active":"2024-09-12T12:23:35.118142+0000","last_peered":"2024-09-12T12:23:35.118142+0000","last_clean":"2024-09-12T12:23:35.118142+0000","last_became_active":"2024-09-12T12:22:54.314304+0000","last_became_peered":"2024-09-12T12:22:54.314304+0000","last_unstale":"2024-09-12T12:23:35.118142+0000","last_undegraded":"2024-09-12T12:23:35.118142+0000","last_fullsized":"2024-09-12T12:23:35.118142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:52.198831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:59.318633+0000","last_change":"2024-09-12T12:22:51.846753+0000","last_active":"2024-09-12T12:23:59.318633+0000","last_peered":"2024-09-12T12:23:59.318633+0000","last_clean":"2024-09-12T12:23:59.318633+0000","last_became_active":"2024-09-12T12:22:51.846388+0000","last_became_peered":"2024-09-12T12:22:51.846388+0000","last_unstale":"2024-09-12T12:23:59.318633+0000","last_undegraded":"2024-09-12T12:23:59.318633+0000","last_fullsized":"2024-09-12T12:23:59.318633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:34.511644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117057+0000","last_change":"2024-09-12T12:23:03.779254+0000","last_active":"2024-09-12T12:23:35.117057+0000","last_peered":"2024-09-12T12:23:35.117057+0000","last_clean":"2024-09-12T12:23:35.117057+0000","last_became_active":"2024-09-12T12:23:03.778801+0000","last_became_peered":"2024-09-12T12:23:03.778801+0000","last_unstale":"2024-09-12T12:23:35.117057+0000","last_undegraded":"2024-09-12T12:23:35.117057+0000","last_fullsized":"2024-09-12T12:23:35.117057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079397+0000","last_change":"2024-09-12T12:22:54.312002+0000","last_active":"2024-09-12T12:23:35.079397+0000","last_peered":"2024-09-12T12:23:35.079397+0000","last_clean":"2024-09-12T12:23:35.079397+0000","last_became_active":"2024-09-12T12:22:54.311670+0000","last_became_peered":"2024-09-12T12:22:54.311670+0000","last_unstale":"2024-09-12T12:23:35.079397+0000","last_undegraded":"2024-09-12T12:23:35.079397+0000","last_fullsized":"2024-09-12T12:23:35.079397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:08.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.187657+0000","last_change":"2024-09-12T12:22:51.991983+0000","last_active":"2024-09-12T12:23:47.187657+0000","last_peered":"2024-09-12T12:23:47.187657+0000","last_clean":"2024-09-12T12:23:47.187657+0000","last_became_active":"2024-09-12T12:22:51.991712+0000","last_became_peered":"2024-09-12T12:22:51.991712+0000","last_unstale":"2024-09-12T12:23:47.187657+0000","last_undegraded":"2024-09-12T12:23:47.187657+0000","last_fullsized":"2024-09-12T12:23:47.187657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:07.442638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117451+0000","last_change":"2024-09-12T12:23:03.379901+0000","last_active":"2024-09-12T12:23:35.117451+0000","last_peered":"2024-09-12T12:23:35.117451+0000","last_clean":"2024-09-12T12:23:35.117451+0000","last_became_active":"2024-09-12T12:23:03.379385+0000","last_became_peered":"2024-09-12T12:23:03.379385+0000","last_unstale":"2024-09-12T12:23:35.117451+0000","last_undegraded":"2024-09-12T12:23:35.117451+0000","last_fullsized":"2024-09-12T12:23:35.117451+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:47.939223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074870+0000","last_change":"2024-09-12T12:22:54.316450+0000","last_active":"2024-09-12T12:23:35.074870+0000","last_peered":"2024-09-12T12:23:35.074870+0000","last_clean":"2024-09-12T12:23:35.074870+0000","last_became_active":"2024-09-12T12:22:54.316058+0000","last_became_peered":"2024-09-12T12:22:54.316058+0000","last_unstale":"2024-09-12T12:23:35.074870+0000","last_undegraded":"2024-09-12T12:23:35.074870+0000","last_fullsized":"2024-09-12T12:23:35.074870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:38.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071341+0000","last_change":"2024-09-12T12:22:51.992564+0000","last_active":"2024-09-12T12:23:35.071341+0000","last_peered":"2024-09-12T12:23:35.071341+0000","last_clean":"2024-09-12T12:23:35.071341+0000","last_became_active":"2024-09-12T12:22:51.992012+0000","last_became_peered":"2024-09-12T12:22:51.992012+0000","last_unstale":"2024-09-12T12:23:35.071341+0000","last_undegraded":"2024-09-12T12:23:35.071341+0000","last_fullsized":"2024-09-12T12:23:35.071341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:26.190486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072486+0000","last_change":"2024-09-12T12:23:03.779309+0000","last_active":"2024-09-12T12:23:35.072486+0000","last_peered":"2024-09-12T12:23:35.072486+0000","last_clean":"2024-09-12T12:23:35.072486+0000","last_became_active":"2024-09-12T12:23:03.778812+0000","last_became_peered":"2024-09-12T12:23:03.778812+0000","last_unstale":"2024-09-12T12:23:35.072486+0000","last_undegraded":"2024-09-12T12:23:35.072486+0000","last_fullsized":"2024-09-12T12:23:35.072486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:56.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075512+0000","last_change":"2024-09-12T12:22:54.309745+0000","last_active":"2024-09-12T12:23:35.075512+0000","last_peered":"2024-09-12T12:23:35.075512+0000","last_clean":"2024-09-12T12:23:35.075512+0000","last_became_active":"2024-09-12T12:22:54.309388+0000","last_became_peered":"2024-09-12T12:22:54.309388+0000","last_unstale":"2024-09-12T12:23:35.075512+0000","last_undegraded":"2024-09-12T12:23:35.075512+0000","last_fullsized":"2024-09-12T12:23:35.075512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.268141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.212428+0000","last_change":"2024-09-12T12:22:51.850494+0000","last_active":"2024-09-12T12:24:00.212428+0000","last_peered":"2024-09-12T12:24:00.212428+0000","last_clean":"2024-09-12T12:24:00.212428+0000","last_became_active":"2024-09-12T12:22:51.849071+0000","last_became_peered":"2024-09-12T12:22:51.849071+0000","last_unstale":"2024-09-12T12:24:00.212428+0000","last_undegraded":"2024-09-12T12:24:00.212428+0000","last_fullsized":"2024-09-12T12:24:00.212428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:19.203267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079229+0000","last_change":"2024-09-12T12:23:03.383096+0000","last_active":"2024-09-12T12:23:35.079229+0000","last_peered":"2024-09-12T12:23:35.079229+0000","last_clean":"2024-09-12T12:23:35.079229+0000","last_became_active":"2024-09-12T12:23:03.382261+0000","last_became_peered":"2024-09-12T12:23:03.382261+0000","last_unstale":"2024-09-12T12:23:35.079229+0000","last_undegraded":"2024-09-12T12:23:35.079229+0000","last_fullsized":"2024-09-12T12:23:35.079229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:08.976679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081034+0000","last_change":"2024-09-12T12:23:35.079333+0000","last_active":"2024-09-12T12:23:35.081034+0000","last_peered":"2024-09-12T12:23:35.081034+0000","last_clean":"2024-09-12T12:23:35.081034+0000","last_became_active":"2024-09-12T12:23:35.078908+0000","last_became_peered":"2024-09-12T12:23:35.078908+0000","last_unstale":"2024-09-12T12:23:35.081034+0000","last_undegraded":"2024-09-12T12:23:35.081034+0000","last_fullsized":"2024-09-12T12:23:35.081034+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:55:59.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.210822+0000","last_change":"2024-09-12T12:22:51.990322+0000","last_active":"2024-09-12T12:24:00.210822+0000","last_peered":"2024-09-12T12:24:00.210822+0000","last_clean":"2024-09-12T12:24:00.210822+0000","last_became_active":"2024-09-12T12:22:51.989970+0000","last_became_peered":"2024-09-12T12:22:51.989970+0000","last_unstale":"2024-09-12T12:24:00.210822+0000","last_undegraded":"2024-09-12T12:24:00.210822+0000","last_fullsized":"2024-09-12T12:24:00.210822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:14.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.083806+0000","last_change":"2024-09-12T12:23:35.083806+0000","last_active":"2024-09-12T12:23:35.083806+0000","last_peered":"2024-09-12T12:23:35.083806+0000","last_clean":"2024-09-12T12:23:35.083806+0000","last_became_active":"2024-09-12T12:23:35.083379+0000","last_became_peered":"2024-09-12T12:23:35.083379+0000","last_unstale":"2024-09-12T12:23:35.083806+0000","last_undegraded":"2024-09-12T12:23:35.083806+0000","last_fullsized":"2024-09-12T12:23:35.083806+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:54.146429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078441+0000","last_change":"2024-09-12T12:22:54.305747+0000","last_active":"2024-09-12T12:23:35.078441+0000","last_peered":"2024-09-12T12:23:35.078441+0000","last_clean":"2024-09-12T12:23:35.078441+0000","last_became_active":"2024-09-12T12:22:54.305423+0000","last_became_peered":"2024-09-12T12:22:54.305423+0000","last_unstale":"2024-09-12T12:23:35.078441+0000","last_undegraded":"2024-09-12T12:23:35.078441+0000","last_fullsized":"2024-09-12T12:23:35.078441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.463661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:45.148441+0000","last_change":"2024-09-12T12:22:51.852216+0000","last_active":"2024-09-12T12:23:45.148441+0000","last_peered":"2024-09-12T12:23:45.148441+0000","last_clean":"2024-09-12T12:23:45.148441+0000","last_became_active":"2024-09-12T12:22:51.850495+0000","last_became_peered":"2024-09-12T12:22:51.850495+0000","last_unstale":"2024-09-12T12:23:45.148441+0000","last_undegraded":"2024-09-12T12:23:45.148441+0000","last_fullsized":"2024-09-12T12:23:45.148441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:51.711697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118914+0000","last_change":"2024-09-12T12:23:35.118914+0000","last_active":"2024-09-12T12:23:35.118914+0000","last_peered":"2024-09-12T12:23:35.118914+0000","last_clean":"2024-09-12T12:23:35.118914+0000","last_became_active":"2024-09-12T12:23:35.118411+0000","last_became_peered":"2024-09-12T12:23:35.118411+0000","last_unstale":"2024-09-12T12:23:35.118914+0000","last_undegraded":"2024-09-12T12:23:35.118914+0000","last_fullsized":"2024-09-12T12:23:35.118914+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:08.350538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117531+0000","last_change":"2024-09-12T12:22:54.320573+0000","last_active":"2024-09-12T12:23:35.117531+0000","last_peered":"2024-09-12T12:23:35.117531+0000","last_clean":"2024-09-12T12:23:35.117531+0000","last_became_active":"2024-09-12T12:22:54.320120+0000","last_became_peered":"2024-09-12T12:22:54.320120+0000","last_unstale":"2024-09-12T12:23:35.117531+0000","last_undegraded":"2024-09-12T12:23:35.117531+0000","last_fullsized":"2024-09-12T12:23:35.117531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:35.490584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:48.192125+0000","last_change":"2024-09-12T12:22:51.851098+0000","last_active":"2024-09-12T12:23:48.192125+0000","last_peered":"2024-09-12T12:23:48.192125+0000","last_clean":"2024-09-12T12:23:48.192125+0000","last_became_active":"2024-09-12T12:22:51.850725+0000","last_became_peered":"2024-09-12T12:22:51.850725+0000","last_unstale":"2024-09-12T12:23:48.192125+0000","last_undegraded":"2024-09-12T12:23:48.192125+0000","last_fullsized":"2024-09-12T12:23:48.192125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:18.308742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077342+0000","last_change":"2024-09-12T12:21:34.312000+0000","last_active":"2024-09-12T12:23:35.077342+0000","last_peered":"2024-09-12T12:23:35.077342+0000","last_clean":"2024-09-12T12:23:35.077342+0000","last_became_active":"2024-09-12T12:21:34.311472+0000","last_became_peered":"2024-09-12T12:21:34.311472+0000","last_unstale":"2024-09-12T12:23:35.077342+0000","last_undegraded":"2024-09-12T12:23:35.077342+0000","last_fullsized":"2024-09-12T12:23:35.077342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_clean_scrub_stamp":"2024-09-12T12:17:58.852566+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077576+0000","last_change":"2024-09-12T12:23:03.387802+0000","last_active":"2024-09-12T12:23:35.077576+0000","last_peered":"2024-09-12T12:23:35.077576+0000","last_clean":"2024-09-12T12:23:35.077576+0000","last_became_active":"2024-09-12T12:23:03.387391+0000","last_became_peered":"2024-09-12T12:23:03.387391+0000","last_unstale":"2024-09-12T12:23:35.077576+0000","last_undegraded":"2024-09-12T12:23:35.077576+0000","last_fullsized":"2024-09-12T12:23:35.077576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:24.741915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077820+0000","last_change":"2024-09-12T12:22:54.314326+0000","last_active":"2024-09-12T12:23:35.077820+0000","last_peered":"2024-09-12T12:23:35.077820+0000","last_clean":"2024-09-12T12:23:35.077820+0000","last_became_active":"2024-09-12T12:22:54.313892+0000","last_became_peered":"2024-09-12T12:22:54.313892+0000","last_unstale":"2024-09-12T12:23:35.077820+0000","last_undegraded":"2024-09-12T12:23:35.077820+0000","last_fullsized":"2024-09-12T12:23:35.077820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:50.980891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:00.212315+0000","last_change":"2024-09-12T12:22:52.557126+0000","last_active":"2024-09-12T12:24:00.212315+0000","last_peered":"2024-09-12T12:24:00.212315+0000","last_clean":"2024-09-12T12:24:00.212315+0000","last_became_active":"2024-09-12T12:22:52.556736+0000","last_became_peered":"2024-09-12T12:22:52.556736+0000","last_unstale":"2024-09-12T12:24:00.212315+0000","last_undegraded":"2024-09-12T12:24:00.212315+0000","last_fullsized":"2024-09-12T12:24:00.212315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:09.199871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079363+0000","last_change":"2024-09-12T12:23:03.380117+0000","last_active":"2024-09-12T12:23:35.079363+0000","last_peered":"2024-09-12T12:23:35.079363+0000","last_clean":"2024-09-12T12:23:35.079363+0000","last_became_active":"2024-09-12T12:23:03.379635+0000","last_became_peered":"2024-09-12T12:23:03.379635+0000","last_unstale":"2024-09-12T12:23:35.079363+0000","last_undegraded":"2024-09-12T12:23:35.079363+0000","last_fullsized":"2024-09-12T12:23:35.079363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:23.227681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077268+0000","last_change":"2024-09-12T12:22:54.316010+0000","last_active":"2024-09-12T12:23:35.077268+0000","last_peered":"2024-09-12T12:23:35.077268+0000","last_clean":"2024-09-12T12:23:35.077268+0000","last_became_active":"2024-09-12T12:22:54.315702+0000","last_became_peered":"2024-09-12T12:22:54.315702+0000","last_unstale":"2024-09-12T12:23:35.077268+0000","last_undegraded":"2024-09-12T12:23:35.077268+0000","last_fullsized":"2024-09-12T12:23:35.077268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:52.370650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186564+0000","last_change":"2024-09-12T12:22:51.854456+0000","last_active":"2024-09-12T12:23:47.186564+0000","last_peered":"2024-09-12T12:23:47.186564+0000","last_clean":"2024-09-12T12:23:47.186564+0000","last_became_active":"2024-09-12T12:22:51.854092+0000","last_became_peered":"2024-09-12T12:22:51.854092+0000","last_unstale":"2024-09-12T12:23:47.186564+0000","last_undegraded":"2024-09-12T12:23:47.186564+0000","last_fullsized":"2024-09-12T12:23:47.186564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:57.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081550+0000","last_change":"2024-09-12T12:23:03.390443+0000","last_active":"2024-09-12T12:23:35.081550+0000","last_peered":"2024-09-12T12:23:35.081550+0000","last_clean":"2024-09-12T12:23:35.081550+0000","last_became_active":"2024-09-12T12:23:03.389825+0000","last_became_peered":"2024-09-12T12:23:03.389825+0000","last_unstale":"2024-09-12T12:23:35.081550+0000","last_undegraded":"2024-09-12T12:23:35.081550+0000","last_fullsized":"2024-09-12T12:23:35.081550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.711075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077125+0000","last_change":"2024-09-12T12:22:54.311694+0000","last_active":"2024-09-12T12:23:35.077125+0000","last_peered":"2024-09-12T12:23:35.077125+0000","last_clean":"2024-09-12T12:23:35.077125+0000","last_became_active":"2024-09-12T12:22:54.311381+0000","last_became_peered":"2024-09-12T12:22:54.311381+0000","last_unstale":"2024-09-12T12:23:35.077125+0000","last_undegraded":"2024-09-12T12:23:35.077125+0000","last_fullsized":"2024-09-12T12:23:35.077125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.378495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186369+0000","last_change":"2024-09-12T12:22:51.852126+0000","last_active":"2024-09-12T12:23:47.186369+0000","last_peered":"2024-09-12T12:23:47.186369+0000","last_clean":"2024-09-12T12:23:47.186369+0000","last_became_active":"2024-09-12T12:22:51.851766+0000","last_became_peered":"2024-09-12T12:22:51.851766+0000","last_unstale":"2024-09-12T12:23:47.186369+0000","last_undegraded":"2024-09-12T12:23:47.186369+0000","last_fullsized":"2024-09-12T12:23:47.186369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:37.263329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075396+0000","last_change":"2024-09-12T12:23:03.375569+0000","last_active":"2024-09-12T12:23:35.075396+0000","last_peered":"2024-09-12T12:23:35.075396+0000","last_clean":"2024-09-12T12:23:35.075396+0000","last_became_active":"2024-09-12T12:23:03.375136+0000","last_became_peered":"2024-09-12T12:23:03.375136+0000","last_unstale":"2024-09-12T12:23:35.075396+0000","last_undegraded":"2024-09-12T12:23:35.075396+0000","last_fullsized":"2024-09-12T12:23:35.075396+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:05.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117792+0000","last_change":"2024-09-12T12:22:54.304943+0000","last_active":"2024-09-12T12:23:35.117792+0000","last_peered":"2024-09-12T12:23:35.117792+0000","last_clean":"2024-09-12T12:23:35.117792+0000","last_became_active":"2024-09-12T12:22:54.304573+0000","last_became_peered":"2024-09-12T12:22:54.304573+0000","last_unstale":"2024-09-12T12:23:35.117792+0000","last_undegraded":"2024-09-12T12:23:35.117792+0000","last_fullsized":"2024-09-12T12:23:35.117792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.145358+0000","last_change":"2024-09-12T12:22:51.846998+0000","last_active":"2024-09-12T12:23:47.145358+0000","last_peered":"2024-09-12T12:23:47.145358+0000","last_clean":"2024-09-12T12:23:47.145358+0000","last_became_active":"2024-09-12T12:22:51.846617+0000","last_became_peered":"2024-09-12T12:22:51.846617+0000","last_unstale":"2024-09-12T12:23:47.145358+0000","last_undegraded":"2024-09-12T12:23:47.145358+0000","last_fullsized":"2024-09-12T12:23:47.145358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.428244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074803+0000","last_change":"2024-09-12T12:23:03.383519+0000","last_active":"2024-09-12T12:23:35.074803+0000","last_peered":"2024-09-12T12:23:35.074803+0000","last_clean":"2024-09-12T12:23:35.074803+0000","last_became_active":"2024-09-12T12:23:03.383131+0000","last_became_peered":"2024-09-12T12:23:03.383131+0000","last_unstale":"2024-09-12T12:23:35.074803+0000","last_undegraded":"2024-09-12T12:23:35.074803+0000","last_fullsized":"2024-09-12T12:23:35.074803+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:59.602027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074945+0000","last_change":"2024-09-12T12:22:54.312418+0000","last_active":"2024-09-12T12:23:35.074945+0000","last_peered":"2024-09-12T12:23:35.074945+0000","last_clean":"2024-09-12T12:23:35.074945+0000","last_became_active":"2024-09-12T12:22:54.311932+0000","last_became_peered":"2024-09-12T12:22:54.311932+0000","last_unstale":"2024-09-12T12:23:35.074945+0000","last_undegraded":"2024-09-12T12:23:35.074945+0000","last_fullsized":"2024-09-12T12:23:35.074945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:48.395607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186588+0000","last_change":"2024-09-12T12:22:51.993506+0000","last_active":"2024-09-12T12:23:47.186588+0000","last_peered":"2024-09-12T12:23:47.186588+0000","last_clean":"2024-09-12T12:23:47.186588+0000","last_became_active":"2024-09-12T12:22:51.993204+0000","last_became_peered":"2024-09-12T12:22:51.993204+0000","last_unstale":"2024-09-12T12:23:47.186588+0000","last_undegraded":"2024-09-12T12:23:47.186588+0000","last_fullsized":"2024-09-12T12:23:47.186588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:34.670023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.080742+0000","last_change":"2024-09-12T12:23:03.388552+0000","last_active":"2024-09-12T12:23:35.080742+0000","last_peered":"2024-09-12T12:23:35.080742+0000","last_clean":"2024-09-12T12:23:35.080742+0000","last_became_active":"2024-09-12T12:23:03.388105+0000","last_became_peered":"2024-09-12T12:23:03.388105+0000","last_unstale":"2024-09-12T12:23:35.080742+0000","last_undegraded":"2024-09-12T12:23:35.080742+0000","last_fullsized":"2024-09-12T12:23:35.080742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:08.927714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081015+0000","last_change":"2024-09-12T12:23:35.081015+0000","last_active":"2024-09-12T12:23:35.081015+0000","last_peered":"2024-09-12T12:23:35.081015+0000","last_clean":"2024-09-12T12:23:35.081015+0000","last_became_active":"2024-09-12T12:23:35.080609+0000","last_became_peered":"2024-09-12T12:23:35.080609+0000","last_unstale":"2024-09-12T12:23:35.081015+0000","last_undegraded":"2024-09-12T12:23:35.081015+0000","last_fullsized":"2024-09-12T12:23:35.081015+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:26.700031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.212848+0000","last_change":"2024-09-12T12:22:51.848784+0000","last_active":"2024-09-12T12:24:01.212848+0000","last_peered":"2024-09-12T12:24:01.212848+0000","last_clean":"2024-09-12T12:24:01.212848+0000","last_became_active":"2024-09-12T12:22:51.848255+0000","last_became_peered":"2024-09-12T12:22:51.848255+0000","last_unstale":"2024-09-12T12:24:01.212848+0000","last_undegraded":"2024-09-12T12:24:01.212848+0000","last_fullsized":"2024-09-12T12:24:01.212848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:00.680332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071606+0000","last_change":"2024-09-12T12:23:03.386046+0000","last_active":"2024-09-12T12:23:35.071606+0000","last_peered":"2024-09-12T12:23:35.071606+0000","last_clean":"2024-09-12T12:23:35.071606+0000","last_became_active":"2024-09-12T12:23:03.384264+0000","last_became_peered":"2024-09-12T12:23:03.384264+0000","last_unstale":"2024-09-12T12:23:35.071606+0000","last_undegraded":"2024-09-12T12:23:35.071606+0000","last_fullsized":"2024-09-12T12:23:35.071606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:23.605769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077453+0000","last_change":"2024-09-12T12:22:54.315588+0000","last_active":"2024-09-12T12:23:35.077453+0000","last_peered":"2024-09-12T12:23:35.077453+0000","last_clean":"2024-09-12T12:23:35.077453+0000","last_became_active":"2024-09-12T12:22:54.315216+0000","last_became_peered":"2024-09-12T12:22:54.315216+0000","last_unstale":"2024-09-12T12:23:35.077453+0000","last_undegraded":"2024-09-12T12:23:35.077453+0000","last_fullsized":"2024-09-12T12:23:35.077453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:06.556373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186061+0000","last_change":"2024-09-12T12:22:51.851246+0000","last_active":"2024-09-12T12:23:47.186061+0000","last_peered":"2024-09-12T12:23:47.186061+0000","last_clean":"2024-09-12T12:23:47.186061+0000","last_became_active":"2024-09-12T12:22:51.850963+0000","last_became_peered":"2024-09-12T12:22:51.850963+0000","last_unstale":"2024-09-12T12:23:47.186061+0000","last_undegraded":"2024-09-12T12:23:47.186061+0000","last_fullsized":"2024-09-12T12:23:47.186061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:12.032126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117527+0000","last_change":"2024-09-12T12:23:03.382950+0000","last_active":"2024-09-12T12:23:35.117527+0000","last_peered":"2024-09-12T12:23:35.117527+0000","last_clean":"2024-09-12T12:23:35.117527+0000","last_became_active":"2024-09-12T12:23:03.382503+0000","last_became_peered":"2024-09-12T12:23:03.382503+0000","last_unstale":"2024-09-12T12:23:35.117527+0000","last_undegraded":"2024-09-12T12:23:35.117527+0000","last_fullsized":"2024-09-12T12:23:35.117527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:03.991304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078957+0000","last_change":"2024-09-12T12:22:54.315788+0000","last_active":"2024-09-12T12:23:35.078957+0000","last_peered":"2024-09-12T12:23:35.078957+0000","last_clean":"2024-09-12T12:23:35.078957+0000","last_became_active":"2024-09-12T12:22:54.315343+0000","last_became_peered":"2024-09-12T12:22:54.315343+0000","last_unstale":"2024-09-12T12:23:35.078957+0000","last_undegraded":"2024-09-12T12:23:35.078957+0000","last_fullsized":"2024-09-12T12:23:35.078957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:22.549415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:48.192118+0000","last_change":"2024-09-12T12:22:51.854532+0000","last_active":"2024-09-12T12:23:48.192118+0000","last_peered":"2024-09-12T12:23:48.192118+0000","last_clean":"2024-09-12T12:23:48.192118+0000","last_became_active":"2024-09-12T12:22:51.854206+0000","last_became_peered":"2024-09-12T12:22:51.854206+0000","last_unstale":"2024-09-12T12:23:48.192118+0000","last_undegraded":"2024-09-12T12:23:48.192118+0000","last_fullsized":"2024-09-12T12:23:48.192118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:46.908917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076206+0000","last_change":"2024-09-12T12:23:03.383647+0000","last_active":"2024-09-12T12:23:35.076206+0000","last_peered":"2024-09-12T12:23:35.076206+0000","last_clean":"2024-09-12T12:23:35.076206+0000","last_became_active":"2024-09-12T12:23:03.383094+0000","last_became_peered":"2024-09-12T12:23:03.383094+0000","last_unstale":"2024-09-12T12:23:35.076206+0000","last_undegraded":"2024-09-12T12:23:35.076206+0000","last_fullsized":"2024-09-12T12:23:35.076206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:03.754250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072954+0000","last_change":"2024-09-12T12:22:54.310717+0000","last_active":"2024-09-12T12:23:35.072954+0000","last_peered":"2024-09-12T12:23:35.072954+0000","last_clean":"2024-09-12T12:23:35.072954+0000","last_became_active":"2024-09-12T12:22:54.309485+0000","last_became_peered":"2024-09-12T12:22:54.309485+0000","last_unstale":"2024-09-12T12:23:35.072954+0000","last_undegraded":"2024-09-12T12:23:35.072954+0000","last_fullsized":"2024-09-12T12:23:35.072954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:10.293726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'28","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.212873+0000","last_change":"2024-09-12T12:22:51.856735+0000","last_active":"2024-09-12T12:24:01.212873+0000","last_peered":"2024-09-12T12:24:01.212873+0000","last_clean":"2024-09-12T12:24:01.212873+0000","last_became_active":"2024-09-12T12:22:51.856340+0000","last_became_peered":"2024-09-12T12:22:51.856340+0000","last_unstale":"2024-09-12T12:24:01.212873+0000","last_undegraded":"2024-09-12T12:24:01.212873+0000","last_fullsized":"2024-09-12T12:24:01.212873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:40.727645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":64,"num_write":30,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.070490+0000","last_change":"2024-09-12T12:23:03.379726+0000","last_active":"2024-09-12T12:23:35.070490+0000","last_peered":"2024-09-12T12:23:35.070490+0000","last_clean":"2024-09-12T12:23:35.070490+0000","last_became_active":"2024-09-12T12:23:03.378168+0000","last_became_peered":"2024-09-12T12:23:03.378168+0000","last_unstale":"2024-09-12T12:23:35.070490+0000","last_undegraded":"2024-09-12T12:23:35.070490+0000","last_fullsized":"2024-09-12T12:23:35.070490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.083119+0000","last_change":"2024-09-12T12:23:35.083119+0000","last_active":"2024-09-12T12:23:35.083119+0000","last_peered":"2024-09-12T12:23:35.083119+0000","last_clean":"2024-09-12T12:23:35.083119+0000","last_became_active":"2024-09-12T12:23:35.082800+0000","last_became_peered":"2024-09-12T12:23:35.082800+0000","last_unstale":"2024-09-12T12:23:35.083119+0000","last_undegraded":"2024-09-12T12:23:35.083119+0000","last_fullsized":"2024-09-12T12:23:35.083119+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.717540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:46.173997+0000","last_change":"2024-09-12T12:22:51.989886+0000","last_active":"2024-09-12T12:23:46.173997+0000","last_peered":"2024-09-12T12:23:46.173997+0000","last_clean":"2024-09-12T12:23:46.173997+0000","last_became_active":"2024-09-12T12:22:51.989524+0000","last_became_peered":"2024-09-12T12:22:51.989524+0000","last_unstale":"2024-09-12T12:23:46.173997+0000","last_undegraded":"2024-09-12T12:23:46.173997+0000","last_fullsized":"2024-09-12T12:23:46.173997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:26.409342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.076639+0000","last_change":"2024-09-12T12:23:03.384583+0000","last_active":"2024-09-12T12:23:35.076639+0000","last_peered":"2024-09-12T12:23:35.076639+0000","last_clean":"2024-09-12T12:23:35.076639+0000","last_became_active":"2024-09-12T12:23:03.383639+0000","last_became_peered":"2024-09-12T12:23:03.383639+0000","last_unstale":"2024-09-12T12:23:35.076639+0000","last_undegraded":"2024-09-12T12:23:35.076639+0000","last_fullsized":"2024-09-12T12:23:35.076639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:09.755052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.082352+0000","last_change":"2024-09-12T12:22:54.309874+0000","last_active":"2024-09-12T12:23:35.082352+0000","last_peered":"2024-09-12T12:23:35.082352+0000","last_clean":"2024-09-12T12:23:35.082352+0000","last_became_active":"2024-09-12T12:22:54.309294+0000","last_became_peered":"2024-09-12T12:22:54.309294+0000","last_unstale":"2024-09-12T12:23:35.082352+0000","last_undegraded":"2024-09-12T12:23:35.082352+0000","last_fullsized":"2024-09-12T12:23:35.082352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:50.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186746+0000","last_change":"2024-09-12T12:22:51.849467+0000","last_active":"2024-09-12T12:23:47.186746+0000","last_peered":"2024-09-12T12:23:47.186746+0000","last_clean":"2024-09-12T12:23:47.186746+0000","last_became_active":"2024-09-12T12:22:51.849076+0000","last_became_peered":"2024-09-12T12:22:51.849076+0000","last_unstale":"2024-09-12T12:23:47.186746+0000","last_undegraded":"2024-09-12T12:23:47.186746+0000","last_fullsized":"2024-09-12T12:23:47.186746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:04.821105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.084184+0000","last_change":"2024-09-12T12:23:35.083542+0000","last_active":"2024-09-12T12:23:35.084184+0000","last_peered":"2024-09-12T12:23:35.084184+0000","last_clean":"2024-09-12T12:23:35.084184+0000","last_became_active":"2024-09-12T12:23:35.083095+0000","last_became_peered":"2024-09-12T12:23:35.083095+0000","last_unstale":"2024-09-12T12:23:35.084184+0000","last_undegraded":"2024-09-12T12:23:35.084184+0000","last_fullsized":"2024-09-12T12:23:35.084184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:06.750223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079701+0000","last_change":"2024-09-12T12:22:54.315215+0000","last_active":"2024-09-12T12:23:35.079701+0000","last_peered":"2024-09-12T12:23:35.079701+0000","last_clean":"2024-09-12T12:23:35.079701+0000","last_became_active":"2024-09-12T12:22:54.314879+0000","last_became_peered":"2024-09-12T12:22:54.314879+0000","last_unstale":"2024-09-12T12:23:35.079701+0000","last_undegraded":"2024-09-12T12:23:35.079701+0000","last_fullsized":"2024-09-12T12:23:35.079701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:35.501376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.212760+0000","last_change":"2024-09-12T12:22:51.851461+0000","last_active":"2024-09-12T12:24:01.212760+0000","last_peered":"2024-09-12T12:24:01.212760+0000","last_clean":"2024-09-12T12:24:01.212760+0000","last_became_active":"2024-09-12T12:22:51.851105+0000","last_became_peered":"2024-09-12T12:22:51.851105+0000","last_unstale":"2024-09-12T12:24:01.212760+0000","last_undegraded":"2024-09-12T12:24:01.212760+0000","last_fullsized":"2024-09-12T12:24:01.212760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:42.604983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117222+0000","last_change":"2024-09-12T12:23:03.383308+0000","last_active":"2024-09-12T12:23:35.117222+0000","last_peered":"2024-09-12T12:23:35.117222+0000","last_clean":"2024-09-12T12:23:35.117222+0000","last_became_active":"2024-09-12T12:23:03.382294+0000","last_became_peered":"2024-09-12T12:23:03.382294+0000","last_unstale":"2024-09-12T12:23:35.117222+0000","last_undegraded":"2024-09-12T12:23:35.117222+0000","last_fullsized":"2024-09-12T12:23:35.117222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:43.920306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081620+0000","last_change":"2024-09-12T12:23:03.386850+0000","last_active":"2024-09-12T12:23:35.081620+0000","last_peered":"2024-09-12T12:23:35.081620+0000","last_clean":"2024-09-12T12:23:35.081620+0000","last_became_active":"2024-09-12T12:23:03.386350+0000","last_became_peered":"2024-09-12T12:23:03.386350+0000","last_unstale":"2024-09-12T12:23:35.081620+0000","last_undegraded":"2024-09-12T12:23:35.081620+0000","last_fullsized":"2024-09-12T12:23:35.081620+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.295745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.070233+0000","last_change":"2024-09-12T12:22:54.320709+0000","last_active":"2024-09-12T12:23:35.070233+0000","last_peered":"2024-09-12T12:23:35.070233+0000","last_clean":"2024-09-12T12:23:35.070233+0000","last_became_active":"2024-09-12T12:22:54.320208+0000","last_became_peered":"2024-09-12T12:22:54.320208+0000","last_unstale":"2024-09-12T12:23:35.070233+0000","last_undegraded":"2024-09-12T12:23:35.070233+0000","last_fullsized":"2024-09-12T12:23:35.070233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:45.452449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:47.186784+0000","last_change":"2024-09-12T12:22:51.853047+0000","last_active":"2024-09-12T12:23:47.186784+0000","last_peered":"2024-09-12T12:23:47.186784+0000","last_clean":"2024-09-12T12:23:47.186784+0000","last_became_active":"2024-09-12T12:22:51.852653+0000","last_became_peered":"2024-09-12T12:22:51.852653+0000","last_unstale":"2024-09-12T12:23:47.186784+0000","last_undegraded":"2024-09-12T12:23:47.186784+0000","last_fullsized":"2024-09-12T12:23:47.186784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:39.035009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117686+0000","last_change":"2024-09-12T12:23:03.382997+0000","last_active":"2024-09-12T12:23:35.117686+0000","last_peered":"2024-09-12T12:23:35.117686+0000","last_clean":"2024-09-12T12:23:35.117686+0000","last_became_active":"2024-09-12T12:23:03.382594+0000","last_became_peered":"2024-09-12T12:23:03.382594+0000","last_unstale":"2024-09-12T12:23:35.117686+0000","last_undegraded":"2024-09-12T12:23:35.117686+0000","last_fullsized":"2024-09-12T12:23:35.117686+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:25.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117695+0000","last_change":"2024-09-12T12:22:54.322595+0000","last_active":"2024-09-12T12:23:35.117695+0000","last_peered":"2024-09-12T12:23:35.117695+0000","last_clean":"2024-09-12T12:23:35.117695+0000","last_became_active":"2024-09-12T12:22:54.320182+0000","last_became_peered":"2024-09-12T12:22:54.320182+0000","last_unstale":"2024-09-12T12:23:35.117695+0000","last_undegraded":"2024-09-12T12:23:35.117695+0000","last_fullsized":"2024-09-12T12:23:35.117695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:45.151420+0000","last_change":"2024-09-12T12:22:51.850045+0000","last_active":"2024-09-12T12:23:45.151420+0000","last_peered":"2024-09-12T12:23:45.151420+0000","last_clean":"2024-09-12T12:23:45.151420+0000","last_became_active":"2024-09-12T12:22:51.849643+0000","last_became_peered":"2024-09-12T12:22:51.849643+0000","last_unstale":"2024-09-12T12:23:45.151420+0000","last_undegraded":"2024-09-12T12:23:45.151420+0000","last_fullsized":"2024-09-12T12:23:45.151420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:18.255368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:46.174327+0000","last_change":"2024-09-12T12:22:51.852692+0000","last_active":"2024-09-12T12:23:46.174327+0000","last_peered":"2024-09-12T12:23:46.174327+0000","last_clean":"2024-09-12T12:23:46.174327+0000","last_became_active":"2024-09-12T12:22:51.852265+0000","last_became_peered":"2024-09-12T12:22:51.852265+0000","last_unstale":"2024-09-12T12:23:46.174327+0000","last_undegraded":"2024-09-12T12:23:46.174327+0000","last_fullsized":"2024-09-12T12:23:46.174327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:55.853073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075682+0000","last_change":"2024-09-12T12:22:54.315519+0000","last_active":"2024-09-12T12:23:35.075682+0000","last_peered":"2024-09-12T12:23:35.075682+0000","last_clean":"2024-09-12T12:23:35.075682+0000","last_became_active":"2024-09-12T12:22:54.315158+0000","last_became_peered":"2024-09-12T12:22:54.315158+0000","last_unstale":"2024-09-12T12:23:35.075682+0000","last_undegraded":"2024-09-12T12:23:35.075682+0000","last_fullsized":"2024-09-12T12:23:35.075682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073601+0000","last_change":"2024-09-12T12:23:03.383443+0000","last_active":"2024-09-12T12:23:35.073601+0000","last_peered":"2024-09-12T12:23:35.073601+0000","last_clean":"2024-09-12T12:23:35.073601+0000","last_became_active":"2024-09-12T12:23:03.382865+0000","last_became_peered":"2024-09-12T12:23:03.382865+0000","last_unstale":"2024-09-12T12:23:35.073601+0000","last_undegraded":"2024-09-12T12:23:35.073601+0000","last_fullsized":"2024-09-12T12:23:35.073601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:26.339910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:24:01.213584+0000","last_change":"2024-09-12T12:22:51.849963+0000","last_active":"2024-09-12T12:24:01.213584+0000","last_peered":"2024-09-12T12:24:01.213584+0000","last_clean":"2024-09-12T12:24:01.213584+0000","last_became_active":"2024-09-12T12:22:51.849596+0000","last_became_peered":"2024-09-12T12:22:51.849596+0000","last_unstale":"2024-09-12T12:24:01.213584+0000","last_undegraded":"2024-09-12T12:24:01.213584+0000","last_fullsized":"2024-09-12T12:24:01.213584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:48.695657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072511+0000","last_change":"2024-09-12T12:22:54.312543+0000","last_active":"2024-09-12T12:23:35.072511+0000","last_peered":"2024-09-12T12:23:35.072511+0000","last_clean":"2024-09-12T12:23:35.072511+0000","last_became_active":"2024-09-12T12:22:54.312154+0000","last_became_peered":"2024-09-12T12:22:54.312154+0000","last_unstale":"2024-09-12T12:23:35.072511+0000","last_undegraded":"2024-09-12T12:23:35.072511+0000","last_fullsized":"2024-09-12T12:23:35.072511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:28.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073680+0000","last_change":"2024-09-12T12:23:03.376938+0000","last_active":"2024-09-12T12:23:35.073680+0000","last_peered":"2024-09-12T12:23:35.073680+0000","last_clean":"2024-09-12T12:23:35.073680+0000","last_became_active":"2024-09-12T12:23:03.376450+0000","last_became_peered":"2024-09-12T12:23:03.376450+0000","last_unstale":"2024-09-12T12:23:35.073680+0000","last_undegraded":"2024-09-12T12:23:35.073680+0000","last_fullsized":"2024-09-12T12:23:35.073680+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:35.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117421+0000","last_change":"2024-09-12T12:22:54.305562+0000","last_active":"2024-09-12T12:23:35.117421+0000","last_peered":"2024-09-12T12:23:35.117421+0000","last_clean":"2024-09-12T12:23:35.117421+0000","last_became_active":"2024-09-12T12:22:54.305208+0000","last_became_peered":"2024-09-12T12:22:54.305208+0000","last_unstale":"2024-09-12T12:23:35.117421+0000","last_undegraded":"2024-09-12T12:23:35.117421+0000","last_fullsized":"2024-09-12T12:23:35.117421+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:46.643949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073480+0000","last_change":"2024-09-12T12:22:54.310634+0000","last_active":"2024-09-12T12:23:35.073480+0000","last_peered":"2024-09-12T12:23:35.073480+0000","last_clean":"2024-09-12T12:23:35.073480+0000","last_became_active":"2024-09-12T12:22:54.310194+0000","last_became_peered":"2024-09-12T12:22:54.310194+0000","last_unstale":"2024-09-12T12:23:35.073480+0000","last_undegraded":"2024-09-12T12:23:35.073480+0000","last_fullsized":"2024-09-12T12:23:35.073480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:05.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074474+0000","last_change":"2024-09-12T12:22:54.315119+0000","last_active":"2024-09-12T12:23:35.074474+0000","last_peered":"2024-09-12T12:23:35.074474+0000","last_clean":"2024-09-12T12:23:35.074474+0000","last_became_active":"2024-09-12T12:22:54.314729+0000","last_became_peered":"2024-09-12T12:22:54.314729+0000","last_unstale":"2024-09-12T12:23:35.074474+0000","last_undegraded":"2024-09-12T12:23:35.074474+0000","last_fullsized":"2024-09-12T12:23:35.074474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:07.888005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.083672+0000","last_change":"2024-09-12T12:23:35.083672+0000","last_active":"2024-09-12T12:23:35.083672+0000","last_peered":"2024-09-12T12:23:35.083672+0000","last_clean":"2024-09-12T12:23:35.083672+0000","last_became_active":"2024-09-12T12:23:35.083222+0000","last_became_peered":"2024-09-12T12:23:35.083222+0000","last_unstale":"2024-09-12T12:23:35.083672+0000","last_undegraded":"2024-09-12T12:23:35.083672+0000","last_fullsized":"2024-09-12T12:23:35.083672+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079376+0000","last_change":"2024-09-12T12:22:54.321649+0000","last_active":"2024-09-12T12:23:35.079376+0000","last_peered":"2024-09-12T12:23:35.079376+0000","last_clean":"2024-09-12T12:23:35.079376+0000","last_became_active":"2024-09-12T12:22:54.320859+0000","last_became_peered":"2024-09-12T12:22:54.320859+0000","last_unstale":"2024-09-12T12:23:35.079376+0000","last_undegraded":"2024-09-12T12:23:35.079376+0000","last_fullsized":"2024-09-12T12:23:35.079376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:49.706632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117723+0000","last_change":"2024-09-12T12:22:54.306900+0000","last_active":"2024-09-12T12:23:35.117723+0000","last_peered":"2024-09-12T12:23:35.117723+0000","last_clean":"2024-09-12T12:23:35.117723+0000","last_became_active":"2024-09-12T12:22:54.306432+0000","last_became_peered":"2024-09-12T12:22:54.306432+0000","last_unstale":"2024-09-12T12:23:35.117723+0000","last_undegraded":"2024-09-12T12:23:35.117723+0000","last_fullsized":"2024-09-12T12:23:35.117723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:07.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074149+0000","last_change":"2024-09-12T12:22:54.318123+0000","last_active":"2024-09-12T12:23:35.074149+0000","last_peered":"2024-09-12T12:23:35.074149+0000","last_clean":"2024-09-12T12:23:35.074149+0000","last_became_active":"2024-09-12T12:22:54.317820+0000","last_became_peered":"2024-09-12T12:22:54.317820+0000","last_unstale":"2024-09-12T12:23:35.074149+0000","last_undegraded":"2024-09-12T12:23:35.074149+0000","last_fullsized":"2024-09-12T12:23:35.074149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:19.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.118129+0000","last_change":"2024-09-12T12:22:54.318029+0000","last_active":"2024-09-12T12:23:35.118129+0000","last_peered":"2024-09-12T12:23:35.118129+0000","last_clean":"2024-09-12T12:23:35.118129+0000","last_became_active":"2024-09-12T12:22:54.316015+0000","last_became_peered":"2024-09-12T12:22:54.316015+0000","last_unstale":"2024-09-12T12:23:35.118129+0000","last_undegraded":"2024-09-12T12:23:35.118129+0000","last_fullsized":"2024-09-12T12:23:35.118129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075580+0000","last_change":"2024-09-12T12:22:54.325688+0000","last_active":"2024-09-12T12:23:35.075580+0000","last_peered":"2024-09-12T12:23:35.075580+0000","last_clean":"2024-09-12T12:23:35.075580+0000","last_became_active":"2024-09-12T12:22:54.325375+0000","last_became_peered":"2024-09-12T12:22:54.325375+0000","last_unstale":"2024-09-12T12:23:35.075580+0000","last_undegraded":"2024-09-12T12:23:35.075580+0000","last_fullsized":"2024-09-12T12:23:35.075580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:43.971575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117350+0000","last_change":"2024-09-12T12:22:54.315713+0000","last_active":"2024-09-12T12:23:35.117350+0000","last_peered":"2024-09-12T12:23:35.117350+0000","last_clean":"2024-09-12T12:23:35.117350+0000","last_became_active":"2024-09-12T12:22:54.315401+0000","last_became_peered":"2024-09-12T12:22:54.315401+0000","last_unstale":"2024-09-12T12:23:35.117350+0000","last_undegraded":"2024-09-12T12:23:35.117350+0000","last_fullsized":"2024-09-12T12:23:35.117350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:35:31.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079533+0000","last_change":"2024-09-12T12:22:54.314543+0000","last_active":"2024-09-12T12:23:35.079533+0000","last_peered":"2024-09-12T12:23:35.079533+0000","last_clean":"2024-09-12T12:23:35.079533+0000","last_became_active":"2024-09-12T12:22:54.314216+0000","last_became_peered":"2024-09-12T12:22:54.314216+0000","last_unstale":"2024-09-12T12:23:35.079533+0000","last_undegraded":"2024-09-12T12:23:35.079533+0000","last_fullsized":"2024-09-12T12:23:35.079533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:12.180355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079623+0000","last_change":"2024-09-12T12:22:54.313637+0000","last_active":"2024-09-12T12:23:35.079623+0000","last_peered":"2024-09-12T12:23:35.079623+0000","last_clean":"2024-09-12T12:23:35.079623+0000","last_became_active":"2024-09-12T12:22:54.313327+0000","last_became_peered":"2024-09-12T12:22:54.313327+0000","last_unstale":"2024-09-12T12:23:35.079623+0000","last_undegraded":"2024-09-12T12:23:35.079623+0000","last_fullsized":"2024-09-12T12:23:35.079623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:24.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117542+0000","last_change":"2024-09-12T12:22:54.306018+0000","last_active":"2024-09-12T12:23:35.117542+0000","last_peered":"2024-09-12T12:23:35.117542+0000","last_clean":"2024-09-12T12:23:35.117542+0000","last_became_active":"2024-09-12T12:22:54.305683+0000","last_became_peered":"2024-09-12T12:22:54.305683+0000","last_unstale":"2024-09-12T12:23:35.117542+0000","last_undegraded":"2024-09-12T12:23:35.117542+0000","last_fullsized":"2024-09-12T12:23:35.117542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:00.464765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.073880+0000","last_change":"2024-09-12T12:22:54.319169+0000","last_active":"2024-09-12T12:23:35.073880+0000","last_peered":"2024-09-12T12:23:35.073880+0000","last_clean":"2024-09-12T12:23:35.073880+0000","last_became_active":"2024-09-12T12:22:54.318831+0000","last_became_peered":"2024-09-12T12:22:54.318831+0000","last_unstale":"2024-09-12T12:23:35.073880+0000","last_undegraded":"2024-09-12T12:23:35.073880+0000","last_fullsized":"2024-09-12T12:23:35.073880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:42.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.071633+0000","last_change":"2024-09-12T12:22:54.305760+0000","last_active":"2024-09-12T12:23:35.071633+0000","last_peered":"2024-09-12T12:23:35.071633+0000","last_clean":"2024-09-12T12:23:35.071633+0000","last_became_active":"2024-09-12T12:22:54.305455+0000","last_became_peered":"2024-09-12T12:22:54.305455+0000","last_unstale":"2024-09-12T12:23:35.071633+0000","last_undegraded":"2024-09-12T12:23:35.071633+0000","last_fullsized":"2024-09-12T12:23:35.071633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:54.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117932+0000","last_change":"2024-09-12T12:22:54.311420+0000","last_active":"2024-09-12T12:23:35.117932+0000","last_peered":"2024-09-12T12:23:35.117932+0000","last_clean":"2024-09-12T12:23:35.117932+0000","last_became_active":"2024-09-12T12:22:54.311072+0000","last_became_peered":"2024-09-12T12:22:54.311072+0000","last_unstale":"2024-09-12T12:23:35.117932+0000","last_undegraded":"2024-09-12T12:23:35.117932+0000","last_fullsized":"2024-09-12T12:23:35.117932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:54.476587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078825+0000","last_change":"2024-09-12T12:22:54.313093+0000","last_active":"2024-09-12T12:23:35.078825+0000","last_peered":"2024-09-12T12:23:35.078825+0000","last_clean":"2024-09-12T12:23:35.078825+0000","last_became_active":"2024-09-12T12:22:54.312220+0000","last_became_peered":"2024-09-12T12:22:54.312220+0000","last_unstale":"2024-09-12T12:23:35.078825+0000","last_undegraded":"2024-09-12T12:23:35.078825+0000","last_fullsized":"2024-09-12T12:23:35.078825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:33.241798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081126+0000","last_change":"2024-09-12T12:22:54.310536+0000","last_active":"2024-09-12T12:23:35.081126+0000","last_peered":"2024-09-12T12:23:35.081126+0000","last_clean":"2024-09-12T12:23:35.081126+0000","last_became_active":"2024-09-12T12:22:54.310203+0000","last_became_peered":"2024-09-12T12:22:54.310203+0000","last_unstale":"2024-09-12T12:23:35.081126+0000","last_undegraded":"2024-09-12T12:23:35.081126+0000","last_fullsized":"2024-09-12T12:23:35.081126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:40.957367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081396+0000","last_change":"2024-09-12T12:22:54.312898+0000","last_active":"2024-09-12T12:23:35.081396+0000","last_peered":"2024-09-12T12:23:35.081396+0000","last_clean":"2024-09-12T12:23:35.081396+0000","last_became_active":"2024-09-12T12:22:54.312449+0000","last_became_peered":"2024-09-12T12:22:54.312449+0000","last_unstale":"2024-09-12T12:23:35.081396+0000","last_undegraded":"2024-09-12T12:23:35.081396+0000","last_fullsized":"2024-09-12T12:23:35.081396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:57.384949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079431+0000","last_change":"2024-09-12T12:22:54.312206+0000","last_active":"2024-09-12T12:23:35.079431+0000","last_peered":"2024-09-12T12:23:35.079431+0000","last_clean":"2024-09-12T12:23:35.079431+0000","last_became_active":"2024-09-12T12:22:54.311187+0000","last_became_peered":"2024-09-12T12:22:54.311187+0000","last_unstale":"2024-09-12T12:23:35.079431+0000","last_undegraded":"2024-09-12T12:23:35.079431+0000","last_fullsized":"2024-09-12T12:23:35.079431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:22.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077572+0000","last_change":"2024-09-12T12:22:54.312083+0000","last_active":"2024-09-12T12:23:35.077572+0000","last_peered":"2024-09-12T12:23:35.077572+0000","last_clean":"2024-09-12T12:23:35.077572+0000","last_became_active":"2024-09-12T12:22:54.310716+0000","last_became_peered":"2024-09-12T12:22:54.310716+0000","last_unstale":"2024-09-12T12:23:35.077572+0000","last_undegraded":"2024-09-12T12:23:35.077572+0000","last_fullsized":"2024-09-12T12:23:35.077572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:22.717416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077718+0000","last_change":"2024-09-12T12:22:54.315088+0000","last_active":"2024-09-12T12:23:35.077718+0000","last_peered":"2024-09-12T12:23:35.077718+0000","last_clean":"2024-09-12T12:23:35.077718+0000","last_became_active":"2024-09-12T12:22:54.314601+0000","last_became_peered":"2024-09-12T12:22:54.314601+0000","last_unstale":"2024-09-12T12:23:35.077718+0000","last_undegraded":"2024-09-12T12:23:35.077718+0000","last_fullsized":"2024-09-12T12:23:35.077718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:35.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.075474+0000","last_change":"2024-09-12T12:22:54.305332+0000","last_active":"2024-09-12T12:23:35.075474+0000","last_peered":"2024-09-12T12:23:35.075474+0000","last_clean":"2024-09-12T12:23:35.075474+0000","last_became_active":"2024-09-12T12:22:54.305017+0000","last_became_peered":"2024-09-12T12:22:54.305017+0000","last_unstale":"2024-09-12T12:23:35.075474+0000","last_undegraded":"2024-09-12T12:23:35.075474+0000","last_fullsized":"2024-09-12T12:23:35.075474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:16.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.079859+0000","last_change":"2024-09-12T12:22:54.319768+0000","last_active":"2024-09-12T12:23:35.079859+0000","last_peered":"2024-09-12T12:23:35.079859+0000","last_clean":"2024-09-12T12:23:35.079859+0000","last_became_active":"2024-09-12T12:22:54.319451+0000","last_became_peered":"2024-09-12T12:22:54.319451+0000","last_unstale":"2024-09-12T12:23:35.079859+0000","last_undegraded":"2024-09-12T12:23:35.079859+0000","last_fullsized":"2024-09-12T12:23:35.079859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:56.368891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117257+0000","last_change":"2024-09-12T12:22:54.323162+0000","last_active":"2024-09-12T12:23:35.117257+0000","last_peered":"2024-09-12T12:23:35.117257+0000","last_clean":"2024-09-12T12:23:35.117257+0000","last_became_active":"2024-09-12T12:22:54.322068+0000","last_became_peered":"2024-09-12T12:22:54.322068+0000","last_unstale":"2024-09-12T12:23:35.117257+0000","last_undegraded":"2024-09-12T12:23:35.117257+0000","last_fullsized":"2024-09-12T12:23:35.117257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:54.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.077816+0000","last_change":"2024-09-12T12:22:54.306125+0000","last_active":"2024-09-12T12:23:35.077816+0000","last_peered":"2024-09-12T12:23:35.077816+0000","last_clean":"2024-09-12T12:23:35.077816+0000","last_became_active":"2024-09-12T12:22:54.305790+0000","last_became_peered":"2024-09-12T12:22:54.305790+0000","last_unstale":"2024-09-12T12:23:35.077816+0000","last_undegraded":"2024-09-12T12:23:35.077816+0000","last_fullsized":"2024-09-12T12:23:35.077816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:36.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.074924+0000","last_change":"2024-09-12T12:22:54.305099+0000","last_active":"2024-09-12T12:23:35.074924+0000","last_peered":"2024-09-12T12:23:35.074924+0000","last_clean":"2024-09-12T12:23:35.074924+0000","last_became_active":"2024-09-12T12:22:54.304649+0000","last_became_peered":"2024-09-12T12:22:54.304649+0000","last_unstale":"2024-09-12T12:23:35.074924+0000","last_undegraded":"2024-09-12T12:23:35.074924+0000","last_fullsized":"2024-09-12T12:23:35.074924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:05.771434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.072804+0000","last_change":"2024-09-12T12:22:54.319247+0000","last_active":"2024-09-12T12:23:35.072804+0000","last_peered":"2024-09-12T12:23:35.072804+0000","last_clean":"2024-09-12T12:23:35.072804+0000","last_became_active":"2024-09-12T12:22:54.318894+0000","last_became_peered":"2024-09-12T12:22:54.318894+0000","last_unstale":"2024-09-12T12:23:35.072804+0000","last_undegraded":"2024-09-12T12:23:35.072804+0000","last_fullsized":"2024-09-12T12:23:35.072804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:55.692071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.078218+0000","last_change":"2024-09-12T12:23:35.076997+0000","last_active":"2024-09-12T12:23:35.078218+0000","last_peered":"2024-09-12T12:23:35.078218+0000","last_clean":"2024-09-12T12:23:35.078218+0000","last_became_active":"2024-09-12T12:23:35.076506+0000","last_became_peered":"2024-09-12T12:23:35.076506+0000","last_unstale":"2024-09-12T12:23:35.078218+0000","last_undegraded":"2024-09-12T12:23:35.078218+0000","last_fullsized":"2024-09-12T12:23:35.078218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081709+0000","last_change":"2024-09-12T12:22:54.314298+0000","last_active":"2024-09-12T12:23:35.081709+0000","last_peered":"2024-09-12T12:23:35.081709+0000","last_clean":"2024-09-12T12:23:35.081709+0000","last_became_active":"2024-09-12T12:22:54.311726+0000","last_became_peered":"2024-09-12T12:22:54.311726+0000","last_unstale":"2024-09-12T12:23:35.081709+0000","last_undegraded":"2024-09-12T12:23:35.081709+0000","last_fullsized":"2024-09-12T12:23:35.081709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:13.298082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.081628+0000","last_change":"2024-09-12T12:22:54.304397+0000","last_active":"2024-09-12T12:23:35.081628+0000","last_peered":"2024-09-12T12:23:35.081628+0000","last_clean":"2024-09-12T12:23:35.081628+0000","last_became_active":"2024-09-12T12:22:54.304048+0000","last_became_peered":"2024-09-12T12:22:54.304048+0000","last_unstale":"2024-09-12T12:23:35.081628+0000","last_undegraded":"2024-09-12T12:23:35.081628+0000","last_fullsized":"2024-09-12T12:23:35.081628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:13.518433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T12:23:35.117892+0000","last_change":"2024-09-12T12:22:54.312229+0000","last_active":"2024-09-12T12:23:35.117892+0000","last_peered":"2024-09-12T12:23:35.117892+0000","last_clean":"2024-09-12T12:23:35.117892+0000","last_became_active":"2024-09-12T12:22:54.311806+0000","last_became_peered":"2024-09-12T12:22:54.311806+0000","last_unstale":"2024-09-12T12:23:35.117892+0000","last_undegraded":"2024-09-12T12:23:35.117892+0000","last_fullsized":"2024-09-12T12:23:35.117892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:28.865595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55913,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":178,"num_read_kb":151,"num_write":234,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":167739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1044480,"data_stored":514144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1153761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":513681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135916,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":514059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36968,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708184,"statfs":{"total":95995035648,"available":95957180416,"internally_reserved":0,"allocated":1662976,"data_stored":1110165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561078,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":509185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36976,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708176,"statfs":{"total":95995035648,"available":95957172224,"internally_reserved":0,"allocated":1671168,"data_stored":1105747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":513259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":508893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":559926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":559313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":511034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":50850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":50834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:08.445 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T12:24:08.446 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T12:24:08.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T12:24:08.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:08 smithi154 ceph-mon[35578]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:08.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:08 smithi038 ceph-mon[30810]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:08.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:08 smithi071 ceph-mon[34859]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:08.822 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.377+0000 7f4a2fe00640 1 -- 172.21.15.38:0/2184199977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28103e00 msgr2=0x7f4a28104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.377+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/2184199977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28103e00 0x7f4a28104200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009900 tx=0x7f4a1c02a410 comp rx=0 tx=0).stop 2024-09-12T12:24:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.378+0000 7f4a2fe00640 1 -- 172.21.15.38:0/2184199977 shutdown_connections 2024-09-12T12:24:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.378+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/2184199977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a28105920 0x7f4a2810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.378+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/2184199977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a28104f60 0x7f4a281053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.378+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/2184199977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28103e00 0x7f4a28104200 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.378+0000 7f4a2fe00640 1 -- 172.21.15.38:0/2184199977 >> 172.21.15.38:0/2184199977 conn(0x7f4a280ff5b0 msgr2=0x7f4a281019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.378+0000 7f4a2fe00640 1 -- 172.21.15.38:0/2184199977 shutdown_connections 2024-09-12T12:24:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.378+0000 7f4a2fe00640 1 -- 172.21.15.38:0/2184199977 wait complete. 2024-09-12T12:24:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 Processor -- start 2024-09-12T12:24:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 -- start start 2024-09-12T12:24:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a28103e00 0x7f4a2819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a28104f60 0x7f4a2819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28105920 0x7f4a281a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2810fb00 con 0x7f4a28105920 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2810f980 con 0x7f4a28104f60 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2fe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2810fc80 con 0x7f4a28103e00 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28105920 0x7f4a281a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28105920 0x7f4a281a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33182/0 (socket says 172.21.15.38:33182) 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2de00640 1 -- 172.21.15.38:0/3969104951 learned_addr learned my addr 172.21.15.38:0/3969104951 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2d400640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a28103e00 0x7f4a2819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.379+0000 7f4a2ca00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a28104f60 0x7f4a2819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a2de00640 1 -- 172.21.15.38:0/3969104951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a28103e00 msgr2=0x7f4a2819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a2de00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a28103e00 0x7f4a2819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a2de00640 1 -- 172.21.15.38:0/3969104951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a28104f60 msgr2=0x7f4a2819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a2de00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a28104f60 0x7f4a2819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a2de00640 1 -- 172.21.15.38:0/3969104951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a281a1d00 con 0x7f4a28105920 2024-09-12T12:24:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a2de00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28105920 0x7f4a281a1690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000eb10 tx=0x7f4a2000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a26000640 1 -- 172.21.15.38:0/3969104951 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20004b20 con 0x7f4a28105920 2024-09-12T12:24:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a26000640 1 -- 172.21.15.38:0/3969104951 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a20004cc0 con 0x7f4a28105920 2024-09-12T12:24:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a26000640 1 -- 172.21.15.38:0/3969104951 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20010760 con 0x7f4a28105920 2024-09-12T12:24:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.380+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a281a1ff0 con 0x7f4a28105920 2024-09-12T12:24:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.381+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a281a2450 con 0x7f4a28105920 2024-09-12T12:24:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.382+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2810b120 con 0x7f4a28105920 2024-09-12T12:24:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.384+0000 7f4a26000640 1 -- 172.21.15.38:0/3969104951 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a20010900 con 0x7f4a28105920 2024-09-12T12:24:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.385+0000 7f4a26000640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a100a2c40 0x7f4a100a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.385+0000 7f4a26000640 1 -- 172.21.15.38:0/3969104951 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4a200cfcc0 con 0x7f4a28105920 2024-09-12T12:24:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.385+0000 7f4a2d400640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a100a2c40 0x7f4a100a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.386+0000 7f4a2d400640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a100a2c40 0x7f4a100a5100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c031440 tx=0x7f4a1c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:09.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.387+0000 7f4a26000640 1 -- 172.21.15.38:0/3969104951 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a200541b0 con 0x7f4a28105920 2024-09-12T12:24:09.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.636+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f4a2802d7c0 con 0x7f4a28105920 2024-09-12T12:24:09.637 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:09 smithi038 ceph-mon[30810]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-12T12:24:09.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.643+0000 7f4a26000640 1 -- 172.21.15.38:0/3969104951 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f4a2009c700 con 0x7f4a28105920 2024-09-12T12:24:09.644 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2024-09-12T12:24:09.644 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBp3eJmFnoPJhAAUfoPcBkU8jLZDQ9kWh9exQ== 2024-09-12T12:24:09.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a100a2c40 msgr2=0x7f4a100a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a100a2c40 0x7f4a100a5100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c031440 tx=0x7f4a1c0315b0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28105920 msgr2=0x7f4a281a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28105920 0x7f4a281a1690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000eb10 tx=0x7f4a2000c2d0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 shutdown_connections 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a100a2c40 0x7f4a100a5100 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a28105920 0x7f4a281a1690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a28104f60 0x7f4a2819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 --2- 172.21.15.38:0/3969104951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a28103e00 0x7f4a2819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 >> 172.21.15.38:0/3969104951 conn(0x7f4a280ff5b0 msgr2=0x7f4a281082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 shutdown_connections 2024-09-12T12:24:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:09.646+0000 7f4a2fe00640 1 -- 172.21.15.38:0/3969104951 wait complete. 2024-09-12T12:24:09.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:09 smithi154 ceph-mon[35578]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-12T12:24:09.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:09 smithi071 ceph-mon[34859]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-12T12:24:10.419 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:24:10.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T12:24:10.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T12:24:10.500 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T12:24:10.500 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T12:24:10.500 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T12:24:10.589 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:10 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3969104951' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:24:10.589 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:10 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3969104951' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:24:10.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:10 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3969104951' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:24:10.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:10 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3969104951' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:24:10.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:10 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3969104951' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:24:10.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:10 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3969104951' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:24:10.931 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.527+0000 7f64c8c00640 1 -- 172.21.15.38:0/2012156669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 msgr2=0x7f64c41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.527+0000 7f64c8c00640 1 --2- 172.21.15.38:0/2012156669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 0x7f64c41089f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009900 tx=0x7f64b002a410 comp rx=0 tx=0).stop 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.527+0000 7f64c8c00640 1 -- 172.21.15.38:0/2012156669 shutdown_connections 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.527+0000 7f64c8c00640 1 --2- 172.21.15.38:0/2012156669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4109120 0x7f64c4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.527+0000 7f64c8c00640 1 --2- 172.21.15.38:0/2012156669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 0x7f64c41089f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.527+0000 7f64c8c00640 1 --2- 172.21.15.38:0/2012156669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c4103ff0 0x7f64c41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.528+0000 7f64c8c00640 1 -- 172.21.15.38:0/2012156669 >> 172.21.15.38:0/2012156669 conn(0x7f64c40ffa90 msgr2=0x7f64c4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.528+0000 7f64c8c00640 1 -- 172.21.15.38:0/2012156669 shutdown_connections 2024-09-12T12:24:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.528+0000 7f64c8c00640 1 -- 172.21.15.38:0/2012156669 wait complete. 2024-09-12T12:24:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 Processor -- start 2024-09-12T12:24:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 -- start start 2024-09-12T12:24:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4103ff0 0x7f64c419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 0x7f64c419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c4109120 0x7f64c419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4114190 con 0x7f64c41049a0 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4114010 con 0x7f64c4103ff0 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c8c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4114310 con 0x7f64c4109120 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c1400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 0x7f64c419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4103ff0 0x7f64c419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c1400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 0x7f64c419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33192/0 (socket says 172.21.15.38:33192) 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c1400640 1 -- 172.21.15.38:0/1450451654 learned_addr learned my addr 172.21.15.38:0/1450451654 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.529+0000 7f64c1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4103ff0 0x7f64c419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:35296/0 (socket says 172.21.15.38:35296) 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64c2800640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c4109120 0x7f64c419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64c1e00640 1 -- 172.21.15.38:0/1450451654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c4109120 msgr2=0x7f64c419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64c1e00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c4109120 0x7f64c419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64c1e00640 1 -- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 msgr2=0x7f64c419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64c1e00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 0x7f64c419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64c1e00640 1 -- 172.21.15.38:0/1450451654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c419f5c0 con 0x7f64c4103ff0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64c1e00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4103ff0 0x7f64c419a610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f64b400e9f0 tx=0x7f64b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.530+0000 7f64baa00640 1 -- 172.21.15.38:0/1450451654 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b400ccc0 con 0x7f64c4103ff0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.531+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c419f8b0 con 0x7f64c4103ff0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.531+0000 7f64baa00640 1 -- 172.21.15.38:0/1450451654 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64b4005020 con 0x7f64c4103ff0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.531+0000 7f64baa00640 1 -- 172.21.15.38:0/1450451654 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b40049e0 con 0x7f64c4103ff0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.531+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c41a7190 con 0x7f64c4103ff0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.532+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c41043d0 con 0x7f64c4103ff0 2024-09-12T12:24:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.534+0000 7f64baa00640 1 -- 172.21.15.38:0/1450451654 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f64b4005560 con 0x7f64c4103ff0 2024-09-12T12:24:11.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.535+0000 7f64baa00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f64a80a2c90 0x7f64a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.535+0000 7f64baa00640 1 -- 172.21.15.38:0/1450451654 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f64b40cf470 con 0x7f64c4103ff0 2024-09-12T12:24:11.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.535+0000 7f64c1400640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f64a80a2c90 0x7f64a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.536+0000 7f64c1400640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f64a80a2c90 0x7f64a80a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64b00096c0 tx=0x7f64b00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.537+0000 7f64baa00640 1 -- 172.21.15.38:0/1450451654 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64b40051d0 con 0x7f64c4103ff0 2024-09-12T12:24:11.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:11 smithi038 ceph-mon[30810]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-09-12T12:24:11.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.776+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f64c410c3c0 con 0x7f64c4103ff0 2024-09-12T12:24:11.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.781+0000 7f64baa00640 1 -- 172.21.15.38:0/1450451654 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263201 (secure 0 0 0) 0x7f64b409beb0 con 0x7f64c4103ff0 2024-09-12T12:24:11.786 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f64a80a2c90 msgr2=0x7f64a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f64a80a2c90 0x7f64a80a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64b00096c0 tx=0x7f64b00046c0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4103ff0 msgr2=0x7f64c419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4103ff0 0x7f64c419a610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f64b400e9f0 tx=0x7f64b400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 shutdown_connections 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f64a80a2c90 0x7f64a80a5150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c4109120 0x7f64c419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64c41049a0 0x7f64c419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 --2- 172.21.15.38:0/1450451654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64c4103ff0 0x7f64c419a610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 >> 172.21.15.38:0/1450451654 conn(0x7f64c40ffa90 msgr2=0x7f64c4100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:11.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 shutdown_connections 2024-09-12T12:24:11.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:11.786+0000 7f64c8c00640 1 -- 172.21.15.38:0/1450451654 wait complete. 2024-09-12T12:24:11.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:11 smithi154 ceph-mon[35578]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-09-12T12:24:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:11 smithi071 ceph-mon[34859]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-09-12T12:24:12.583 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1234723065},{"type":"v1","addr":"172.21.15.38:6801","nonce":1234723065}]},"active_addr":"172.21.15.38:6801/1234723065","active_change":"2024-09-12T12:15:33.977060+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.38:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3285851358}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1198574791}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":2864406877}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":4145183514}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3399234432}]}]} 2024-09-12T12:24:12.588 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T12:24:12.588 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T12:24:12.589 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:12.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:12 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1450451654' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:12.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:12 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1450451654' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:24:13.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:12 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1450451654' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:24:13.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 -- 172.21.15.38:0/3073029783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80076720 msgr2=0x7f2b80076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 --2- 172.21.15.38:0/3073029783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80076720 0x7f2b80076b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009900 tx=0x7f2b7402a410 comp rx=0 tx=0).stop 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 -- 172.21.15.38:0/3073029783 shutdown_connections 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 --2- 172.21.15.38:0/3073029783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b80112a30 0x7f2b80114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 --2- 172.21.15.38:0/3073029783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b80077040 0x7f2b801124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 --2- 172.21.15.38:0/3073029783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80076720 0x7f2b80076b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 -- 172.21.15.38:0/3073029783 >> 172.21.15.38:0/3073029783 conn(0x7f2b800ffa90 msgr2=0x7f2b80101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 -- 172.21.15.38:0/3073029783 shutdown_connections 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.520+0000 7f2b88400640 1 -- 172.21.15.38:0/3073029783 wait complete. 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.521+0000 7f2b88400640 1 Processor -- start 2024-09-12T12:24:13.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.521+0000 7f2b88400640 1 -- start start 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b88400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b80076720 0x7f2b801a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b88400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80077040 0x7f2b801a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b88400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b80112a30 0x7f2b8019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b88400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2b80118610 con 0x7f2b80077040 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b88400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b80118490 con 0x7f2b80076720 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b88400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b80118790 con 0x7f2b80112a30 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b85000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80077040 0x7f2b801a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b85a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b80076720 0x7f2b801a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b85a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b80076720 0x7f2b801a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:35318/0 (socket says 172.21.15.38:35318) 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b85a00640 1 -- 172.21.15.38:0/244358408 learned_addr learned my addr 172.21.15.38:0/244358408 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.522+0000 7f2b86400640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b80112a30 0x7f2b8019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b85000640 1 -- 172.21.15.38:0/244358408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b80112a30 msgr2=0x7f2b8019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b85000640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b80112a30 0x7f2b8019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b85000640 1 -- 172.21.15.38:0/244358408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b80076720 msgr2=0x7f2b801a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b85000640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b80076720 0x7f2b801a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b85000640 1 -- 172.21.15.38:0/244358408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8019f000 con 0x7f2b80077040 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b85000640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80077040 0x7f2b801a4c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00e9f0 tx=0x7f2b6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b7e000640 1 -- 172.21.15.38:0/244358408 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00ccc0 con 0x7f2b80077040 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b7e000640 1 -- 172.21.15.38:0/244358408 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b6c005020 con 0x7f2b80077040 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8019f2f0 con 0x7f2b80077040 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.523+0000 7f2b7e000640 1 -- 172.21.15.38:0/244358408 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0049e0 con 0x7f2b80077040 2024-09-12T12:24:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.524+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b801ab5e0 con 0x7f2b80077040 2024-09-12T12:24:13.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.525+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b80076b00 con 0x7f2b80077040 2024-09-12T12:24:13.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.527+0000 7f2b7e000640 1 -- 172.21.15.38:0/244358408 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2b6c005560 con 0x7f2b80077040 2024-09-12T12:24:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.528+0000 7f2b7e000640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b680a2c10 0x7f2b680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.528+0000 7f2b7e000640 1 -- 172.21.15.38:0/244358408 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2b6c0cf510 con 0x7f2b80077040 2024-09-12T12:24:13.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.528+0000 7f2b85a00640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b680a2c10 0x7f2b680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.529+0000 7f2b85a00640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b680a2c10 0x7f2b680a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b740096c0 tx=0x7f2b740046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:13.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.532+0000 7f2b7e000640 1 -- 172.21.15.38:0/244358408 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b6c0051d0 con 0x7f2b80077040 2024-09-12T12:24:13.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.718+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b8002d7c0 con 0x7f2b80077040 2024-09-12T12:24:13.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.720+0000 7f2b7e000640 1 -- 172.21.15.38:0/244358408 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24668 (secure 0 0 0) 0x7f2b6c09bf50 con 0x7f2b80077040 2024-09-12T12:24:13.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:13.721 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":91,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:35.061031+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:13.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b680a2c10 msgr2=0x7f2b680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b680a2c10 0x7f2b680a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b740096c0 tx=0x7f2b740046c0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80077040 msgr2=0x7f2b801a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80077040 0x7f2b801a4c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00e9f0 tx=0x7f2b6c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 shutdown_connections 2024-09-12T12:24:13.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b680a2c10 0x7f2b680a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b80112a30 0x7f2b8019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b80077040 0x7f2b801a4c50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.722+0000 7f2b88400640 1 --2- 172.21.15.38:0/244358408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b80076720 0x7f2b801a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.723+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 >> 172.21.15.38:0/244358408 conn(0x7f2b800ffa90 msgr2=0x7f2b80101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:13.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.723+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 shutdown_connections 2024-09-12T12:24:13.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:13.723+0000 7f2b88400640 1 -- 172.21.15.38:0/244358408 wait complete. 2024-09-12T12:24:13.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:13 smithi154 ceph-mon[35578]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-12T12:24:13.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:13 smithi038 ceph-mon[30810]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-12T12:24:14.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:13 smithi071 ceph-mon[34859]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-12T12:24:14.593 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T12:24:14.593 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:14.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:14 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/244358408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:14.970 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:15.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:14 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/244358408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:15.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:14 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/244358408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 -- 172.21.15.38:0/1741511449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074f40 msgr2=0x7f424810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 --2- 172.21.15.38:0/1741511449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074f40 0x7f424810de80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4234009900 tx=0x7f423402a480 comp rx=0 tx=0).stop 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 -- 172.21.15.38:0/1741511449 shutdown_connections 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 --2- 172.21.15.38:0/1741511449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f424810e3c0 0x7f4248110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 --2- 172.21.15.38:0/1741511449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074f40 0x7f424810de80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 --2- 172.21.15.38:0/1741511449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4248074620 0x7f4248074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 -- 172.21.15.38:0/1741511449 >> 172.21.15.38:0/1741511449 conn(0x7f42480fd8c0 msgr2=0x7f42480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 -- 172.21.15.38:0/1741511449 shutdown_connections 2024-09-12T12:24:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.507+0000 7f424ea00640 1 -- 172.21.15.38:0/1741511449 wait complete. 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 Processor -- start 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 -- start start 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074620 0x7f424819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4248074f40 0x7f424819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424810e3c0 0x7f424819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f42481141b0 con 0x7f4248074620 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4248114030 con 0x7f424810e3c0 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.508+0000 7f424ea00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4248114330 con 0x7f4248074f40 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074620 0x7f424819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074620 0x7f424819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33228/0 (socket says 172.21.15.38:33228) 2024-09-12T12:24:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 -- 172.21.15.38:0/416406412 learned_addr learned my addr 172.21.15.38:0/416406412 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247400640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4248074f40 0x7f424819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f424ca00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424810e3c0 0x7f424819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 -- 172.21.15.38:0/416406412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4248074f40 msgr2=0x7f424819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4248074f40 0x7f424819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 -- 172.21.15.38:0/416406412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424810e3c0 msgr2=0x7f424819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424810e3c0 0x7f424819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.509+0000 7f4247e00640 1 -- 172.21.15.38:0/416406412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424819f620 con 0x7f4248074620 2024-09-12T12:24:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.510+0000 7f4247e00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074620 0x7f424819a670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f423800e9f0 tx=0x7f423800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:15.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.510+0000 7f4244c00640 1 -- 172.21.15.38:0/416406412 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423800cd80 con 0x7f4248074620 2024-09-12T12:24:15.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.510+0000 7f4244c00640 1 -- 172.21.15.38:0/416406412 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4238010910 con 0x7f4248074620 2024-09-12T12:24:15.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.510+0000 7f4244c00640 1 -- 172.21.15.38:0/416406412 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238018990 con 0x7f4248074620 2024-09-12T12:24:15.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.510+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424819f910 con 0x7f4248074620 2024-09-12T12:24:15.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.510+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42481a71f0 con 0x7f4248074620 2024-09-12T12:24:15.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.511+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4248074a00 con 0x7f4248074620 2024-09-12T12:24:15.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.513+0000 7f4244c00640 1 -- 172.21.15.38:0/416406412 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4238010ac0 con 0x7f4248074620 2024-09-12T12:24:15.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.514+0000 7f4244c00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f422c0a2c90 0x7f422c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.514+0000 7f4244c00640 1 -- 172.21.15.38:0/416406412 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f42380cf800 con 0x7f4248074620 2024-09-12T12:24:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.515+0000 7f4247400640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f422c0a2c90 0x7f422c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.515+0000 7f4247400640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f422c0a2c90 0x7f422c0a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4234000c00 tx=0x7f4234005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:15.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.518+0000 7f4244c00640 1 -- 172.21.15.38:0/416406412 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f423809bbf0 con 0x7f4248074620 2024-09-12T12:24:15.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.705+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42481095a0 con 0x7f4248074620 2024-09-12T12:24:15.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.707+0000 7f4244c00640 1 -- 172.21.15.38:0/416406412 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24668 (secure 0 0 0) 0x7f423809fef0 con 0x7f4248074620 2024-09-12T12:24:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:15.708 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":91,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:23:35.061031+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:15.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f422c0a2c90 msgr2=0x7f422c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f422c0a2c90 0x7f422c0a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4234000c00 tx=0x7f4234005b50 comp rx=0 tx=0).stop 2024-09-12T12:24:15.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074620 msgr2=0x7f424819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074620 0x7f424819a670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f423800e9f0 tx=0x7f423800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 shutdown_connections 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f422c0a2c90 0x7f422c0a5150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424810e3c0 0x7f424819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4248074f40 0x7f424819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 --2- 172.21.15.38:0/416406412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4248074620 0x7f424819a670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 >> 172.21.15.38:0/416406412 conn(0x7f42480fd8c0 msgr2=0x7f42480fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 shutdown_connections 2024-09-12T12:24:15.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:15.710+0000 7f424ea00640 1 -- 172.21.15.38:0/416406412 wait complete. 2024-09-12T12:24:15.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:15 smithi038 ceph-mon[30810]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-12T12:24:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:15 smithi071 ceph-mon[34859]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-12T12:24:16.067 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:15 smithi154 ceph-mon[35578]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-12T12:24:16.570 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T12:24:16.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T12:24:16.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T12:24:16.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T12:24:16.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T12:24:16.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T12:24:16.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T12:24:16.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T12:24:16.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T12:24:16.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T12:24:16.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T12:24:16.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T12:24:16.973 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:16 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/416406412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:17.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:16 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/416406412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:17.084 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:16 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/416406412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:17.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:17 smithi038 ceph-mon[30810]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-12T12:24:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:17 smithi071 ceph-mon[34859]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-12T12:24:18.076 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:18.079 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:18.084 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:18.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:17 smithi154 ceph-mon[35578]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 -- 172.21.15.38:0/2866508748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 msgr2=0x7f4a5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 --2- 172.21.15.38:0/2866508748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 0x7f4a5810ea90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009ca0 tx=0x7f4a5002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 -- 172.21.15.38:0/2866508748 shutdown_connections 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 --2- 172.21.15.38:0/2866508748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 0x7f4a5810ea90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 --2- 172.21.15.38:0/2866508748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a58102790 0x7f4a581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 --2- 172.21.15.38:0/2866508748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58101de0 0x7f4a581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 -- 172.21.15.38:0/2866508748 >> 172.21.15.38:0/2866508748 conn(0x7f4a580fd8c0 msgr2=0x7f4a580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 -- 172.21.15.38:0/2866508748 shutdown_connections 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.868+0000 7f4a5ee00640 1 -- 172.21.15.38:0/2866508748 wait complete. 2024-09-12T12:24:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.869+0000 7f4a5ee00640 1 Processor -- start 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.869+0000 7f4a5ee00640 1 -- start start 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.869+0000 7f4a5ee00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58101de0 0x7f4a5819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ee00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a58102790 0x7f4a5819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ee00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 0x7f4a5819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ee00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58111fc0 con 0x7f4a58106f10 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ee00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58111e40 con 0x7f4a58101de0 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ee00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58112140 con 0x7f4a58102790 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 0x7f4a5819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 0x7f4a5819eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54216/0 (socket says 172.21.15.38:54216) 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 -- 172.21.15.38:0/3283388252 learned_addr learned my addr 172.21.15.38:0/3283388252 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a4f400640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a58102790 0x7f4a5819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a57e00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58101de0 0x7f4a5819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 -- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a58102790 msgr2=0x7f4a5819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a58102790 0x7f4a5819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 -- 172.21.15.38:0/3283388252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58101de0 msgr2=0x7f4a5819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58101de0 0x7f4a5819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.870+0000 7f4a5ce00640 1 -- 172.21.15.38:0/3283388252 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5819f580 con 0x7f4a58106f10 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.871+0000 7f4a5ce00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 0x7f4a5819eea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005e30 tx=0x7f4a50003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.871+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50031650 con 0x7f4a58106f10 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.871+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a500317f0 con 0x7f4a58106f10 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.871+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5002f9d0 con 0x7f4a58106f10 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.871+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5819f810 con 0x7f4a58106f10 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.871+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a581a7150 con 0x7f4a58106f10 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.872+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a5810e1b0 con 0x7f4a58106f10 2024-09-12T12:24:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.874+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a5002fb70 con 0x7f4a58106f10 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.875+0000 7f4a55600640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a3c0a2c10 0x7f4a3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.875+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4a500f0a50 con 0x7f4a58106f10 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.875+0000 7f4a57e00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a3c0a2c10 0x7f4a3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.875+0000 7f4a55600640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] conn(0x7f4a3c0adde0 0x7f4a3c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.875+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 --> [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a5000b150 con 0x7f4a3c0adde0 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.875+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f4a500f0e00 con 0x7f4a58106f10 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.876+0000 7f4a4f400640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] conn(0x7f4a3c0adde0 0x7f4a3c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.876+0000 7f4a57e00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a3c0a2c10 0x7f4a3c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009bd0 tx=0x7f4a48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.876+0000 7f4a4f400640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] conn(0x7f4a3c0adde0 0x7f4a3c0b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.877+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== osd.11 v2:172.21.15.154:6824/1742402788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a5000b150 con 0x7f4a3c0adde0 2024-09-12T12:24:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.892+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 --> [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a581032c0 con 0x7f4a3c0adde0 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.892+0000 7f4a55600640 1 -- 172.21.15.38:0/3283388252 <== osd.11 v2:172.21.15.154:6824/1742402788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4a581032c0 con 0x7f4a3c0adde0 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] conn(0x7f4a3c0adde0 msgr2=0x7f4a3c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] conn(0x7f4a3c0adde0 0x7f4a3c0b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a3c0a2c10 msgr2=0x7f4a3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4a3c0a2c10 0x7f4a3c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009bd0 tx=0x7f4a48005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 msgr2=0x7f4a5819eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 --2- 172.21.15.38:0/3283388252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58106f10 0x7f4a5819eea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005e30 tx=0x7f4a50003d00 comp rx=0 tx=0).stop 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ce00640 1 -- 172.21.15.38:0/3283388252 reap_dead start 2024-09-12T12:24:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 shutdown_connections 2024-09-12T12:24:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 >> 172.21.15.38:0/3283388252 conn(0x7f4a580fd8c0 msgr2=0x7f4a580fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 shutdown_connections 2024-09-12T12:24:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:18.893+0000 7f4a5ee00640 1 -- 172.21.15.38:0/3283388252 wait complete. 2024-09-12T12:24:19.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.436+0000 7f7767e00640 1 -- 172.21.15.38:0/2080903167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77681079d0 msgr2=0x7f7768107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.436+0000 7f7767e00640 1 --2- 172.21.15.38:0/2080903167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77681079d0 0x7f7768107db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7758009930 tx=0x7f775802a420 comp rx=0 tx=0).stop 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.437+0000 7f7767e00640 1 -- 172.21.15.38:0/2080903167 shutdown_connections 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.437+0000 7f7767e00640 1 --2- 172.21.15.38:0/2080903167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7768102370 0x7f776810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.437+0000 7f7767e00640 1 --2- 172.21.15.38:0/2080903167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77681019d0 0x7f7768101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.437+0000 7f7767e00640 1 --2- 172.21.15.38:0/2080903167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77681079d0 0x7f7768107db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.437+0000 7f7767e00640 1 -- 172.21.15.38:0/2080903167 >> 172.21.15.38:0/2080903167 conn(0x7f77680fd710 msgr2=0x7f77680ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.437+0000 7f7767e00640 1 -- 172.21.15.38:0/2080903167 shutdown_connections 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.437+0000 7f7767e00640 1 -- 172.21.15.38:0/2080903167 wait complete. 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.438+0000 7f7767e00640 1 Processor -- start 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.438+0000 7f7767e00640 1 -- start start 2024-09-12T12:24:19.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7767e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77681019d0 0x7f776819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7767e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7768102370 0x7f776819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7767e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77681079d0 0x7f776819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7767e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7768111dd0 con 0x7f77681079d0 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7767e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7768111c50 con 0x7f7768102370 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7767e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7768111f50 con 0x7f77681019d0 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7767400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77681079d0 0x7f776819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7768102370 0x7f776819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77681019d0 0x7f776819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7768102370 0x7f776819aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55508/0 (socket says 172.21.15.38:55508) 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 -- 172.21.15.38:0/910679314 learned_addr learned my addr 172.21.15.38:0/910679314 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 -- 172.21.15.38:0/910679314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77681019d0 msgr2=0x7f776819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77681019d0 0x7f776819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 -- 172.21.15.38:0/910679314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77681079d0 msgr2=0x7f776819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77681079d0 0x7f776819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.439+0000 7f7766000640 1 -- 172.21.15.38:0/910679314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776819f4a0 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.440+0000 7f7766000640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7768102370 0x7f776819aa30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f775400ea60 tx=0x7f775400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.440+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775400cde0 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.440+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776819f790 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.440+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77540035f0 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.440+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754018690 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.440+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77681a7070 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.441+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77680ff040 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.443+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7754003a80 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.445+0000 7f776ca00640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f774c0a2c90 0x7f774c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.445+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f77540cfad0 con 0x7f7768102370 2024-09-12T12:24:19.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.445+0000 7f7766a00640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f774c0a2c90 0x7f774c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.445+0000 7f776ca00640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] conn(0x7f774c0ade60 0x7f774c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.445+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 --> [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f774c0b09d0 con 0x7f774c0ade60 2024-09-12T12:24:19.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.445+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f77540cfe80 con 0x7f7768102370 2024-09-12T12:24:19.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.445+0000 7f7767400640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] conn(0x7f774c0ade60 0x7f774c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.446+0000 7f7766a00640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f774c0a2c90 0x7f774c0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7758009900 tx=0x7f77580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.446+0000 7f7767400640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] conn(0x7f774c0ade60 0x7f774c0b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.447+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== osd.7 v2:172.21.15.71:6816/3734483310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f774c0b09d0 con 0x7f774c0ade60 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.461+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 --> [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7768103110 con 0x7f774c0ade60 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.462+0000 7f776ca00640 1 -- 172.21.15.38:0/910679314 <== osd.7 v2:172.21.15.71:6816/3734483310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7768103110 con 0x7f774c0ade60 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.462+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] conn(0x7f774c0ade60 msgr2=0x7f774c0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.462+0000 7f7767e00640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] conn(0x7f774c0ade60 0x7f774c0b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f774c0a2c90 msgr2=0x7f774c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f774c0a2c90 0x7f774c0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7758009900 tx=0x7f77580058d0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7768102370 msgr2=0x7f776819aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 --2- 172.21.15.38:0/910679314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7768102370 0x7f776819aa30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f775400ea60 tx=0x7f775400ef20 comp rx=0 tx=0).stop 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767400640 1 -- 172.21.15.38:0/910679314 reap_dead start 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 shutdown_connections 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 >> 172.21.15.38:0/910679314 conn(0x7f77680fd710 msgr2=0x7f776810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:19.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 shutdown_connections 2024-09-12T12:24:19.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.463+0000 7f7767e00640 1 -- 172.21.15.38:0/910679314 wait complete. 2024-09-12T12:24:19.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:19 smithi038 ceph-mon[30810]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-12T12:24:20.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:19 smithi071 ceph-mon[34859]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-12T12:24:20.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:19 smithi154 ceph-mon[35578]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-12T12:24:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:210453397556 2024-09-12T12:24:20.343 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T12:24:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.526+0000 7fa267600640 1 -- 172.21.15.38:0/289836564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa260109140 msgr2=0x7fa260110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.526+0000 7fa267600640 1 --2- 172.21.15.38:0/289836564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa260109140 0x7fa260110cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa258009ca0 tx=0x7fa25802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.527+0000 7fa267600640 1 -- 172.21.15.38:0/289836564 shutdown_connections 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.527+0000 7fa267600640 1 --2- 172.21.15.38:0/289836564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa260109140 0x7fa260110cc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.527+0000 7fa267600640 1 --2- 172.21.15.38:0/289836564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2601049c0 0x7fa260108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.527+0000 7fa267600640 1 --2- 172.21.15.38:0/289836564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa260104010 0x7fa2601043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.527+0000 7fa267600640 1 -- 172.21.15.38:0/289836564 >> 172.21.15.38:0/289836564 conn(0x7fa2600ffa50 msgr2=0x7fa260101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.527+0000 7fa267600640 1 -- 172.21.15.38:0/289836564 shutdown_connections 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.527+0000 7fa267600640 1 -- 172.21.15.38:0/289836564 wait complete. 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 Processor -- start 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 -- start start 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa260104010 0x7fa26019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2601049c0 0x7fa26019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa260109140 0x7fa26019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601141c0 con 0x7fa260109140 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa260114040 con 0x7fa260104010 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa267600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa260114340 con 0x7fa2601049c0 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.528+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2601049c0 0x7fa26019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2601049c0 0x7fa26019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:40158/0 (socket says 172.21.15.38:40158) 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 -- 172.21.15.38:0/2806142556 learned_addr learned my addr 172.21.15.38:0/2806142556 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa265600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa260109140 0x7fa26019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa264c00640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa260104010 0x7fa26019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 -- 172.21.15.38:0/2806142556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa260104010 msgr2=0x7fa26019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa260104010 0x7fa26019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 -- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa260109140 msgr2=0x7fa26019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa260109140 0x7fa26019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 -- 172.21.15.38:0/2806142556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26019f690 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa264c00640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa260104010 0x7fa26019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.529+0000 7fa25fe00640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2601049c0 0x7fa26019ac20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ea60 tx=0x7fa24c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.530+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00cde0 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.530+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26019f980 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.530+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa24c0035f0 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.530+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c010670 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.530+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2601a7260 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.531+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa260062900 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.533+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa24c0037a0 con 0x7fa2601049c0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.534+0000 7fa25d600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa2480a2c90 0x7fa2480a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.535+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa24c0cf9d0 con 0x7fa2601049c0 2024-09-12T12:24:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.535+0000 7fa264c00640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa2480a2c90 0x7fa2480a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.535+0000 7fa25d600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] conn(0x7fa2480ade60 0x7fa2480b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.535+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 --> [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa24c01ce50 con 0x7fa2480ade60 2024-09-12T12:24:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.535+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fa24c0cfd80 con 0x7fa2601049c0 2024-09-12T12:24:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.535+0000 7fa265600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] conn(0x7fa2480ade60 0x7fa2480b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.536+0000 7fa264c00640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa2480a2c90 0x7fa2480a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa254009fc0 tx=0x7fa254005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.536+0000 7fa265600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] conn(0x7fa2480ade60 0x7fa2480b0300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.537+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== osd.9 v2:172.21.15.38:6826/3838798942 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa24c01ce50 con 0x7fa2480ade60 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.551+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 --> [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa260062d00 con 0x7fa2480ade60 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa25d600640 1 -- 172.21.15.38:0/2806142556 <== osd.9 v2:172.21.15.38:6826/3838798942 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa260062d00 con 0x7fa2480ade60 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] conn(0x7fa2480ade60 msgr2=0x7fa2480b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] conn(0x7fa2480ade60 0x7fa2480b0300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa2480a2c90 msgr2=0x7fa2480a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa2480a2c90 0x7fa2480a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa254009fc0 tx=0x7fa254005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2601049c0 msgr2=0x7fa26019ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 --2- 172.21.15.38:0/2806142556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2601049c0 0x7fa26019ac20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ea60 tx=0x7fa24c00ef20 comp rx=0 tx=0).stop 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa265600640 1 -- 172.21.15.38:0/2806142556 reap_dead start 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 shutdown_connections 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 >> 172.21.15.38:0/2806142556 conn(0x7fa2600ffa50 msgr2=0x7fa260100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 shutdown_connections 2024-09-12T12:24:20.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:19.552+0000 7fa267600640 1 -- 172.21.15.38:0/2806142556 wait complete. 2024-09-12T12:24:21.105 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:21.106 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:21.108 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:21.477 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:21.629 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:21.630 INFO:teuthology.orchestra.run.smithi038.stdout:274877906985 2024-09-12T12:24:21.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T12:24:21.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:21 smithi038 ceph-mon[30810]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T12:24:22.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:21 smithi071 ceph-mon[34859]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T12:24:22.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:21 smithi154 ceph-mon[35578]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 -- 172.21.15.38:0/2465019850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed741049a0 msgr2=0x7fed741089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 --2- 172.21.15.38:0/2465019850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed741049a0 0x7fed741089f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed60009900 tx=0x7fed6002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 -- 172.21.15.38:0/2465019850 shutdown_connections 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 --2- 172.21.15.38:0/2465019850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed74109120 0x7fed74110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 --2- 172.21.15.38:0/2465019850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed741049a0 0x7fed741089f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 --2- 172.21.15.38:0/2465019850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed74103ff0 0x7fed741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 -- 172.21.15.38:0/2465019850 >> 172.21.15.38:0/2465019850 conn(0x7fed740ffa90 msgr2=0x7fed74101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 -- 172.21.15.38:0/2465019850 shutdown_connections 2024-09-12T12:24:22.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.199+0000 7fed7b800640 1 -- 172.21.15.38:0/2465019850 wait complete. 2024-09-12T12:24:22.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.200+0000 7fed7b800640 1 Processor -- start 2024-09-12T12:24:22.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.200+0000 7fed7b800640 1 -- start start 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed7b800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed74103ff0 0x7fed7419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed7b800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed741049a0 0x7fed7419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed7b800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed74109120 0x7fed7419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed7b800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fed74114170 con 0x7fed74103ff0 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed7b800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed74113ff0 con 0x7fed741049a0 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed7b800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fed741142f0 con 0x7fed74109120 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed78e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed74103ff0 0x7fed7419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed78e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed74103ff0 0x7fed7419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54288/0 (socket says 172.21.15.38:54288) 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed78e00640 1 -- 172.21.15.38:0/1379377386 learned_addr learned my addr 172.21.15.38:0/1379377386 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed73e00640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed741049a0 0x7fed7419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:22.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed79800640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed74109120 0x7fed7419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.201+0000 7fed78e00640 1 -- 172.21.15.38:0/1379377386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed74109120 msgr2=0x7fed7419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed78e00640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed74109120 0x7fed7419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed78e00640 1 -- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed741049a0 msgr2=0x7fed7419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed78e00640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed741049a0 0x7fed7419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed78e00640 1 -- 172.21.15.38:0/1379377386 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7419f5e0 con 0x7fed74103ff0 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed78e00640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed74103ff0 0x7fed7419a630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed6800e9f0 tx=0x7fed6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6800cd80 con 0x7fed74103ff0 2024-09-12T12:24:22.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed68010910 con 0x7fed74103ff0 2024-09-12T12:24:22.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7419f8d0 con 0x7fed74103ff0 2024-09-12T12:24:22.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68018990 con 0x7fed74103ff0 2024-09-12T12:24:22.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.202+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed741a71b0 con 0x7fed74103ff0 2024-09-12T12:24:22.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.203+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed74062980 con 0x7fed74103ff0 2024-09-12T12:24:22.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.205+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fed68010ac0 con 0x7fed74103ff0 2024-09-12T12:24:22.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.207+0000 7fed71600640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fed5c0a2c10 0x7fed5c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:22.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.207+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fed680cff10 con 0x7fed74103ff0 2024-09-12T12:24:22.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.207+0000 7fed73e00640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fed5c0a2c10 0x7fed5c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:22.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.207+0000 7fed71600640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] conn(0x7fed5c0adde0 0x7fed5c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:22.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.207+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 --> [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed68022e50 con 0x7fed5c0adde0 2024-09-12T12:24:22.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.207+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fed680d02c0 con 0x7fed74103ff0 2024-09-12T12:24:22.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.208+0000 7fed79800640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] conn(0x7fed5c0adde0 0x7fed5c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:22.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.208+0000 7fed73e00640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fed5c0a2c10 0x7fed5c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fed60000c00 tx=0x7fed60005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:22.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.208+0000 7fed79800640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] conn(0x7fed5c0adde0 0x7fed5c0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:22.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.209+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== osd.1 v2:172.21.15.71:6800/1674049999 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed68022e50 con 0x7fed5c0adde0 2024-09-12T12:24:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.224+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 --> [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed74062d80 con 0x7fed5c0adde0 2024-09-12T12:24:22.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.224+0000 7fed71600640 1 -- 172.21.15.38:0/1379377386 <== osd.1 v2:172.21.15.71:6800/1674049999 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fed74062d80 con 0x7fed5c0adde0 2024-09-12T12:24:22.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] conn(0x7fed5c0adde0 msgr2=0x7fed5c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] conn(0x7fed5c0adde0 0x7fed5c0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fed5c0a2c10 msgr2=0x7fed5c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fed5c0a2c10 0x7fed5c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fed60000c00 tx=0x7fed60005b50 comp rx=0 tx=0).stop 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed74103ff0 msgr2=0x7fed7419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 --2- 172.21.15.38:0/1379377386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed74103ff0 0x7fed7419a630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed6800e9f0 tx=0x7fed6800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed79800640 1 -- 172.21.15.38:0/1379377386 reap_dead start 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 shutdown_connections 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 >> 172.21.15.38:0/1379377386 conn(0x7fed740ffa90 msgr2=0x7fed74100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 shutdown_connections 2024-09-12T12:24:22.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:22.225+0000 7fed7b800640 1 -- 172.21.15.38:0/1379377386 wait complete. 2024-09-12T12:24:23.005 INFO:teuthology.orchestra.run.smithi038.stdout:326417514527 2024-09-12T12:24:23.006 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T12:24:23.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 -- 172.21.15.38:0/1575392293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 msgr2=0x7faf34108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 --2- 172.21.15.38:0/1575392293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 0x7faf34108a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009900 tx=0x7faf1c02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 -- 172.21.15.38:0/1575392293 shutdown_connections 2024-09-12T12:24:23.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 --2- 172.21.15.38:0/1575392293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34109140 0x7faf34110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 --2- 172.21.15.38:0/1575392293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 0x7faf34108a10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 --2- 172.21.15.38:0/1575392293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf34104010 0x7faf341043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 -- 172.21.15.38:0/1575392293 >> 172.21.15.38:0/1575392293 conn(0x7faf340ffa50 msgr2=0x7faf34101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:23.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 -- 172.21.15.38:0/1575392293 shutdown_connections 2024-09-12T12:24:23.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.950+0000 7faf39400640 1 -- 172.21.15.38:0/1575392293 wait complete. 2024-09-12T12:24:23.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.951+0000 7faf39400640 1 Processor -- start 2024-09-12T12:24:23.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.951+0000 7faf39400640 1 -- start start 2024-09-12T12:24:23.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf39400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf34104010 0x7faf3419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf39400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 0x7faf3419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf39400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34109140 0x7faf3419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf39400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf341141b0 con 0x7faf341049c0 2024-09-12T12:24:23.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf39400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf34114030 con 0x7faf34109140 2024-09-12T12:24:23.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf39400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf34114330 con 0x7faf34104010 2024-09-12T12:24:23.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf2be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 0x7faf3419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf2be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 0x7faf3419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54272/0 (socket says 172.21.15.38:54272) 2024-09-12T12:24:23.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf2be00640 1 -- 172.21.15.38:0/672093673 learned_addr learned my addr 172.21.15.38:0/672093673 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:23.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf32800640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf34104010 0x7faf3419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.952+0000 7faf33200640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34109140 0x7faf3419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2be00640 1 -- 172.21.15.38:0/672093673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf34104010 msgr2=0x7faf3419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2be00640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf34104010 0x7faf3419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2be00640 1 -- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34109140 msgr2=0x7faf3419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2be00640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf34109140 0x7faf3419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2be00640 1 -- 172.21.15.38:0/672093673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3419f640 con 0x7faf341049c0 2024-09-12T12:24:23.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2be00640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 0x7faf3419abd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf1c004770 tx=0x7faf1c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:23.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c03f070 con 0x7faf341049c0 2024-09-12T12:24:23.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf1c031ca0 con 0x7faf341049c0 2024-09-12T12:24:23.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c035030 con 0x7faf341049c0 2024-09-12T12:24:23.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3419f8d0 con 0x7faf341049c0 2024-09-12T12:24:23.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.953+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf341a7210 con 0x7faf341049c0 2024-09-12T12:24:23.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.954+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf34062980 con 0x7faf341049c0 2024-09-12T12:24:23.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.958+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faf1c042070 con 0x7faf341049c0 2024-09-12T12:24:23.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.960+0000 7faf2b400640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf180a2c10 0x7faf180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.960+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7faf1c0effe0 con 0x7faf341049c0 2024-09-12T12:24:23.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.960+0000 7faf32800640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf180a2c10 0x7faf180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.960+0000 7faf2b400640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] conn(0x7faf180adde0 0x7faf180b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.960+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 --> [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf1c038e90 con 0x7faf180adde0 2024-09-12T12:24:23.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.960+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7faf1c0f0430 con 0x7faf341049c0 2024-09-12T12:24:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.960+0000 7faf33200640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] conn(0x7faf180adde0 0x7faf180b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.961+0000 7faf32800640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf180a2c10 0x7faf180a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf24005fd0 tx=0x7faf2400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.961+0000 7faf33200640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] conn(0x7faf180adde0 0x7faf180b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.962+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== osd.10 v2:172.21.15.71:6824/1853359859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf1c038e90 con 0x7faf180adde0 2024-09-12T12:24:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.976+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 --> [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf34062e00 con 0x7faf180adde0 2024-09-12T12:24:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.977+0000 7faf2b400640 1 -- 172.21.15.38:0/672093673 <== osd.10 v2:172.21.15.71:6824/1853359859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faf34062e00 con 0x7faf180adde0 2024-09-12T12:24:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.977+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] conn(0x7faf180adde0 msgr2=0x7faf180b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.977+0000 7faf39400640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] conn(0x7faf180adde0 0x7faf180b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf180a2c10 msgr2=0x7faf180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf180a2c10 0x7faf180a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf24005fd0 tx=0x7faf2400b390 comp rx=0 tx=0).stop 2024-09-12T12:24:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 msgr2=0x7faf3419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 --2- 172.21.15.38:0/672093673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf341049c0 0x7faf3419abd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf1c004770 tx=0x7faf1c003c10 comp rx=0 tx=0).stop 2024-09-12T12:24:23.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf33200640 1 -- 172.21.15.38:0/672093673 reap_dead start 2024-09-12T12:24:23.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 shutdown_connections 2024-09-12T12:24:23.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 >> 172.21.15.38:0/672093673 conn(0x7faf340ffa50 msgr2=0x7faf34100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:23.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 shutdown_connections 2024-09-12T12:24:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:21.978+0000 7faf39400640 1 -- 172.21.15.38:0/672093673 wait complete. 2024-09-12T12:24:23.888 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:23 smithi038 ceph-mon[30810]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T12:24:24.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:23 smithi071 ceph-mon[34859]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T12:24:24.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:23 smithi154 ceph-mon[35578]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-12T12:24:24.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 -- 172.21.15.38:0/3401478575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c1049a0 msgr2=0x7fca3c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 --2- 172.21.15.38:0/3401478575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c1049a0 0x7fca3c1089f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca28009860 tx=0x7fca2802a340 comp rx=0 tx=0).stop 2024-09-12T12:24:24.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 -- 172.21.15.38:0/3401478575 shutdown_connections 2024-09-12T12:24:24.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 --2- 172.21.15.38:0/3401478575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c109120 0x7fca3c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 --2- 172.21.15.38:0/3401478575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c1049a0 0x7fca3c1089f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 --2- 172.21.15.38:0/3401478575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c103ff0 0x7fca3c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 -- 172.21.15.38:0/3401478575 >> 172.21.15.38:0/3401478575 conn(0x7fca3c0ffa90 msgr2=0x7fca3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 -- 172.21.15.38:0/3401478575 shutdown_connections 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.522+0000 7fca41e00640 1 -- 172.21.15.38:0/3401478575 wait complete. 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.523+0000 7fca41e00640 1 Processor -- start 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.523+0000 7fca41e00640 1 -- start start 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca41e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c103ff0 0x7fca3c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca41e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c1049a0 0x7fca3c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca41e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c109120 0x7fca3c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca41e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c114140 con 0x7fca3c1049a0 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca41e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c113fc0 con 0x7fca3c109120 2024-09-12T12:24:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca41e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c1142c0 con 0x7fca3c103ff0 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3a000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c1049a0 0x7fca3c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c109120 0x7fca3c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3a000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c1049a0 0x7fca3c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54326/0 (socket says 172.21.15.38:54326) 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c103ff0 0x7fca3c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c109120 0x7fca3c19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55604/0 (socket says 172.21.15.38:55604) 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3a000640 1 -- 172.21.15.38:0/195779319 learned_addr learned my addr 172.21.15.38:0/195779319 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3b400640 1 -- 172.21.15.38:0/195779319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c103ff0 msgr2=0x7fca3c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.524+0000 7fca3b400640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c103ff0 0x7fca3c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca3b400640 1 -- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c1049a0 msgr2=0x7fca3c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca3b400640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c1049a0 0x7fca3c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca3b400640 1 -- 172.21.15.38:0/195779319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c19f5d0 con 0x7fca3c109120 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca3b400640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c109120 0x7fca3c19eef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca34009fd0 tx=0x7fca3400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ce20 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c19f8c0 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca34010430 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400f620 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.525+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c1a71a0 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.526+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca3c062980 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.528+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fca34010950 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.530+0000 7fca40a00640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca200a2c10 0x7fca200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.530+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fca340cfd90 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.530+0000 7fca3aa00640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca200a2c10 0x7fca200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.530+0000 7fca40a00640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] conn(0x7fca200adde0 0x7fca200b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.530+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 --> [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca200b0950 con 0x7fca200adde0 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.530+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fca340d0140 con 0x7fca3c109120 2024-09-12T12:24:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.530+0000 7fca3a000640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] conn(0x7fca200adde0 0x7fca200b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.531+0000 7fca3aa00640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca200a2c10 0x7fca200a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009530 tx=0x7fca2c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.531+0000 7fca3a000640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] conn(0x7fca200adde0 0x7fca200b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.532+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== osd.3 v2:172.21.15.38:6810/1122631258 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca200b0950 con 0x7fca200adde0 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.546+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 --> [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca3c062e00 con 0x7fca200adde0 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca40a00640 1 -- 172.21.15.38:0/195779319 <== osd.3 v2:172.21.15.38:6810/1122631258 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca3c062e00 con 0x7fca200adde0 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] conn(0x7fca200adde0 msgr2=0x7fca200b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] conn(0x7fca200adde0 0x7fca200b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca200a2c10 msgr2=0x7fca200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca200a2c10 0x7fca200a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009530 tx=0x7fca2c009260 comp rx=0 tx=0).stop 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c109120 msgr2=0x7fca3c19eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 --2- 172.21.15.38:0/195779319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca3c109120 0x7fca3c19eef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca34009fd0 tx=0x7fca3400ef10 comp rx=0 tx=0).stop 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca3b400640 1 -- 172.21.15.38:0/195779319 reap_dead start 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 shutdown_connections 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 >> 172.21.15.38:0/195779319 conn(0x7fca3c0ffa90 msgr2=0x7fca3c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 shutdown_connections 2024-09-12T12:24:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.547+0000 7fca41e00640 1 -- 172.21.15.38:0/195779319 wait complete. 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.545+0000 7f0edbe00640 1 -- 172.21.15.38:0/4145912437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed41049a0 msgr2=0x7f0ed41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.545+0000 7f0edbe00640 1 --2- 172.21.15.38:0/4145912437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed41049a0 0x7f0ed41089f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009900 tx=0x7f0ec002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.545+0000 7f0edbe00640 1 -- 172.21.15.38:0/4145912437 shutdown_connections 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.545+0000 7f0edbe00640 1 --2- 172.21.15.38:0/4145912437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed4109120 0x7f0ed4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.545+0000 7f0edbe00640 1 --2- 172.21.15.38:0/4145912437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed41049a0 0x7f0ed41089f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.545+0000 7f0edbe00640 1 --2- 172.21.15.38:0/4145912437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed4103ff0 0x7f0ed41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.546+0000 7f0edbe00640 1 -- 172.21.15.38:0/4145912437 >> 172.21.15.38:0/4145912437 conn(0x7f0ed40ffa90 msgr2=0x7f0ed4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.546+0000 7f0edbe00640 1 -- 172.21.15.38:0/4145912437 shutdown_connections 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.546+0000 7f0edbe00640 1 -- 172.21.15.38:0/4145912437 wait complete. 2024-09-12T12:24:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.546+0000 7f0edbe00640 1 Processor -- start 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0edbe00640 1 -- start start 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed4103ff0 0x7f0ed419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed41049a0 0x7f0ed419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed4109120 0x7f0ed419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0edbe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4114140 con 0x7f0ed4109120 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0edbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4113fc0 con 0x7f0ed41049a0 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0edbe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41142c0 con 0x7f0ed4103ff0 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0ed9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed4109120 0x7f0ed419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0ed9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed4109120 0x7f0ed419eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33904/0 (socket says 172.21.15.38:33904) 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0ed9e00640 1 -- 172.21.15.38:0/468470263 learned_addr learned my addr 172.21.15.38:0/468470263 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0ed8a00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed41049a0 0x7f0ed419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.547+0000 7f0ed9400640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed4103ff0 0x7f0ed419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed9e00640 1 -- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed4103ff0 msgr2=0x7f0ed419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed9e00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed4103ff0 0x7f0ed419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed9e00640 1 -- 172.21.15.38:0/468470263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed41049a0 msgr2=0x7f0ed419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed9e00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed41049a0 0x7f0ed419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed9e00640 1 -- 172.21.15.38:0/468470263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed419f5d0 con 0x7f0ed4109120 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed9400640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed4103ff0 0x7f0ed419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed8a00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ed41049a0 0x7f0ed419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed9e00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed4109120 0x7f0ed419eef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00eb10 tx=0x7f0ecc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc004b20 con 0x7f0ed4109120 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed419f8c0 con 0x7f0ed4109120 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc004cc0 con 0x7f0ed4109120 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.548+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc010760 con 0x7f0ed4109120 2024-09-12T12:24:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.549+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed41a71a0 con 0x7f0ed4109120 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.549+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ed4062940 con 0x7f0ed4109120 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.551+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0ecc005020 con 0x7f0ed4109120 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.553+0000 7f0ed2000640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.553+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0ecc0cfeb0 con 0x7f0ed4109120 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.553+0000 7f0ed9400640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.553+0000 7f0ed2000640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] conn(0x7f0ebc0adde0 0x7f0ebc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.553+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 --> [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ebc0b0950 con 0x7f0ebc0adde0 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.553+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f0ecc0d0260 con 0x7f0ed4109120 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.554+0000 7f0ed8a00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] conn(0x7f0ebc0adde0 0x7f0ebc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.554+0000 7f0ed9400640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009fc0 tx=0x7f0ec8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.554+0000 7f0ed8a00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] conn(0x7f0ebc0adde0 0x7f0ebc0b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.555+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== osd.2 v2:172.21.15.154:6800/1873540027 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ebc0b0950 con 0x7f0ebc0adde0 2024-09-12T12:24:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.570+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 --> [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ed4062dc0 con 0x7f0ebc0adde0 2024-09-12T12:24:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0ed2000640 1 -- 172.21.15.38:0/468470263 <== osd.2 v2:172.21.15.154:6800/1873540027 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ed4062dc0 con 0x7f0ebc0adde0 2024-09-12T12:24:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] conn(0x7f0ebc0adde0 msgr2=0x7f0ebc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0edbe00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] conn(0x7f0ebc0adde0 0x7f0ebc0b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0ebc0a2c10 msgr2=0x7f0ebc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0edbe00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009fc0 tx=0x7f0ec8005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed4109120 msgr2=0x7f0ed419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0edbe00640 1 --2- 172.21.15.38:0/468470263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed4109120 0x7f0ed419eef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00eb10 tx=0x7f0ecc00c2d0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.571+0000 7f0ed9e00640 1 -- 172.21.15.38:0/468470263 reap_dead start 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.572+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 shutdown_connections 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.572+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 >> 172.21.15.38:0/468470263 conn(0x7f0ed40ffa90 msgr2=0x7f0ed4100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.572+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 shutdown_connections 2024-09-12T12:24:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.572+0000 7f0edbe00640 1 -- 172.21.15.38:0/468470263 wait complete. 2024-09-12T12:24:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:25 smithi038 ceph-mon[30810]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:26.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:25 smithi071 ceph-mon[34859]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:26.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:25 smithi154 ceph-mon[35578]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:26.467 INFO:teuthology.orchestra.run.smithi038.stdout:296352743460 2024-09-12T12:24:26.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T12:24:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.669+0000 7f22f1800640 1 -- 172.21.15.38:0/2050272663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 msgr2=0x7f22ec110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.669+0000 7f22f1800640 1 --2- 172.21.15.38:0/2050272663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 0x7f22ec110ca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009ca0 tx=0x7f22e402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.669+0000 7f22f1800640 1 -- 172.21.15.38:0/2050272663 shutdown_connections 2024-09-12T12:24:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.669+0000 7f22f1800640 1 --2- 172.21.15.38:0/2050272663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 0x7f22ec110ca0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.670+0000 7f22f1800640 1 --2- 172.21.15.38:0/2050272663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22ec1049a0 0x7f22ec1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.670+0000 7f22f1800640 1 --2- 172.21.15.38:0/2050272663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ec103ff0 0x7f22ec1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.670+0000 7f22f1800640 1 -- 172.21.15.38:0/2050272663 >> 172.21.15.38:0/2050272663 conn(0x7f22ec0ffa90 msgr2=0x7f22ec101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.670+0000 7f22f1800640 1 -- 172.21.15.38:0/2050272663 shutdown_connections 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.670+0000 7f22f1800640 1 -- 172.21.15.38:0/2050272663 wait complete. 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.670+0000 7f22f1800640 1 Processor -- start 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22f1800640 1 -- start start 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22f1800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ec103ff0 0x7f22ec19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22f1800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22ec1049a0 0x7f22ec19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22f1800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 0x7f22ec19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22f1800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec114180 con 0x7f22ec109120 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22f1800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec114000 con 0x7f22ec1049a0 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22f1800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec114300 con 0x7f22ec103ff0 2024-09-12T12:24:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22eb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 0x7f22ec19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22eb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 0x7f22ec19ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33918/0 (socket says 172.21.15.38:33918) 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22eb400640 1 -- 172.21.15.38:0/3345200911 learned_addr learned my addr 172.21.15.38:0/3345200911 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22ea000640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22ec1049a0 0x7f22ec19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.671+0000 7f22eaa00640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ec103ff0 0x7f22ec19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.672+0000 7f22ea000640 1 -- 172.21.15.38:0/3345200911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ec103ff0 msgr2=0x7f22ec19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.672+0000 7f22ea000640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ec103ff0 0x7f22ec19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.672+0000 7f22ea000640 1 -- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 msgr2=0x7f22ec19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.672+0000 7f22ea000640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 0x7f22ec19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.672+0000 7f22ea000640 1 -- 172.21.15.38:0/3345200911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec19f570 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.672+0000 7f22eb400640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec109120 0x7f22ec19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.672+0000 7f22ea000640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22ec1049a0 0x7f22ec19ab00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22d800e9f0 tx=0x7f22d800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.673+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d800ccc0 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.673+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec19f860 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.673+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22d8010910 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.673+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8018880 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.673+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec1a7140 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.674+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22ec101020 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.676+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f22d8010ac0 con 0x7f22ec1049a0 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.677+0000 7f22e3400640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f22d00a2c90 0x7f22d00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.677+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f22d80cfd60 con 0x7f22ec1049a0 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.677+0000 7f22eaa00640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f22d00a2c90 0x7f22d00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.678+0000 7f22e3400640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] conn(0x7f22d00ade60 0x7f22d00b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.678+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 --> [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22d00b09d0 con 0x7f22d00ade60 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.678+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f22d80d0110 con 0x7f22ec1049a0 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.678+0000 7f22eb400640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] conn(0x7f22d00ade60 0x7f22d00b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.678+0000 7f22eaa00640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f22d00a2c90 0x7f22d00a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22dc005d00 tx=0x7f22dc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.679+0000 7f22eb400640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] conn(0x7f22d00ade60 0x7f22d00b0300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.680+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== osd.4 v2:172.21.15.71:6808/1646041821 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22d00b09d0 con 0x7f22d00ade60 2024-09-12T12:24:26.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.711+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 --> [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f22ec1054d0 con 0x7f22d00ade60 2024-09-12T12:24:26.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.712+0000 7f22e3400640 1 -- 172.21.15.38:0/3345200911 <== osd.4 v2:172.21.15.71:6808/1646041821 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f22ec1054d0 con 0x7f22d00ade60 2024-09-12T12:24:26.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.712+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] conn(0x7f22d00ade60 msgr2=0x7f22d00b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.712+0000 7f22f1800640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] conn(0x7f22d00ade60 0x7f22d00b0300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f22d00a2c90 msgr2=0x7f22d00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f22d00a2c90 0x7f22d00a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22dc005d00 tx=0x7f22dc00b410 comp rx=0 tx=0).stop 2024-09-12T12:24:26.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22ec1049a0 msgr2=0x7f22ec19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 --2- 172.21.15.38:0/3345200911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22ec1049a0 0x7f22ec19ab00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22d800e9f0 tx=0x7f22d800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22eb400640 1 -- 172.21.15.38:0/3345200911 reap_dead start 2024-09-12T12:24:26.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 shutdown_connections 2024-09-12T12:24:26.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 >> 172.21.15.38:0/3345200911 conn(0x7f22ec0ffa90 msgr2=0x7f22ec1005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 shutdown_connections 2024-09-12T12:24:26.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.713+0000 7f22f1800640 1 -- 172.21.15.38:0/3345200911 wait complete. 2024-09-12T12:24:26.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.928+0000 7f038a400640 1 -- 172.21.15.38:0/2209388546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 msgr2=0x7f0384108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.928+0000 7f038a400640 1 --2- 172.21.15.38:0/2209388546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 0x7f0384108a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f036c009900 tx=0x7f036c02a410 comp rx=0 tx=0).stop 2024-09-12T12:24:26.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.929+0000 7f038a400640 1 -- 172.21.15.38:0/2209388546 shutdown_connections 2024-09-12T12:24:26.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.929+0000 7f038a400640 1 --2- 172.21.15.38:0/2209388546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0384109140 0x7f0384110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.929+0000 7f038a400640 1 --2- 172.21.15.38:0/2209388546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 0x7f0384108a10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.929+0000 7f038a400640 1 --2- 172.21.15.38:0/2209388546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0384104010 0x7f03841043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.929+0000 7f038a400640 1 -- 172.21.15.38:0/2209388546 >> 172.21.15.38:0/2209388546 conn(0x7f03840ffa50 msgr2=0x7f0384101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.929+0000 7f038a400640 1 -- 172.21.15.38:0/2209388546 shutdown_connections 2024-09-12T12:24:26.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.929+0000 7f038a400640 1 -- 172.21.15.38:0/2209388546 wait complete. 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.930+0000 7f038a400640 1 Processor -- start 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.930+0000 7f038a400640 1 -- start start 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.930+0000 7f038a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0384104010 0x7f038419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f038a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 0x7f038419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f038a400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0384109140 0x7f038419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f038a400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0384114160 con 0x7f03841049c0 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f038a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0384113fe0 con 0x7f0384104010 2024-09-12T12:24:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f038a400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03841142e0 con 0x7f0384109140 2024-09-12T12:24:26.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 0x7f038419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 0x7f038419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33938/0 (socket says 172.21.15.38:33938) 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 -- 172.21.15.38:0/1857806872 learned_addr learned my addr 172.21.15.38:0/1857806872 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f0383400640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0384104010 0x7f038419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f0383e00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0384109140 0x7f038419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 -- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0384109140 msgr2=0x7f038419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0384109140 0x7f038419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 -- 172.21.15.38:0/1857806872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0384104010 msgr2=0x7f038419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0384104010 0x7f038419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.931+0000 7f037be00640 1 -- 172.21.15.38:0/1857806872 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038419f6e0 con 0x7f03841049c0 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.932+0000 7f037be00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 0x7f038419ac70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.932+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c03f030 con 0x7f03841049c0 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.932+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f036c004440 con 0x7f03841049c0 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.932+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038419f970 con 0x7f03841049c0 2024-09-12T12:24:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.932+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03841a72b0 con 0x7f03841049c0 2024-09-12T12:24:26.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.932+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c035070 con 0x7f03841049c0 2024-09-12T12:24:26.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.933+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0384062900 con 0x7f03841049c0 2024-09-12T12:24:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.936+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f036c042030 con 0x7f03841049c0 2024-09-12T12:24:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.937+0000 7f0380c00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03680a2c10 0x7f03680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.937+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f036c0f0050 con 0x7f03841049c0 2024-09-12T12:24:26.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.937+0000 7f0383400640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03680a2c10 0x7f03680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.937+0000 7f0380c00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] conn(0x7f03680adde0 0x7f03680b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.937+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 --> [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03680b0950 con 0x7f03680adde0 2024-09-12T12:24:26.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.937+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f036c0f04a0 con 0x7f03841049c0 2024-09-12T12:24:26.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.938+0000 7f0383e00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] conn(0x7f03680adde0 0x7f03680b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.938+0000 7f0383400640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03680a2c10 0x7f03680a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0374009bd0 tx=0x7f0374005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.939+0000 7f0383e00640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] conn(0x7f03680adde0 0x7f03680b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.940+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== osd.8 v2:172.21.15.154:6816/1762082405 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03680b0950 con 0x7f03680adde0 2024-09-12T12:24:26.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.958+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 --> [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0384062d00 con 0x7f03680adde0 2024-09-12T12:24:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f0380c00640 1 -- 172.21.15.38:0/1857806872 <== osd.8 v2:172.21.15.154:6816/1762082405 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0384062d00 con 0x7f03680adde0 2024-09-12T12:24:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] conn(0x7f03680adde0 msgr2=0x7f03680b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f038a400640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] conn(0x7f03680adde0 0x7f03680b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03680a2c10 msgr2=0x7f03680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f038a400640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f03680a2c10 0x7f03680a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0374009bd0 tx=0x7f0374005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 msgr2=0x7f038419ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f038a400640 1 --2- 172.21.15.38:0/1857806872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03841049c0 0x7f038419ac70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c004040 comp rx=0 tx=0).stop 2024-09-12T12:24:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.959+0000 7f0383e00640 1 -- 172.21.15.38:0/1857806872 reap_dead start 2024-09-12T12:24:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.960+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 shutdown_connections 2024-09-12T12:24:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.960+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 >> 172.21.15.38:0/1857806872 conn(0x7f03840ffa50 msgr2=0x7f0384100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.960+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 shutdown_connections 2024-09-12T12:24:26.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:26.960+0000 7f038a400640 1 -- 172.21.15.38:0/1857806872 wait complete. 2024-09-12T12:24:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.424+0000 7f4452200640 1 -- 172.21.15.38:0/1954237948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 msgr2=0x7f444c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.424+0000 7f4452200640 1 --2- 172.21.15.38:0/1954237948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 0x7f444c1043d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f443c009900 tx=0x7f443c02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.425+0000 7f4452200640 1 -- 172.21.15.38:0/1954237948 shutdown_connections 2024-09-12T12:24:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.425+0000 7f4452200640 1 --2- 172.21.15.38:0/1954237948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c109120 0x7f444c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.425+0000 7f4452200640 1 --2- 172.21.15.38:0/1954237948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444c1049a0 0x7f444c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.425+0000 7f4452200640 1 --2- 172.21.15.38:0/1954237948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 0x7f444c1043d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.425+0000 7f4452200640 1 -- 172.21.15.38:0/1954237948 >> 172.21.15.38:0/1954237948 conn(0x7f444c0ffa90 msgr2=0x7f444c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.425+0000 7f4452200640 1 -- 172.21.15.38:0/1954237948 shutdown_connections 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.425+0000 7f4452200640 1 -- 172.21.15.38:0/1954237948 wait complete. 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.426+0000 7f4452200640 1 Processor -- start 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.426+0000 7f4452200640 1 -- start start 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f4452200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 0x7f444c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f4452200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c1049a0 0x7f444c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f4452200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444c109120 0x7f444c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f4452200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f444c114120 con 0x7f444c103ff0 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f4452200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f444c113fa0 con 0x7f444c1049a0 2024-09-12T12:24:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f4452200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1142a0 con 0x7f444c109120 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f444b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 0x7f444c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f444b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 0x7f444c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54350/0 (socket says 172.21.15.38:54350) 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f444b400640 1 -- 172.21.15.38:0/3840231994 learned_addr learned my addr 172.21.15.38:0/3840231994 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f444aa00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c1049a0 0x7f444c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f444be00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444c109120 0x7f444c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f444b400640 1 -- 172.21.15.38:0/3840231994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444c109120 msgr2=0x7f444c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.427+0000 7f444b400640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444c109120 0x7f444c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f444b400640 1 -- 172.21.15.38:0/3840231994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c1049a0 msgr2=0x7f444c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f444b400640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c1049a0 0x7f444c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f444b400640 1 -- 172.21.15.38:0/3840231994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c19f5d0 con 0x7f444c103ff0 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f444b400640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 0x7f444c19a620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f443c006010 tx=0x7f443c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c03f030 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f443c003ce0 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c19f860 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c035070 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.428+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c1a71a0 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.429+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f444c062980 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.432+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f443c042030 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.434+0000 7f4443e00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44300a2c10 0x7f44300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.435+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f443c0f01f0 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.435+0000 7f444aa00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44300a2c10 0x7f44300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.435+0000 7f4443e00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] conn(0x7f44300adde0 0x7f44300b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.435+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 --> [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f443c040e70 con 0x7f44300adde0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.435+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f443c0f05a0 con 0x7f444c103ff0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.436+0000 7f444be00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] conn(0x7f44300adde0 0x7f44300b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.436+0000 7f444aa00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44300a2c10 0x7f44300a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f444c0ffeb0 tx=0x7f443800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.436+0000 7f444be00640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] conn(0x7f44300adde0 0x7f44300b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.437+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== osd.6 v2:172.21.15.38:6818/3228938954 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f443c040e70 con 0x7f44300adde0 2024-09-12T12:24:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.452+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 --> [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f444c062e00 con 0x7f44300adde0 2024-09-12T12:24:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4443e00640 1 -- 172.21.15.38:0/3840231994 <== osd.6 v2:172.21.15.38:6818/3228938954 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f444c062e00 con 0x7f44300adde0 2024-09-12T12:24:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] conn(0x7f44300adde0 msgr2=0x7f44300b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] conn(0x7f44300adde0 0x7f44300b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44300a2c10 msgr2=0x7f44300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44300a2c10 0x7f44300a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f444c0ffeb0 tx=0x7f443800b390 comp rx=0 tx=0).stop 2024-09-12T12:24:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 msgr2=0x7f444c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 --2- 172.21.15.38:0/3840231994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c103ff0 0x7f444c19a620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f443c006010 tx=0x7f443c0042f0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f444be00640 1 -- 172.21.15.38:0/3840231994 reap_dead start 2024-09-12T12:24:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 shutdown_connections 2024-09-12T12:24:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.453+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 >> 172.21.15.38:0/3840231994 conn(0x7f444c0ffa90 msgr2=0x7f444c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.454+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 shutdown_connections 2024-09-12T12:24:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:25.454+0000 7f4452200640 1 -- 172.21.15.38:0/3840231994 wait complete. 2024-09-12T12:24:28.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:27 smithi071 ceph-mon[34859]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-12T12:24:28.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:27 smithi038 ceph-mon[30810]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-12T12:24:28.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:27 smithi154 ceph-mon[35578]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-12T12:24:29.132 INFO:teuthology.orchestra.run.smithi038.stdout:188978561083 2024-09-12T12:24:29.133 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T12:24:29.140 INFO:teuthology.orchestra.run.smithi038.stdout:244813135921 2024-09-12T12:24:29.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T12:24:29.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 -- 172.21.15.38:0/3596926869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50109120 msgr2=0x7f6f50110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:29.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 --2- 172.21.15.38:0/3596926869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50109120 0x7f6f50110ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009ca0 tx=0x7f6f4802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:29.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 -- 172.21.15.38:0/3596926869 shutdown_connections 2024-09-12T12:24:29.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 --2- 172.21.15.38:0/3596926869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50109120 0x7f6f50110ca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:29.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 --2- 172.21.15.38:0/3596926869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f501049a0 0x7f6f501089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:29.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 --2- 172.21.15.38:0/3596926869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f50103ff0 0x7f6f501043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:29.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 -- 172.21.15.38:0/3596926869 >> 172.21.15.38:0/3596926869 conn(0x7f6f500ffa90 msgr2=0x7f6f50101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 -- 172.21.15.38:0/3596926869 shutdown_connections 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.383+0000 7f6f56e00640 1 -- 172.21.15.38:0/3596926869 wait complete. 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.384+0000 7f6f56e00640 1 Processor -- start 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.384+0000 7f6f56e00640 1 -- start start 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f56e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f50103ff0 0x7f6f5019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f56e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f501049a0 0x7f6f5019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f56e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50109120 0x7f6f5019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f56e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6f50114150 con 0x7f6f50109120 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f56e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f50113fd0 con 0x7f6f501049a0 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f56e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501142d0 con 0x7f6f50103ff0 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f54e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50109120 0x7f6f5019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f50103ff0 0x7f6f5019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:29.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f501049a0 0x7f6f5019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f50103ff0 0x7f6f5019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:40204/0 (socket says 172.21.15.38:40204) 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 -- 172.21.15.38:0/3592808701 learned_addr learned my addr 172.21.15.38:0/3592808701 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 -- 172.21.15.38:0/3592808701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f501049a0 msgr2=0x7f6f5019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f501049a0 0x7f6f5019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 -- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50109120 msgr2=0x7f6f5019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50109120 0x7f6f5019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.385+0000 7f6f4fe00640 1 -- 172.21.15.38:0/3592808701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5019f5a0 con 0x7f6f50103ff0 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.386+0000 7f6f4fe00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f50103ff0 0x7f6f5019a5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000ea60 tx=0x7f6f4000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.386+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000cde0 con 0x7f6f50103ff0 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.386+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5019f890 con 0x7f6f50103ff0 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.386+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f400035f0 con 0x7f6f50103ff0 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.386+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40018690 con 0x7f6f50103ff0 2024-09-12T12:24:29.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.386+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f501a7170 con 0x7f6f50103ff0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.387+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f50062940 con 0x7f6f50103ff0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.390+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6f40003a80 con 0x7f6f50103ff0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.391+0000 7f6f4cc00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6f340a2c90 0x7f6f340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.391+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6f400cfad0 con 0x7f6f50103ff0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.391+0000 7f6f4f400640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6f340a2c90 0x7f6f340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.391+0000 7f6f4cc00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] conn(0x7f6f340ade60 0x7f6f340b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.391+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 --> [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f340b09d0 con 0x7f6f340ade60 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.391+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f6f400cfe80 con 0x7f6f50103ff0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.392+0000 7f6f54e00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] conn(0x7f6f340ade60 0x7f6f340b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.392+0000 7f6f4f400640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6f340a2c90 0x7f6f340a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f500ffeb0 tx=0x7f6f3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.392+0000 7f6f54e00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] conn(0x7f6f340ade60 0x7f6f340b0300 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:29.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.393+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== osd.0 v2:172.21.15.38:6802/4152176718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f340b09d0 con 0x7f6f340ade60 2024-09-12T12:24:29.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.407+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 --> [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f50062dc0 con 0x7f6f340ade60 2024-09-12T12:24:29.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f4cc00640 1 -- 172.21.15.38:0/3592808701 <== osd.0 v2:172.21.15.38:6802/4152176718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6f50062dc0 con 0x7f6f340ade60 2024-09-12T12:24:29.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] conn(0x7f6f340ade60 msgr2=0x7f6f340b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:29.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f56e00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] conn(0x7f6f340ade60 0x7f6f340b0300 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:29.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6f340a2c90 msgr2=0x7f6f340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:29.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f56e00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6f340a2c90 0x7f6f340a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f500ffeb0 tx=0x7f6f3c005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f50103ff0 msgr2=0x7f6f5019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f56e00640 1 --2- 172.21.15.38:0/3592808701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f50103ff0 0x7f6f5019a5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000ea60 tx=0x7f6f4000ef20 comp rx=0 tx=0).stop 2024-09-12T12:24:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.408+0000 7f6f54e00640 1 -- 172.21.15.38:0/3592808701 reap_dead start 2024-09-12T12:24:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.409+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 shutdown_connections 2024-09-12T12:24:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.409+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 >> 172.21.15.38:0/3592808701 conn(0x7f6f500ffa90 msgr2=0x7f6f50100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.409+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 shutdown_connections 2024-09-12T12:24:29.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:24.409+0000 7f6f56e00640 1 -- 172.21.15.38:0/3592808701 wait complete. 2024-09-12T12:24:29.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:29 smithi038 ceph-mon[30810]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:30.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:29 smithi071 ceph-mon[34859]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:30.048 INFO:teuthology.orchestra.run.smithi038.stdout:137438953542 2024-09-12T12:24:30.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T12:24:30.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:29 smithi154 ceph-mon[35578]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:30.504 INFO:teuthology.orchestra.run.smithi038.stdout:107374182474 2024-09-12T12:24:30.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T12:24:30.827 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:30.873 INFO:teuthology.orchestra.run.smithi038.stdout:77309411409 2024-09-12T12:24:30.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T12:24:31.747 INFO:teuthology.orchestra.run.smithi038.stdout:34359738459 2024-09-12T12:24:31.748 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T12:24:31.961 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:31 smithi038 ceph-mon[30810]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:32.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:31 smithi154 ceph-mon[35578]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:32.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:31 smithi071 ceph-mon[34859]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 -- 172.21.15.38:0/2185397544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48101de0 msgr2=0x7f1a481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/2185397544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48101de0 0x7f1a481021c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009900 tx=0x7f1a3802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 -- 172.21.15.38:0/2185397544 shutdown_connections 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/2185397544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a48106f10 0x7f1a4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/2185397544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48102790 0x7f1a481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/2185397544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48101de0 0x7f1a481021c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 -- 172.21.15.38:0/2185397544 >> 172.21.15.38:0/2185397544 conn(0x7f1a480fd8c0 msgr2=0x7f1a480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 -- 172.21.15.38:0/2185397544 shutdown_connections 2024-09-12T12:24:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.253+0000 7f1a4cc00640 1 -- 172.21.15.38:0/2185397544 wait complete. 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.254+0000 7f1a4cc00640 1 Processor -- start 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.254+0000 7f1a4cc00640 1 -- start start 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.254+0000 7f1a4cc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48101de0 0x7f1a480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a4cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a48102790 0x7f1a48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a4cc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48106f10 0x7f1a48074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a4cc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1a48111f80 con 0x7f1a48106f10 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a4cc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a48111e00 con 0x7f1a48102790 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a4cc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a48112100 con 0x7f1a48101de0 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48101de0 0x7f1a480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a48102790 0x7f1a48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48101de0 0x7f1a480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:53956/0 (socket says 172.21.15.38:53956) 2024-09-12T12:24:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45e00640 1 -- 172.21.15.38:0/1819227162 learned_addr learned my addr 172.21.15.38:0/1819227162 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a46800640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48106f10 0x7f1a48074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45400640 1 -- 172.21.15.38:0/1819227162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48101de0 msgr2=0x7f1a480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45400640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48101de0 0x7f1a480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45400640 1 -- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48106f10 msgr2=0x7f1a48074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45400640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48106f10 0x7f1a48074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.255+0000 7f1a45400640 1 -- 172.21.15.38:0/1819227162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a481a68f0 con 0x7f1a48102790 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a46800640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48106f10 0x7f1a48074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a45e00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48101de0 0x7f1a480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a45400640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a48102790 0x7f1a48074a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400d6d0 tx=0x7f1a3400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a3ea00640 1 -- 172.21.15.38:0/1819227162 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34017070 con 0x7f1a48102790 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a481a6be0 con 0x7f1a48102790 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a3ea00640 1 -- 172.21.15.38:0/1819227162 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a34009820 con 0x7f1a48102790 2024-09-12T12:24:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a3ea00640 1 -- 172.21.15.38:0/1819227162 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004cd0 con 0x7f1a48102790 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.256+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a481a7170 con 0x7f1a48102790 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.257+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a481021c0 con 0x7f1a48102790 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.260+0000 7f1a3ea00640 1 -- 172.21.15.38:0/1819227162 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1a340099d0 con 0x7f1a48102790 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.261+0000 7f1a3ea00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a2c0a2c90 0x7f1a2c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.261+0000 7f1a3ea00640 1 -- 172.21.15.38:0/1819227162 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1a340cefe0 con 0x7f1a48102790 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.262+0000 7f1a45e00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a2c0a2c90 0x7f1a2c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.262+0000 7f1a45e00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a2c0a2c90 0x7f1a2c0a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a380096c0 tx=0x7f1a380046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.266+0000 7f1a3ea00640 1 -- 172.21.15.38:0/1819227162 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a3409b3f0 con 0x7f1a48102790 2024-09-12T12:24:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.455+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1a48109b60 con 0x7f1a48102790 2024-09-12T12:24:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.456+0000 7f1a3ea00640 1 -- 172.21.15.38:0/1819227162 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1a3409f6f0 con 0x7f1a48102790 2024-09-12T12:24:32.456 INFO:teuthology.orchestra.run.smithi038.stdout:210453397558 2024-09-12T12:24:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a2c0a2c90 msgr2=0x7f1a2c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a2c0a2c90 0x7f1a2c0a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a380096c0 tx=0x7f1a380046c0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a48102790 msgr2=0x7f1a48074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a48102790 0x7f1a48074a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400d6d0 tx=0x7f1a3400db90 comp rx=0 tx=0).stop 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 shutdown_connections 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f1a2c0a2c90 0x7f1a2c0a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a48106f10 0x7f1a48074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a48102790 0x7f1a48074a30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 --2- 172.21.15.38:0/1819227162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a48101de0 0x7f1a480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 >> 172.21.15.38:0/1819227162 conn(0x7f1a480fd8c0 msgr2=0x7f1a480fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 shutdown_connections 2024-09-12T12:24:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:32.458+0000 7f1a4cc00640 1 -- 172.21.15.38:0/1819227162 wait complete. 2024-09-12T12:24:32.798 INFO:teuthology.orchestra.run.smithi038.stdout:55834574933 2024-09-12T12:24:32.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T12:24:33.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:32 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1819227162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:24:33.175 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:32 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1819227162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:24:33.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:32 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1819227162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:24:33.616 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397556 got 210453397558 for osd.7 2024-09-12T12:24:33.617 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:33.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:33 smithi038 ceph-mon[30810]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-12T12:24:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.887+0000 7fc4c5c00640 1 -- 172.21.15.38:0/2571611423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c010e970 msgr2=0x7fc4c0115310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.887+0000 7fc4c5c00640 1 --2- 172.21.15.38:0/2571611423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c010e970 0x7fc4c0115310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0005fd0 tx=0x7fc4b000aea0 comp rx=0 tx=0).stop 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.889+0000 7fc4c5c00640 1 -- 172.21.15.38:0/2571611423 shutdown_connections 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.889+0000 7fc4c5c00640 1 --2- 172.21.15.38:0/2571611423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c010e970 0x7fc4c0115310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.889+0000 7fc4c5c00640 1 --2- 172.21.15.38:0/2571611423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4c0109e00 0x7fc4c010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.889+0000 7fc4c5c00640 1 --2- 172.21.15.38:0/2571611423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c0109450 0x7fc4c0109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.889+0000 7fc4c5c00640 1 -- 172.21.15.38:0/2571611423 >> 172.21.15.38:0/2571611423 conn(0x7fc4c0073180 msgr2=0x7fc4c0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:33.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.894+0000 7fc4c5c00640 1 -- 172.21.15.38:0/2571611423 shutdown_connections 2024-09-12T12:24:33.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.894+0000 7fc4c5c00640 1 -- 172.21.15.38:0/2571611423 wait complete. 2024-09-12T12:24:33.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.895+0000 7fc4c5c00640 1 Processor -- start 2024-09-12T12:24:33.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.897+0000 7fc4c5c00640 1 -- start start 2024-09-12T12:24:33.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.899+0000 7fc4c5c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c0109450 0x7fc4c01a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:33.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.899+0000 7fc4c5c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c0109e00 0x7fc4c01a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:33.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.899+0000 7fc4c5c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4c010e970 0x7fc4c019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.900+0000 7fc4bfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c0109450 0x7fc4c01a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.900+0000 7fc4bfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c0109450 0x7fc4c01a45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:58696/0 (socket says 172.21.15.38:58696) 2024-09-12T12:24:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.900+0000 7fc4bf400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c0109e00 0x7fc4c01a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.900+0000 7fc4bf400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c0109e00 0x7fc4c01a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:53976/0 (socket says 172.21.15.38:53976) 2024-09-12T12:24:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.903+0000 7fc4c5200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4c010e970 0x7fc4c019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.903+0000 7fc4c5200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4c010e970 0x7fc4c019e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33962/0 (socket says 172.21.15.38:33962) 2024-09-12T12:24:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.903+0000 7fc4bfe00640 1 -- 172.21.15.38:0/1747883323 learned_addr learned my addr 172.21.15.38:0/1747883323 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.903+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0118380 con 0x7fc4c010e970 2024-09-12T12:24:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.903+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0118200 con 0x7fc4c0109450 2024-09-12T12:24:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.904+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0118500 con 0x7fc4c0109e00 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.905+0000 7fc4bfe00640 1 -- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c0109e00 msgr2=0x7fc4c01a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.905+0000 7fc4bfe00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c0109e00 0x7fc4c01a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.905+0000 7fc4bfe00640 1 -- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4c010e970 msgr2=0x7fc4c019e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.905+0000 7fc4bfe00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4c010e970 0x7fc4c019e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.905+0000 7fc4bfe00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c019ef20 con 0x7fc4c0109450 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.905+0000 7fc4bf400640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c0109e00 0x7fc4c01a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.905+0000 7fc4c5200640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4c010e970 0x7fc4c019e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.906+0000 7fc4bfe00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c0109450 0x7fc4c01a45e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac010aa0 tx=0x7fc4ac010f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.906+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac01a030 con 0x7fc4c0109450 2024-09-12T12:24:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.906+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c019f210 con 0x7fc4c0109450 2024-09-12T12:24:33.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.906+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ac00ee20 con 0x7fc4c0109450 2024-09-12T12:24:33.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.906+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac004bc0 con 0x7fc4c0109450 2024-09-12T12:24:33.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.907+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c01ab560 con 0x7fc4c0109450 2024-09-12T12:24:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.911+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4c0062980 con 0x7fc4c0109450 2024-09-12T12:24:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.914+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc4ac01d070 con 0x7fc4c0109450 2024-09-12T12:24:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.917+0000 7fc4bcc00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc4a40a2ce0 0x7fc4a40a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.917+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc4ac0cf280 con 0x7fc4c0109450 2024-09-12T12:24:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.917+0000 7fc4bcc00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] conn(0x7fc4a40adeb0 0x7fc4a40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.918+0000 7fc4bf400640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc4a40a2ce0 0x7fc4a40a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.918+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4a40b0a20 con 0x7fc4a40adeb0 2024-09-12T12:24:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.919+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fc4ac0d6050 con 0x7fc4c0109450 2024-09-12T12:24:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.919+0000 7fc4c5200640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] conn(0x7fc4a40adeb0 0x7fc4a40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.921+0000 7fc4bf400640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc4a40a2ce0 0x7fc4a40a51a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8006fd0 tx=0x7fc4b8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.922+0000 7fc4c5200640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] conn(0x7fc4a40adeb0 0x7fc4a40b0350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.923+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== osd.5 v2:172.21.15.154:6808/908205841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4a40b0a20 con 0x7fc4a40adeb0 2024-09-12T12:24:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.953+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 --> [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4c0062e00 con 0x7fc4a40adeb0 2024-09-12T12:24:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.954+0000 7fc4bcc00640 1 -- 172.21.15.38:0/1747883323 <== osd.5 v2:172.21.15.154:6808/908205841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc4c0062e00 con 0x7fc4a40adeb0 2024-09-12T12:24:33.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.959+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] conn(0x7fc4a40adeb0 msgr2=0x7fc4a40b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.959+0000 7fc4c5c00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] conn(0x7fc4a40adeb0 0x7fc4a40b0350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.959+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc4a40a2ce0 msgr2=0x7fc4a40a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.959+0000 7fc4c5c00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc4a40a2ce0 0x7fc4a40a51a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8006fd0 tx=0x7fc4b8008040 comp rx=0 tx=0).stop 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.960+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c0109450 msgr2=0x7fc4c01a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.960+0000 7fc4c5c00640 1 --2- 172.21.15.38:0/1747883323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4c0109450 0x7fc4c01a45e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac010aa0 tx=0x7fc4ac010f60 comp rx=0 tx=0).stop 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.960+0000 7fc4c5200640 1 -- 172.21.15.38:0/1747883323 reap_dead start 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.962+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 shutdown_connections 2024-09-12T12:24:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.962+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 >> 172.21.15.38:0/1747883323 conn(0x7fc4c0073180 msgr2=0x7fc4c010c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:33.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.963+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 shutdown_connections 2024-09-12T12:24:33.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:33.963+0000 7fc4c5c00640 1 -- 172.21.15.38:0/1747883323 wait complete. 2024-09-12T12:24:34.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:33 smithi154 ceph-mon[35578]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-12T12:24:34.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:33 smithi071 ceph-mon[34859]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-12T12:24:34.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 -- 172.21.15.38:0/4211122297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3310108f60 msgr2=0x7f3310110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 --2- 172.21.15.38:0/4211122297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3310108f60 0x7f3310110ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3308009ca0 tx=0x7f330802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 -- 172.21.15.38:0/4211122297 shutdown_connections 2024-09-12T12:24:34.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 --2- 172.21.15.38:0/4211122297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3310108f60 0x7f3310110ae0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 --2- 172.21.15.38:0/4211122297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33101047e0 0x7f3310108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 --2- 172.21.15.38:0/4211122297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3310103e30 0x7f3310104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 -- 172.21.15.38:0/4211122297 >> 172.21.15.38:0/4211122297 conn(0x7f33100ff8d0 msgr2=0x7f3310101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:34.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 -- 172.21.15.38:0/4211122297 shutdown_connections 2024-09-12T12:24:34.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.915+0000 7f3315200640 1 -- 172.21.15.38:0/4211122297 wait complete. 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 Processor -- start 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 -- start start 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310103e30 0x7f331019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33101047e0 0x7f331019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3310108f60 0x7f331019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3310113fc0 con 0x7f33101047e0 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3310113e40 con 0x7f3310108f60 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f3315200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3310114140 con 0x7f3310103e30 2024-09-12T12:24:34.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f330f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310103e30 0x7f331019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f330f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310103e30 0x7f331019a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:53994/0 (socket says 172.21.15.38:53994) 2024-09-12T12:24:34.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f330f400640 1 -- 172.21.15.38:0/1821297470 learned_addr learned my addr 172.21.15.38:0/1821297470 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:34.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.917+0000 7f330ea00640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33101047e0 0x7f331019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330fe00640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3310108f60 0x7f331019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330f400640 1 -- 172.21.15.38:0/1821297470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3310108f60 msgr2=0x7f331019ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330f400640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3310108f60 0x7f331019ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330f400640 1 -- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33101047e0 msgr2=0x7f331019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330f400640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33101047e0 0x7f331019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330f400640 1 -- 172.21.15.38:0/1821297470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331019f3d0 con 0x7f3310103e30 2024-09-12T12:24:34.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330ea00640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33101047e0 0x7f331019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:34.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.918+0000 7f330f400640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310103e30 0x7f331019a420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f330000e9f0 tx=0x7f330000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:34.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.919+0000 7f3307e00640 1 -- 172.21.15.38:0/1821297470 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330000cd80 con 0x7f3310103e30 2024-09-12T12:24:34.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.919+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331019f6c0 con 0x7f3310103e30 2024-09-12T12:24:34.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.919+0000 7f3307e00640 1 -- 172.21.15.38:0/1821297470 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3300010910 con 0x7f3310103e30 2024-09-12T12:24:34.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.919+0000 7f3307e00640 1 -- 172.21.15.38:0/1821297470 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33000188f0 con 0x7f3310103e30 2024-09-12T12:24:34.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.919+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33101a6fa0 con 0x7f3310103e30 2024-09-12T12:24:34.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.920+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3310104210 con 0x7f3310103e30 2024-09-12T12:24:34.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.922+0000 7f3307e00640 1 -- 172.21.15.38:0/1821297470 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3300010ac0 con 0x7f3310103e30 2024-09-12T12:24:34.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.923+0000 7f3307e00640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f32f40a2c10 0x7f32f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.923+0000 7f3307e00640 1 -- 172.21.15.38:0/1821297470 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9179+0+0 (secure 0 0 0) 0x7f33000cfea0 con 0x7f3310103e30 2024-09-12T12:24:34.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.924+0000 7f330ea00640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f32f40a2c10 0x7f32f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.924+0000 7f330ea00640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f32f40a2c10 0x7f32f40a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f331010a930 tx=0x7f32fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:34.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:34.925+0000 7f3307e00640 1 -- 172.21.15.38:0/1821297470 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f330009c240 con 0x7f3310103e30 2024-09-12T12:24:34.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T12:24:34.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T12:24:34.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:34 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-12T12:24:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.121+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f331010c1a0 con 0x7f3310103e30 2024-09-12T12:24:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.121+0000 7f3307e00640 1 -- 172.21.15.38:0/1821297470 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f33000a0540 con 0x7f3310103e30 2024-09-12T12:24:35.122 INFO:teuthology.orchestra.run.smithi038.stdout:326417514530 2024-09-12T12:24:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.123+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f32f40a2c10 msgr2=0x7f32f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.123+0000 7f3315200640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f32f40a2c10 0x7f32f40a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f331010a930 tx=0x7f32fc005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.123+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310103e30 msgr2=0x7f331019a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.123+0000 7f3315200640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310103e30 0x7f331019a420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f330000e9f0 tx=0x7f330000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 shutdown_connections 2024-09-12T12:24:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f32f40a2c10 0x7f32f40a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3310108f60 0x7f331019ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33101047e0 0x7f331019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 --2- 172.21.15.38:0/1821297470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310103e30 0x7f331019a420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 >> 172.21.15.38:0/1821297470 conn(0x7f33100ff8d0 msgr2=0x7f3310100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 shutdown_connections 2024-09-12T12:24:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.124+0000 7f3315200640 1 -- 172.21.15.38:0/1821297470 wait complete. 2024-09-12T12:24:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T12:24:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T12:24:35.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:34 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-12T12:24:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T12:24:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T12:24:35.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:34 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-12T12:24:35.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.628+0000 7fd797200640 1 -- 172.21.15.38:0/863837414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981019c0 msgr2=0x7fd798101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.628+0000 7fd797200640 1 --2- 172.21.15.38:0/863837414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981019c0 0x7fd798101e20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd780009930 tx=0x7fd78002a420 comp rx=0 tx=0).stop 2024-09-12T12:24:35.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.629+0000 7fd797200640 1 -- 172.21.15.38:0/863837414 shutdown_connections 2024-09-12T12:24:35.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.629+0000 7fd797200640 1 --2- 172.21.15.38:0/863837414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd798102360 0x7fd79810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.629+0000 7fd797200640 1 --2- 172.21.15.38:0/863837414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981019c0 0x7fd798101e20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.629+0000 7fd797200640 1 --2- 172.21.15.38:0/863837414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981079c0 0x7fd798107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.629+0000 7fd797200640 1 -- 172.21.15.38:0/863837414 >> 172.21.15.38:0/863837414 conn(0x7fd7980fd6e0 msgr2=0x7fd7980ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.629+0000 7fd797200640 1 -- 172.21.15.38:0/863837414 shutdown_connections 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.629+0000 7fd797200640 1 -- 172.21.15.38:0/863837414 wait complete. 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 Processor -- start 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 -- start start 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981019c0 0x7fd7980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd798102360 0x7fd798074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981079c0 0x7fd798074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd798111dc0 con 0x7fd7981079c0 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd798111c40 con 0x7fd798102360 2024-09-12T12:24:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.630+0000 7fd797200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd798111f40 con 0x7fd7981019c0 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981019c0 0x7fd7980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981019c0 0x7fd7980744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58756/0 (socket says 172.21.15.38:58756) 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 -- 172.21.15.38:0/4286296565 learned_addr learned my addr 172.21.15.38:0/4286296565 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd796800640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981079c0 0x7fd798074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd78d400640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd798102360 0x7fd798074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 -- 172.21.15.38:0/4286296565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd798102360 msgr2=0x7fd798074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd798102360 0x7fd798074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 -- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981079c0 msgr2=0x7fd798074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981079c0 0x7fd798074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 -- 172.21.15.38:0/4286296565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7981a6760 con 0x7fd7981019c0 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.631+0000 7fd795e00640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981019c0 0x7fd7980744f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd78800ebc0 tx=0x7fd78800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.632+0000 7fd78f400640 1 -- 172.21.15.38:0/4286296565 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788010630 con 0x7fd7981019c0 2024-09-12T12:24:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.632+0000 7fd78f400640 1 -- 172.21.15.38:0/4286296565 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd788010cb0 con 0x7fd7981019c0 2024-09-12T12:24:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.632+0000 7fd78f400640 1 -- 172.21.15.38:0/4286296565 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788018bd0 con 0x7fd7981019c0 2024-09-12T12:24:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.632+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7981a6a50 con 0x7fd7981019c0 2024-09-12T12:24:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.632+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7981a6f60 con 0x7fd7981019c0 2024-09-12T12:24:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.633+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd798101e20 con 0x7fd7981019c0 2024-09-12T12:24:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.635+0000 7fd78f400640 1 -- 172.21.15.38:0/4286296565 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd7880107d0 con 0x7fd7981019c0 2024-09-12T12:24:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.637+0000 7fd78f400640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd77c0a2c10 0x7fd77c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.637+0000 7fd78f400640 1 -- 172.21.15.38:0/4286296565 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9179+0+0 (secure 0 0 0) 0x7fd7880cfe70 con 0x7fd7981019c0 2024-09-12T12:24:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.637+0000 7fd78d400640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd77c0a2c10 0x7fd77c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.638+0000 7fd78d400640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd77c0a2c10 0x7fd77c0a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd780009900 tx=0x7fd7800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.638+0000 7fd78f400640 1 -- 172.21.15.38:0/4286296565 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd78809c210 con 0x7fd7981019c0 2024-09-12T12:24:35.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.828+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd798075a20 con 0x7fd7981019c0 2024-09-12T12:24:35.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.828+0000 7fd78f400640 1 -- 172.21.15.38:0/4286296565 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd7880a0510 con 0x7fd7981019c0 2024-09-12T12:24:35.829 INFO:teuthology.orchestra.run.smithi038.stdout:274877906988 2024-09-12T12:24:35.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd77c0a2c10 msgr2=0x7fd77c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd77c0a2c10 0x7fd77c0a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd780009900 tx=0x7fd7800058d0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981019c0 msgr2=0x7fd7980744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981019c0 0x7fd7980744f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd78800ebc0 tx=0x7fd78800c6a0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 shutdown_connections 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd77c0a2c10 0x7fd77c0a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7981079c0 0x7fd798074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd798102360 0x7fd798074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 --2- 172.21.15.38:0/4286296565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7981019c0 0x7fd7980744f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 >> 172.21.15.38:0/4286296565 conn(0x7fd7980fd6e0 msgr2=0x7fd7980fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 shutdown_connections 2024-09-12T12:24:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:35.831+0000 7fd797200640 1 -- 172.21.15.38:0/4286296565 wait complete. 2024-09-12T12:24:36.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:35 smithi038 ceph-mon[30810]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:36.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T12:24:36.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T12:24:36.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:35 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-12T12:24:36.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:35 smithi038 ceph-mon[30810]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T12:24:36.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:35 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1821297470' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:24:36.112 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514527 got 326417514530 for osd.11 2024-09-12T12:24:36.113 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:35 smithi154 ceph-mon[35578]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T12:24:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T12:24:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:35 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-12T12:24:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:35 smithi154 ceph-mon[35578]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T12:24:36.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:35 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1821297470' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:24:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:35 smithi071 ceph-mon[34859]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T12:24:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T12:24:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:35 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-12T12:24:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:35 smithi071 ceph-mon[34859]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T12:24:36.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:35 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1821297470' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:24:36.885 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:36.890 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:36.897 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:36.898 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:36.899 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:36.904 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:36.945 INFO:teuthology.orchestra.run.smithi038.stdout:154618822721 2024-09-12T12:24:36.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T12:24:37.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:36 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/4286296565' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:24:37.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:36 smithi154 ceph-mon[35578]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T12:24:37.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:36 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/4286296565' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:24:37.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:36 smithi038 ceph-mon[30810]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T12:24:37.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:36 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/4286296565' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:24:37.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:36 smithi071 ceph-mon[34859]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T12:24:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:37.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906985 got 274877906988 for osd.9 2024-09-12T12:24:37.320 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:38.098 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:37 smithi038 ceph-mon[30810]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T12:24:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:37 smithi154 ceph-mon[35578]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T12:24:38.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:37 smithi071 ceph-mon[34859]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T12:24:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 -- 172.21.15.38:0/60978255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c1034b0 msgr2=0x7f4b1c10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 --2- 172.21.15.38:0/60978255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c1034b0 0x7f4b1c10b9a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009900 tx=0x7f4b0802a480 comp rx=0 tx=0).stop 2024-09-12T12:24:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 -- 172.21.15.38:0/60978255 shutdown_connections 2024-09-12T12:24:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 --2- 172.21.15.38:0/60978255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1c10bfc0 0x7f4b1c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 --2- 172.21.15.38:0/60978255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c1034b0 0x7f4b1c10b9a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 --2- 172.21.15.38:0/60978255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 0x7f4b1c102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 -- 172.21.15.38:0/60978255 >> 172.21.15.38:0/60978255 conn(0x7f4b1c0fc610 msgr2=0x7f4b1c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 -- 172.21.15.38:0/60978255 shutdown_connections 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.566+0000 7f4b20c00640 1 -- 172.21.15.38:0/60978255 wait complete. 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 Processor -- start 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 -- start start 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 0x7f4b1c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1c1034b0 0x7f4b1c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c10bfc0 0x7f4b1c19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c111e10 con 0x7f4b1c10bfc0 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c111c90 con 0x7f4b1c102b90 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b20c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c111f90 con 0x7f4b1c1034b0 2024-09-12T12:24:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.568+0000 7f4b1b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 0x7f4b1c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 0x7f4b1c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:60810/0 (socket says 172.21.15.38:60810) 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 -- 172.21.15.38:0/844026188 learned_addr learned my addr 172.21.15.38:0/844026188 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1be00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c10bfc0 0x7f4b1c19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1aa00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1c1034b0 0x7f4b1c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 -- 172.21.15.38:0/844026188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1c1034b0 msgr2=0x7f4b1c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1c1034b0 0x7f4b1c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 -- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c10bfc0 msgr2=0x7f4b1c19cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c10bfc0 0x7f4b1c19cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 -- 172.21.15.38:0/844026188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c19d220 con 0x7f4b1c102b90 2024-09-12T12:24:38.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b1b400640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 0x7f4b1c198270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00d950 tx=0x7f4b0c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.569+0000 7f4b13e00640 1 -- 172.21.15.38:0/844026188 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c017030 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.570+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1c19d510 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.570+0000 7f4b13e00640 1 -- 172.21.15.38:0/844026188 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b0c004020 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.570+0000 7f4b13e00640 1 -- 172.21.15.38:0/844026188 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0047a0 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.570+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1c1a4df0 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.571+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1c102f70 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.573+0000 7f4b13e00640 1 -- 172.21.15.38:0/844026188 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4b0c0041d0 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.574+0000 7f4b13e00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4b000a2c10 0x7f4b000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.574+0000 7f4b13e00640 1 -- 172.21.15.38:0/844026188 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f4b0c0cf5b0 con 0x7f4b1c102b90 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.574+0000 7f4b1aa00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4b000a2c10 0x7f4b000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:38.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.575+0000 7f4b1aa00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4b000a2c10 0x7f4b000a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b08000c00 tx=0x7f4b08005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:38.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.576+0000 7f4b13e00640 1 -- 172.21.15.38:0/844026188 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b0c09bfa0 con 0x7f4b1c102b90 2024-09-12T12:24:38.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.766+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f4b1c1995d0 con 0x7f4b1c102b90 2024-09-12T12:24:38.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.766+0000 7f4b13e00640 1 -- 172.21.15.38:0/844026188 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4b0c09b8a0 con 0x7f4b1c102b90 2024-09-12T12:24:38.767 INFO:teuthology.orchestra.run.smithi038.stdout:244813135923 2024-09-12T12:24:38.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4b000a2c10 msgr2=0x7f4b000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:38.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4b000a2c10 0x7f4b000a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b08000c00 tx=0x7f4b08005b50 comp rx=0 tx=0).stop 2024-09-12T12:24:38.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 msgr2=0x7f4b1c198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:38.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 0x7f4b1c198270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00d950 tx=0x7f4b0c00de10 comp rx=0 tx=0).stop 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 shutdown_connections 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4b000a2c10 0x7f4b000a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c10bfc0 0x7f4b1c19cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1c1034b0 0x7f4b1c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 --2- 172.21.15.38:0/844026188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b1c102b90 0x7f4b1c198270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 >> 172.21.15.38:0/844026188 conn(0x7f4b1c0fc610 msgr2=0x7f4b1c0fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 shutdown_connections 2024-09-12T12:24:38.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:38.769+0000 7f4b20c00640 1 -- 172.21.15.38:0/844026188 wait complete. 2024-09-12T12:24:38.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:38 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/844026188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:24:39.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:38 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/844026188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:24:39.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:38 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/844026188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:24:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 -- 172.21.15.38:0/2348625563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e441047e0 msgr2=0x7f6e44108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/2348625563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e441047e0 0x7f6e44108830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009900 tx=0x7f6e3002a410 comp rx=0 tx=0).stop 2024-09-12T12:24:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 -- 172.21.15.38:0/2348625563 shutdown_connections 2024-09-12T12:24:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/2348625563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e44108f60 0x7f6e44110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/2348625563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e441047e0 0x7f6e44108830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/2348625563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44103e30 0x7f6e44104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 -- 172.21.15.38:0/2348625563 >> 172.21.15.38:0/2348625563 conn(0x7f6e440ff8d0 msgr2=0x7f6e44101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 -- 172.21.15.38:0/2348625563 shutdown_connections 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.330+0000 7f6e4ae00640 1 -- 172.21.15.38:0/2348625563 wait complete. 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 Processor -- start 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 -- start start 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e44103e30 0x7f6e4419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e441047e0 0x7f6e4419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44108f60 0x7f6e4419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44113fc0 con 0x7f6e44103e30 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44113e40 con 0x7f6e44108f60 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.331+0000 7f6e4ae00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44114140 con 0x7f6e441047e0 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44108f60 0x7f6e4419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e49a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e44103e30 0x7f6e4419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44108f60 0x7f6e4419ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:60828/0 (socket says 172.21.15.38:60828) 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 -- 172.21.15.38:0/4250493659 learned_addr learned my addr 172.21.15.38:0/4250493659 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e49000640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e441047e0 0x7f6e4419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 -- 172.21.15.38:0/4250493659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e441047e0 msgr2=0x7f6e4419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e441047e0 0x7f6e4419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 -- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e44103e30 msgr2=0x7f6e4419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e44103e30 0x7f6e4419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.332+0000 7f6e4a400640 1 -- 172.21.15.38:0/4250493659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4419f430 con 0x7f6e44108f60 2024-09-12T12:24:39.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.333+0000 7f6e4a400640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44108f60 0x7f6e4419ed50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00eaa0 tx=0x7f6e3c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:39.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.333+0000 7f6e42000640 1 -- 172.21.15.38:0/4250493659 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00cdb0 con 0x7f6e44108f60 2024-09-12T12:24:39.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.333+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4419f720 con 0x7f6e44108f60 2024-09-12T12:24:39.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.333+0000 7f6e42000640 1 -- 172.21.15.38:0/4250493659 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e3c005020 con 0x7f6e44108f60 2024-09-12T12:24:39.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.333+0000 7f6e42000640 1 -- 172.21.15.38:0/4250493659 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0116b0 con 0x7f6e44108f60 2024-09-12T12:24:39.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.333+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e441a7000 con 0x7f6e44108f60 2024-09-12T12:24:39.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.334+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e44104210 con 0x7f6e44108f60 2024-09-12T12:24:39.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.336+0000 7f6e42000640 1 -- 172.21.15.38:0/4250493659 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6e3c005560 con 0x7f6e44108f60 2024-09-12T12:24:39.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.337+0000 7f6e42000640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e2c0a2c10 0x7f6e2c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.337+0000 7f6e42000640 1 -- 172.21.15.38:0/4250493659 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f6e3c0cf820 con 0x7f6e44108f60 2024-09-12T12:24:39.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.338+0000 7f6e49a00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e2c0a2c10 0x7f6e2c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.338+0000 7f6e49a00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e2c0a2c10 0x7f6e2c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009bd0 tx=0x7f6e38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:39.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.340+0000 7f6e42000640 1 -- 172.21.15.38:0/4250493659 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e3c016030 con 0x7f6e44108f60 2024-09-12T12:24:39.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.529+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6e4419b7e0 con 0x7f6e44108f60 2024-09-12T12:24:39.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.530+0000 7f6e42000640 1 -- 172.21.15.38:0/4250493659 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e4419b7e0 con 0x7f6e44108f60 2024-09-12T12:24:39.530 INFO:teuthology.orchestra.run.smithi038.stdout:77309411412 2024-09-12T12:24:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e2c0a2c10 msgr2=0x7f6e2c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e2c0a2c10 0x7f6e2c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009bd0 tx=0x7f6e38005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44108f60 msgr2=0x7f6e4419ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44108f60 0x7f6e4419ed50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00eaa0 tx=0x7f6e3c00ef60 comp rx=0 tx=0).stop 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 shutdown_connections 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e2c0a2c10 0x7f6e2c0a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e44108f60 0x7f6e4419ed50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e441047e0 0x7f6e4419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 --2- 172.21.15.38:0/4250493659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e44103e30 0x7f6e4419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 >> 172.21.15.38:0/4250493659 conn(0x7f6e440ff8d0 msgr2=0x7f6e44100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 shutdown_connections 2024-09-12T12:24:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.533+0000 7f6e4ae00640 1 -- 172.21.15.38:0/4250493659 wait complete. 2024-09-12T12:24:39.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.585+0000 7fde73800640 1 -- 172.21.15.38:0/3812317945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c076720 msgr2=0x7fde6c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.585+0000 7fde73800640 1 --2- 172.21.15.38:0/3812317945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c076720 0x7fde6c076b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fde60009900 tx=0x7fde6002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.586+0000 7fde73800640 1 -- 172.21.15.38:0/3812317945 shutdown_connections 2024-09-12T12:24:39.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.586+0000 7fde73800640 1 --2- 172.21.15.38:0/3812317945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde6c112a30 0x7fde6c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.586+0000 7fde73800640 1 --2- 172.21.15.38:0/3812317945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6c077040 0x7fde6c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.586+0000 7fde73800640 1 --2- 172.21.15.38:0/3812317945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c076720 0x7fde6c076b00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.586+0000 7fde73800640 1 -- 172.21.15.38:0/3812317945 >> 172.21.15.38:0/3812317945 conn(0x7fde6c0ffa90 msgr2=0x7fde6c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:39.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.586+0000 7fde73800640 1 -- 172.21.15.38:0/3812317945 shutdown_connections 2024-09-12T12:24:39.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.586+0000 7fde73800640 1 -- 172.21.15.38:0/3812317945 wait complete. 2024-09-12T12:24:39.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.587+0000 7fde73800640 1 Processor -- start 2024-09-12T12:24:39.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.587+0000 7fde73800640 1 -- start start 2024-09-12T12:24:39.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde73800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde6c076720 0x7fde6c1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde73800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c077040 0x7fde6c1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde73800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6c112a30 0x7fde6c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde73800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c1185c0 con 0x7fde6c076720 2024-09-12T12:24:39.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde73800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c118440 con 0x7fde6c077040 2024-09-12T12:24:39.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde73800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c118740 con 0x7fde6c112a30 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde70e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde6c076720 0x7fde6c1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde70e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde6c076720 0x7fde6c1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35074/0 (socket says 172.21.15.38:35074) 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.588+0000 7fde70e00640 1 -- 172.21.15.38:0/3357417032 learned_addr learned my addr 172.21.15.38:0/3357417032 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde6be00640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c077040 0x7fde6c1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde71800640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6c112a30 0x7fde6c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde6be00640 1 -- 172.21.15.38:0/3357417032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6c112a30 msgr2=0x7fde6c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde6be00640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6c112a30 0x7fde6c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde6be00640 1 -- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde6c076720 msgr2=0x7fde6c1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde6be00640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde6c076720 0x7fde6c1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde6be00640 1 -- 172.21.15.38:0/3357417032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c19f000 con 0x7fde6c077040 2024-09-12T12:24:39.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.589+0000 7fde6be00640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c077040 0x7fde6c1a4c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde5800e9f0 tx=0x7fde5800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:39.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.590+0000 7fde69600640 1 -- 172.21.15.38:0/3357417032 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5800ccc0 con 0x7fde6c077040 2024-09-12T12:24:39.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.590+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6c19f2f0 con 0x7fde6c077040 2024-09-12T12:24:39.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.590+0000 7fde69600640 1 -- 172.21.15.38:0/3357417032 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde58005020 con 0x7fde6c077040 2024-09-12T12:24:39.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.590+0000 7fde69600640 1 -- 172.21.15.38:0/3357417032 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58004a00 con 0x7fde6c077040 2024-09-12T12:24:39.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.590+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6c1ab5e0 con 0x7fde6c077040 2024-09-12T12:24:39.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.591+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde6c076b00 con 0x7fde6c077040 2024-09-12T12:24:39.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.593+0000 7fde69600640 1 -- 172.21.15.38:0/3357417032 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fde580051d0 con 0x7fde6c077040 2024-09-12T12:24:39.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.596+0000 7fde69600640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fde540a2c90 0x7fde540a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.596+0000 7fde69600640 1 -- 172.21.15.38:0/3357417032 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fde580cf4b0 con 0x7fde6c077040 2024-09-12T12:24:39.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.596+0000 7fde70e00640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fde540a2c90 0x7fde540a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.597+0000 7fde69600640 1 -- 172.21.15.38:0/3357417032 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde5809bea0 con 0x7fde6c077040 2024-09-12T12:24:39.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.597+0000 7fde70e00640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fde540a2c90 0x7fde540a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fde600096c0 tx=0x7fde60005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:39.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.833+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fde6c19fe00 con 0x7fde6c077040 2024-09-12T12:24:39.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.834+0000 7fde69600640 1 -- 172.21.15.38:0/3357417032 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fde6c19fe00 con 0x7fde6c077040 2024-09-12T12:24:39.834 INFO:teuthology.orchestra.run.smithi038.stdout:107374182477 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fde540a2c90 msgr2=0x7fde540a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fde540a2c90 0x7fde540a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fde600096c0 tx=0x7fde60005a20 comp rx=0 tx=0).stop 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c077040 msgr2=0x7fde6c1a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c077040 0x7fde6c1a4c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde5800e9f0 tx=0x7fde5800edf0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 shutdown_connections 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fde540a2c90 0x7fde540a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6c112a30 0x7fde6c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde6c077040 0x7fde6c1a4c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 --2- 172.21.15.38:0/3357417032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde6c076720 0x7fde6c1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.837+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 >> 172.21.15.38:0/3357417032 conn(0x7fde6c0ffa90 msgr2=0x7fde6c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:39.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.838+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 shutdown_connections 2024-09-12T12:24:39.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.838+0000 7fde73800640 1 -- 172.21.15.38:0/3357417032 wait complete. 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 -- 172.21.15.38:0/2232517581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c102370 msgr2=0x7f2b5c10e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 --2- 172.21.15.38:0/2232517581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c102370 0x7f2b5c10e8a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009cd0 tx=0x7f2b5402a8f0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 -- 172.21.15.38:0/2232517581 shutdown_connections 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 --2- 172.21.15.38:0/2232517581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c102370 0x7f2b5c10e8a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 --2- 172.21.15.38:0/2232517581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b5c1019d0 0x7f2b5c101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 --2- 172.21.15.38:0/2232517581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c1079d0 0x7f2b5c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 -- 172.21.15.38:0/2232517581 >> 172.21.15.38:0/2232517581 conn(0x7f2b5c0fd710 msgr2=0x7f2b5c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 -- 172.21.15.38:0/2232517581 shutdown_connections 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.964+0000 7f2b60e00640 1 -- 172.21.15.38:0/2232517581 wait complete. 2024-09-12T12:24:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.965+0000 7f2b60e00640 1 Processor -- start 2024-09-12T12:24:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b60e00640 1 -- start start 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b60e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c1019d0 0x7f2b5c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b60e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c102370 0x7f2b5c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b60e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b5c1079d0 0x7f2b5c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b60e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c111dd0 con 0x7f2b5c1019d0 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b60e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c111c50 con 0x7f2b5c1079d0 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b60e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c111f50 con 0x7f2b5c102370 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.966+0000 7f2b5b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c1019d0 0x7f2b5c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c102370 0x7f2b5c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c1019d0 0x7f2b5c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35116/0 (socket says 172.21.15.38:35116) 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5b400640 1 -- 172.21.15.38:0/3931538391 learned_addr learned my addr 172.21.15.38:0/3931538391 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c102370 0x7f2b5c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58838/0 (socket says 172.21.15.38:58838) 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5be00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b5c1079d0 0x7f2b5c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 -- 172.21.15.38:0/3931538391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b5c1079d0 msgr2=0x7f2b5c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b5c1079d0 0x7f2b5c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 -- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c1019d0 msgr2=0x7f2b5c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c1019d0 0x7f2b5c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 -- 172.21.15.38:0/3931538391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c1a66b0 con 0x7f2b5c102370 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5be00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b5c1079d0 0x7f2b5c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.967+0000 7f2b5aa00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c102370 0x7f2b5c074a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800e9f0 tx=0x7f2b4800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.968+0000 7f2b53e00640 1 -- 172.21.15.38:0/3931538391 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800ccc0 con 0x7f2b5c102370 2024-09-12T12:24:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.968+0000 7f2b53e00640 1 -- 172.21.15.38:0/3931538391 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b48010910 con 0x7f2b5c102370 2024-09-12T12:24:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.968+0000 7f2b53e00640 1 -- 172.21.15.38:0/3931538391 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b48018960 con 0x7f2b5c102370 2024-09-12T12:24:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.968+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c1a69a0 con 0x7f2b5c102370 2024-09-12T12:24:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.968+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c1a6f30 con 0x7f2b5c102370 2024-09-12T12:24:39.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.969+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c101e30 con 0x7f2b5c102370 2024-09-12T12:24:39.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.972+0000 7f2b53e00640 1 -- 172.21.15.38:0/3931538391 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2b48010ac0 con 0x7f2b5c102370 2024-09-12T12:24:39.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:39 smithi038 ceph-mon[30810]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:39.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:39 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/4250493659' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:24:39.972 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:39 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3357417032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:24:39.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.974+0000 7f2b53e00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b400a2c90 0x7f2b400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.974+0000 7f2b53e00640 1 -- 172.21.15.38:0/3931538391 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2b480cfd90 con 0x7f2b5c102370 2024-09-12T12:24:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.974+0000 7f2b5b400640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b400a2c90 0x7f2b400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.975+0000 7f2b53e00640 1 -- 172.21.15.38:0/3931538391 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b4809c130 con 0x7f2b5c102370 2024-09-12T12:24:39.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.975+0000 7f2b5b400640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b400a2c90 0x7f2b400a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009c10 tx=0x7f2b4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:40.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.840+0000 7fdb47e00640 1 -- 172.21.15.38:0/3465575024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 msgr2=0x7fdb48108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.840+0000 7fdb47e00640 1 --2- 172.21.15.38:0/3465575024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 0x7fdb48108830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009860 tx=0x7fdb3402a340 comp rx=0 tx=0).stop 2024-09-12T12:24:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.841+0000 7fdb47e00640 1 -- 172.21.15.38:0/3465575024 shutdown_connections 2024-09-12T12:24:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.841+0000 7fdb47e00640 1 --2- 172.21.15.38:0/3465575024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb48108f60 0x7fdb48110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.841+0000 7fdb47e00640 1 --2- 172.21.15.38:0/3465575024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 0x7fdb48108830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.841+0000 7fdb47e00640 1 --2- 172.21.15.38:0/3465575024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb48103e30 0x7fdb48104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.841+0000 7fdb47e00640 1 -- 172.21.15.38:0/3465575024 >> 172.21.15.38:0/3465575024 conn(0x7fdb480ff8f0 msgr2=0x7fdb48101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.841+0000 7fdb47e00640 1 -- 172.21.15.38:0/3465575024 shutdown_connections 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.841+0000 7fdb47e00640 1 -- 172.21.15.38:0/3465575024 wait complete. 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 Processor -- start 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 -- start start 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb48103e30 0x7fdb4819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 0x7fdb4819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb48108f60 0x7fdb4819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48113f80 con 0x7fdb48108f60 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48113e00 con 0x7fdb481047e0 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.842+0000 7fdb47e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48114100 con 0x7fdb48103e30 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb48103e30 0x7fdb4819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 0x7fdb4819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb48103e30 0x7fdb4819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58816/0 (socket says 172.21.15.38:58816) 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46a00640 1 -- 172.21.15.38:0/964430111 learned_addr learned my addr 172.21.15.38:0/964430111 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb47400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb48108f60 0x7fdb4819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46000640 1 -- 172.21.15.38:0/964430111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb48103e30 msgr2=0x7fdb4819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46000640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb48103e30 0x7fdb4819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46000640 1 -- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb48108f60 msgr2=0x7fdb4819ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46000640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb48108f60 0x7fdb4819ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.843+0000 7fdb46000640 1 -- 172.21.15.38:0/964430111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4819f510 con 0x7fdb481047e0 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.844+0000 7fdb46000640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 0x7fdb4819aaa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb34035040 tx=0x7fdb34033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.844+0000 7fdb3f400640 1 -- 172.21.15.38:0/964430111 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3403f020 con 0x7fdb481047e0 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.844+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4819f7a0 con 0x7fdb481047e0 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.844+0000 7fdb3f400640 1 -- 172.21.15.38:0/964430111 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb34030550 con 0x7fdb481047e0 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.844+0000 7fdb3f400640 1 -- 172.21.15.38:0/964430111 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34037040 con 0x7fdb481047e0 2024-09-12T12:24:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.844+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb481a70e0 con 0x7fdb481047e0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.846+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb48104210 con 0x7fdb481047e0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.849+0000 7fdb3f400640 1 -- 172.21.15.38:0/964430111 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdb34042020 con 0x7fdb481047e0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.851+0000 7fdb3f400640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdb2c0a2c10 0x7fdb2c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.851+0000 7fdb3f400640 1 -- 172.21.15.38:0/964430111 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fdb340ef850 con 0x7fdb481047e0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.852+0000 7fdb46a00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdb2c0a2c10 0x7fdb2c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.852+0000 7fdb3f400640 1 -- 172.21.15.38:0/964430111 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb34049020 con 0x7fdb481047e0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:39.853+0000 7fdb46a00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdb2c0a2c10 0x7fdb2c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb38005c80 tx=0x7fdb38009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.046+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdb4810c140 con 0x7fdb481047e0 2024-09-12T12:24:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.047+0000 7fdb3f400640 1 -- 172.21.15.38:0/964430111 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdb340bc350 con 0x7fdb481047e0 2024-09-12T12:24:40.128 INFO:teuthology.orchestra.run.smithi038.stdout:137438953545 2024-09-12T12:24:40.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdb2c0a2c10 msgr2=0x7fdb2c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdb2c0a2c10 0x7fdb2c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb38005c80 tx=0x7fdb38009260 comp rx=0 tx=0).stop 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 msgr2=0x7fdb4819aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 0x7fdb4819aaa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb34035040 tx=0x7fdb34033b60 comp rx=0 tx=0).stop 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 shutdown_connections 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdb2c0a2c10 0x7fdb2c0a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb48108f60 0x7fdb4819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb481047e0 0x7fdb4819aaa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 --2- 172.21.15.38:0/964430111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb48103e30 0x7fdb4819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 >> 172.21.15.38:0/964430111 conn(0x7fdb480ff8f0 msgr2=0x7fdb48100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 shutdown_connections 2024-09-12T12:24:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.050+0000 7fdb47e00640 1 -- 172.21.15.38:0/964430111 wait complete. 2024-09-12T12:24:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:39 smithi154 ceph-mon[35578]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:39 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/4250493659' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:24:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:39 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3357417032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:24:40.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.182+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2b5c075a20 con 0x7f2b5c102370 2024-09-12T12:24:40.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.183+0000 7f2b53e00640 1 -- 172.21.15.38:0/3931538391 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b480a0430 con 0x7f2b5c102370 2024-09-12T12:24:40.183 INFO:teuthology.orchestra.run.smithi038.stdout:34359738462 2024-09-12T12:24:40.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b400a2c90 msgr2=0x7f2b400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:40.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b400a2c90 0x7f2b400a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009c10 tx=0x7f2b4c005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:40.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c102370 msgr2=0x7f2b5c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:40.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c102370 0x7f2b5c074a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800e9f0 tx=0x7f2b4800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 shutdown_connections 2024-09-12T12:24:40.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b400a2c90 0x7f2b400a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b5c1079d0 0x7f2b5c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b5c102370 0x7f2b5c074a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 --2- 172.21.15.38:0/3931538391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b5c1019d0 0x7f2b5c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:40.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 >> 172.21.15.38:0/3931538391 conn(0x7f2b5c0fd710 msgr2=0x7f2b5c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:40.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 shutdown_connections 2024-09-12T12:24:40.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:40.185+0000 7f2b60e00640 1 -- 172.21.15.38:0/3931538391 wait complete. 2024-09-12T12:24:40.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:39 smithi071 ceph-mon[34859]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:40.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:39 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/4250493659' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:24:40.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:39 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3357417032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:24:41.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:40 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/964430111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:24:41.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:40 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3931538391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:24:41.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:40 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/964430111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:24:41.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:40 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3931538391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:24:41.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:40 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/964430111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:24:41.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:40 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3931538391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:24:41.904 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953542 got 137438953545 for osd.4 2024-09-12T12:24:41.905 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:42.115 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:41 smithi038 ceph-mon[30810]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:42.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:41 smithi154 ceph-mon[35578]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:42.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:41 smithi071 ceph-mon[34859]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:42.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738459 got 34359738462 for osd.0 2024-09-12T12:24:42.777 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:42.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 -- 172.21.15.38:0/3674633784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 msgr2=0x7fd5d810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 --2- 172.21.15.38:0/3674633784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 0x7fd5d810de80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009900 tx=0x7fd5c402a480 comp rx=0 tx=0).stop 2024-09-12T12:24:42.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 -- 172.21.15.38:0/3674633784 shutdown_connections 2024-09-12T12:24:42.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 --2- 172.21.15.38:0/3674633784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d810e3c0 0x7fd5d8110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 --2- 172.21.15.38:0/3674633784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 0x7fd5d810de80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 --2- 172.21.15.38:0/3674633784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d8074620 0x7fd5d8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 -- 172.21.15.38:0/3674633784 >> 172.21.15.38:0/3674633784 conn(0x7fd5d80fd8c0 msgr2=0x7fd5d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:42.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 -- 172.21.15.38:0/3674633784 shutdown_connections 2024-09-12T12:24:42.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.964+0000 7fd5df800640 1 -- 172.21.15.38:0/3674633784 wait complete. 2024-09-12T12:24:42.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 Processor -- start 2024-09-12T12:24:42.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 -- start start 2024-09-12T12:24:42.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d8074620 0x7fd5d819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 0x7fd5d819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d810e3c0 0x7fd5d819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8114140 con 0x7fd5d8074f40 2024-09-12T12:24:42.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8113fc0 con 0x7fd5d810e3c0 2024-09-12T12:24:42.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.966+0000 7fd5df800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d81142c0 con 0x7fd5d8074620 2024-09-12T12:24:42.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5d7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 0x7fd5d819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5d7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 0x7fd5d819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35134/0 (socket says 172.21.15.38:35134) 2024-09-12T12:24:42.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5d7e00640 1 -- 172.21.15.38:0/1614952621 learned_addr learned my addr 172.21.15.38:0/1614952621 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:42.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dce00640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d8074620 0x7fd5d819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dd800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d810e3c0 0x7fd5d819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dce00640 1 -- 172.21.15.38:0/1614952621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d810e3c0 msgr2=0x7fd5d819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dce00640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d810e3c0 0x7fd5d819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dce00640 1 -- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 msgr2=0x7fd5d819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dce00640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 0x7fd5d819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dce00640 1 -- 172.21.15.38:0/1614952621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d819f590 con 0x7fd5d8074620 2024-09-12T12:24:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.967+0000 7fd5dd800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d810e3c0 0x7fd5d819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.968+0000 7fd5dce00640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d8074620 0x7fd5d819a5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c970 tx=0x7fd5cc00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:42.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.968+0000 7fd5d5600640 1 -- 172.21.15.38:0/1614952621 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc007bb0 con 0x7fd5d8074620 2024-09-12T12:24:42.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.968+0000 7fd5d5600640 1 -- 172.21.15.38:0/1614952621 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5cc007d50 con 0x7fd5d8074620 2024-09-12T12:24:42.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.968+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d819f880 con 0x7fd5d8074620 2024-09-12T12:24:42.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.968+0000 7fd5d5600640 1 -- 172.21.15.38:0/1614952621 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc018820 con 0x7fd5d8074620 2024-09-12T12:24:42.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.968+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d81a7160 con 0x7fd5d8074620 2024-09-12T12:24:42.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.969+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d8074a00 con 0x7fd5d8074620 2024-09-12T12:24:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.971+0000 7fd5d5600640 1 -- 172.21.15.38:0/1614952621 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd5cc043b10 con 0x7fd5d8074620 2024-09-12T12:24:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.972+0000 7fd5d5600640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd5c00a2c10 0x7fd5c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.973+0000 7fd5d5600640 1 -- 172.21.15.38:0/1614952621 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fd5cc0cf730 con 0x7fd5d8074620 2024-09-12T12:24:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.973+0000 7fd5d7e00640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd5c00a2c10 0x7fd5c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.973+0000 7fd5d7e00640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd5c00a2c10 0x7fd5c00a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4031550 tx=0x7fd5c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:42.975+0000 7fd5d5600640 1 -- 172.21.15.38:0/1614952621 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5cc014030 con 0x7fd5d8074620 2024-09-12T12:24:43.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.162+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd5d819b940 con 0x7fd5d8074620 2024-09-12T12:24:43.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.162+0000 7fd5d5600640 1 -- 172.21.15.38:0/1614952621 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd5cc09c120 con 0x7fd5d8074620 2024-09-12T12:24:43.163 INFO:teuthology.orchestra.run.smithi038.stdout:188978561087 2024-09-12T12:24:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd5c00a2c10 msgr2=0x7fd5c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd5c00a2c10 0x7fd5c00a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4031550 tx=0x7fd5c4005a20 comp rx=0 tx=0).stop 2024-09-12T12:24:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d8074620 msgr2=0x7fd5d819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d8074620 0x7fd5d819a5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c970 tx=0x7fd5cc00ce30 comp rx=0 tx=0).stop 2024-09-12T12:24:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 shutdown_connections 2024-09-12T12:24:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd5c00a2c10 0x7fd5c00a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5d810e3c0 0x7fd5d819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5d8074f40 0x7fd5d819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 --2- 172.21.15.38:0/1614952621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d8074620 0x7fd5d819a5e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 >> 172.21.15.38:0/1614952621 conn(0x7fd5d80fd8c0 msgr2=0x7fd5d80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 shutdown_connections 2024-09-12T12:24:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.165+0000 7fd5df800640 1 -- 172.21.15.38:0/1614952621 wait complete. 2024-09-12T12:24:43.465 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182474 got 107374182477 for osd.3 2024-09-12T12:24:43.466 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:43.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.658+0000 7ff398400640 1 -- 172.21.15.38:0/2264954615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 msgr2=0x7ff390114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.658+0000 7ff398400640 1 --2- 172.21.15.38:0/2264954615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 0x7ff390114e20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff388009900 tx=0x7ff38802a410 comp rx=0 tx=0).stop 2024-09-12T12:24:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.659+0000 7ff398400640 1 -- 172.21.15.38:0/2264954615 shutdown_connections 2024-09-12T12:24:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.659+0000 7ff398400640 1 --2- 172.21.15.38:0/2264954615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 0x7ff390114e20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.659+0000 7ff398400640 1 --2- 172.21.15.38:0/2264954615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390077040 0x7ff3901124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.659+0000 7ff398400640 1 --2- 172.21.15.38:0/2264954615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff390076720 0x7ff390076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.659+0000 7ff398400640 1 -- 172.21.15.38:0/2264954615 >> 172.21.15.38:0/2264954615 conn(0x7ff3900ffa90 msgr2=0x7ff390101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.659+0000 7ff398400640 1 -- 172.21.15.38:0/2264954615 shutdown_connections 2024-09-12T12:24:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.659+0000 7ff398400640 1 -- 172.21.15.38:0/2264954615 wait complete. 2024-09-12T12:24:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 Processor -- start 2024-09-12T12:24:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 -- start start 2024-09-12T12:24:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390076720 0x7ff3901a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff390077040 0x7ff3901a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 0x7ff39019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff3901185e0 con 0x7ff390112a30 2024-09-12T12:24:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff390118460 con 0x7ff390077040 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff398400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff390118760 con 0x7ff390076720 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff395a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390076720 0x7ff3901a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff395a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390076720 0x7ff3901a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58886/0 (socket says 172.21.15.38:58886) 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff395a00640 1 -- 172.21.15.38:0/2770517212 learned_addr learned my addr 172.21.15.38:0/2770517212 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.660+0000 7ff396400640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 0x7ff39019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff395000640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff390077040 0x7ff3901a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff395a00640 1 -- 172.21.15.38:0/2770517212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff390077040 msgr2=0x7ff3901a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff395a00640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff390077040 0x7ff3901a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff395a00640 1 -- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 msgr2=0x7ff39019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff395a00640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 0x7ff39019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff395a00640 1 -- 172.21.15.38:0/2770517212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39019f040 con 0x7ff390076720 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff395a00640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390076720 0x7ff3901a4750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff38400ebc0 tx=0x7ff38400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.661+0000 7ff38e000640 1 -- 172.21.15.38:0/2770517212 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384010630 con 0x7ff390076720 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.662+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39019f330 con 0x7ff390076720 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.662+0000 7ff38e000640 1 -- 172.21.15.38:0/2770517212 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff384010cb0 con 0x7ff390076720 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.662+0000 7ff38e000640 1 -- 172.21.15.38:0/2770517212 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384018bd0 con 0x7ff390076720 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.662+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3901ab620 con 0x7ff390076720 2024-09-12T12:24:43.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.663+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff390076b00 con 0x7ff390076720 2024-09-12T12:24:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.665+0000 7ff38e000640 1 -- 172.21.15.38:0/2770517212 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff3840107d0 con 0x7ff390076720 2024-09-12T12:24:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.666+0000 7ff38e000640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3780a2c90 0x7ff3780a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.666+0000 7ff38e000640 1 -- 172.21.15.38:0/2770517212 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff3840cfd50 con 0x7ff390076720 2024-09-12T12:24:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.666+0000 7ff395000640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3780a2c90 0x7ff3780a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.667+0000 7ff395000640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3780a2c90 0x7ff3780a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff3900796d0 tx=0x7ff37c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:43.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.668+0000 7ff38e000640 1 -- 172.21.15.38:0/2770517212 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff38409c0f0 con 0x7ff390076720 2024-09-12T12:24:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.862+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff39010dbf0 con 0x7ff390076720 2024-09-12T12:24:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.863+0000 7ff38e000640 1 -- 172.21.15.38:0/2770517212 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3840a03f0 con 0x7ff390076720 2024-09-12T12:24:43.864 INFO:teuthology.orchestra.run.smithi038.stdout:55834574936 2024-09-12T12:24:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3780a2c90 msgr2=0x7ff3780a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3780a2c90 0x7ff3780a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff3900796d0 tx=0x7ff37c005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390076720 msgr2=0x7ff3901a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390076720 0x7ff3901a4750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff38400ebc0 tx=0x7ff38400c6a0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 shutdown_connections 2024-09-12T12:24:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3780a2c90 0x7ff3780a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff390112a30 0x7ff39019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff390077040 0x7ff3901a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 --2- 172.21.15.38:0/2770517212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff390076720 0x7ff3901a4750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 >> 172.21.15.38:0/2770517212 conn(0x7ff3900ffa90 msgr2=0x7ff390113630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 shutdown_connections 2024-09-12T12:24:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.867+0000 7ff398400640 1 -- 172.21.15.38:0/2770517212 wait complete. 2024-09-12T12:24:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.928+0000 7fb2fe200640 1 -- 172.21.15.38:0/3471931075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8103e30 msgr2=0x7fb2f8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.928+0000 7fb2fe200640 1 --2- 172.21.15.38:0/3471931075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8103e30 0x7fb2f8104210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009900 tx=0x7fb2ec02a410 comp rx=0 tx=0).stop 2024-09-12T12:24:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.929+0000 7fb2fe200640 1 -- 172.21.15.38:0/3471931075 shutdown_connections 2024-09-12T12:24:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.929+0000 7fb2fe200640 1 --2- 172.21.15.38:0/3471931075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8108f60 0x7fb2f8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.929+0000 7fb2fe200640 1 --2- 172.21.15.38:0/3471931075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f81047e0 0x7fb2f8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.929+0000 7fb2fe200640 1 --2- 172.21.15.38:0/3471931075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8103e30 0x7fb2f8104210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.929+0000 7fb2fe200640 1 -- 172.21.15.38:0/3471931075 >> 172.21.15.38:0/3471931075 conn(0x7fb2f80ff910 msgr2=0x7fb2f8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.929+0000 7fb2fe200640 1 -- 172.21.15.38:0/3471931075 shutdown_connections 2024-09-12T12:24:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.929+0000 7fb2fe200640 1 -- 172.21.15.38:0/3471931075 wait complete. 2024-09-12T12:24:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 Processor -- start 2024-09-12T12:24:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 -- start start 2024-09-12T12:24:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8103e30 0x7fb2f819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f81047e0 0x7fb2f819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8108f60 0x7fb2f819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f8114010 con 0x7fb2f8108f60 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f8113e90 con 0x7fb2f81047e0 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.930+0000 7fb2fe200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f8114190 con 0x7fb2f8103e30 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8103e30 0x7fb2f819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8103e30 0x7fb2f819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58904/0 (socket says 172.21.15.38:58904) 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 -- 172.21.15.38:0/65908721 learned_addr learned my addr 172.21.15.38:0/65908721 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2f7e00640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f81047e0 0x7fb2f819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fd800640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8108f60 0x7fb2f819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 -- 172.21.15.38:0/65908721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f81047e0 msgr2=0x7fb2f819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f81047e0 0x7fb2f819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 -- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8108f60 msgr2=0x7fb2f819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8108f60 0x7fb2f819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.931+0000 7fb2fce00640 1 -- 172.21.15.38:0/65908721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f819f420 con 0x7fb2f8103e30 2024-09-12T12:24:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.932+0000 7fb2fce00640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8103e30 0x7fb2f819a470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec02a980 tx=0x7fb2ec003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.932+0000 7fb2f5600640 1 -- 172.21.15.38:0/65908721 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec03f070 con 0x7fb2f8103e30 2024-09-12T12:24:43.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.932+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f819f6b0 con 0x7fb2f8103e30 2024-09-12T12:24:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.932+0000 7fb2f5600640 1 -- 172.21.15.38:0/65908721 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2ec031c90 con 0x7fb2f8103e30 2024-09-12T12:24:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.932+0000 7fb2f5600640 1 -- 172.21.15.38:0/65908721 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec035030 con 0x7fb2f8103e30 2024-09-12T12:24:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.932+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f81a6ff0 con 0x7fb2f8103e30 2024-09-12T12:24:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.934+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f8105310 con 0x7fb2f8103e30 2024-09-12T12:24:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.935+0000 7fb2f5600640 1 -- 172.21.15.38:0/65908721 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb2ec042070 con 0x7fb2f8103e30 2024-09-12T12:24:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.937+0000 7fb2f5600640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb2e00a2c60 0x7fb2e00a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.937+0000 7fb2f5600640 1 -- 172.21.15.38:0/65908721 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fb2ec0efc40 con 0x7fb2f8103e30 2024-09-12T12:24:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.937+0000 7fb2f7e00640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb2e00a2c60 0x7fb2e00a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.938+0000 7fb2f7e00640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb2e00a2c60 0x7fb2e00a5120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40095f0 tx=0x7fb2e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:43.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:43.941+0000 7fb2f5600640 1 -- 172.21.15.38:0/65908721 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2ec0bbfe0 con 0x7fb2f8103e30 2024-09-12T12:24:44.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.128+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fb2f8104210 con 0x7fb2f8103e30 2024-09-12T12:24:44.129 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:43 smithi038 ceph-mon[30810]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:44.129 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:43 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1614952621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:24:44.129 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:43 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2770517212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:24:44.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.129+0000 7fb2f5600640 1 -- 172.21.15.38:0/65908721 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fb2f8104210 con 0x7fb2f8103e30 2024-09-12T12:24:44.130 INFO:teuthology.orchestra.run.smithi038.stdout:296352743464 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb2e00a2c60 msgr2=0x7fb2e00a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb2e00a2c60 0x7fb2e00a5120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40095f0 tx=0x7fb2e4005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8103e30 msgr2=0x7fb2f819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8103e30 0x7fb2f819a470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec02a980 tx=0x7fb2ec003b90 comp rx=0 tx=0).stop 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 shutdown_connections 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb2e00a2c60 0x7fb2e00a5120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2f8108f60 0x7fb2f819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f81047e0 0x7fb2f819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 --2- 172.21.15.38:0/65908721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8103e30 0x7fb2f819a470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 >> 172.21.15.38:0/65908721 conn(0x7fb2f80ff910 msgr2=0x7fb2f8100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:44.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.131+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 shutdown_connections 2024-09-12T12:24:44.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:44.132+0000 7fb2fe200640 1 -- 172.21.15.38:0/65908721 wait complete. 2024-09-12T12:24:44.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:43 smithi154 ceph-mon[35578]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:44.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:43 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1614952621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:24:44.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:43 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2770517212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:24:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:43 smithi071 ceph-mon[34859]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:43 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1614952621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:24:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:43 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2770517212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:24:45.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:44 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/65908721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:24:45.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:44 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/65908721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:24:45.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:44 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/65908721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:24:45.454 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411409 got 77309411412 for osd.2 2024-09-12T12:24:45.454 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:46.079 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:45 smithi038 ceph-mon[30810]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 12 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:46.117 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135921 got 244813135923 for osd.8 2024-09-12T12:24:46.118 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:45 smithi154 ceph-mon[35578]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 12 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:46.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:45 smithi071 ceph-mon[34859]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 12 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:24:46.449 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743460 got 296352743464 for osd.10 2024-09-12T12:24:46.449 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:46.882 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561083 got 188978561087 for osd.6 2024-09-12T12:24:46.883 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:47.281 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574933 got 55834574936 for osd.1 2024-09-12T12:24:47.281 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:47.341 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 -- 172.21.15.38:0/2864112580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41079c0 msgr2=0x7f3fa4107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2864112580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41079c0 0x7f3fa4107da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009cd0 tx=0x7f3f9402a8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 -- 172.21.15.38:0/2864112580 shutdown_connections 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2864112580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fa4102360 0x7f3fa410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2864112580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41019c0 0x7f3fa4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2864112580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41079c0 0x7f3fa4107da0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 -- 172.21.15.38:0/2864112580 >> 172.21.15.38:0/2864112580 conn(0x7f3fa40fd740 msgr2=0x7f3fa40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:47.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 -- 172.21.15.38:0/2864112580 shutdown_connections 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.908+0000 7f3fa3200640 1 -- 172.21.15.38:0/2864112580 wait complete. 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.909+0000 7f3fa3200640 1 Processor -- start 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.909+0000 7f3fa3200640 1 -- start start 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa3200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41019c0 0x7f3fa419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa3200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa4102360 0x7f3fa419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fa41079c0 0x7f3fa419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa3200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4111dd0 con 0x7f3fa41019c0 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4111c50 con 0x7f3fa41079c0 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa3200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4111f50 con 0x7f3fa4102360 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41019c0 0x7f3fa419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41019c0 0x7f3fa419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38798/0 (socket says 172.21.15.38:38798) 2024-09-12T12:24:47.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa2800640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fa41079c0 0x7f3fa419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 -- 172.21.15.38:0/2652729371 learned_addr learned my addr 172.21.15.38:0/2652729371 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3f99400640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa4102360 0x7f3fa419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 -- 172.21.15.38:0/2652729371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa4102360 msgr2=0x7f3fa419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa4102360 0x7f3fa419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 -- 172.21.15.38:0/2652729371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fa41079c0 msgr2=0x7f3fa419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fa41079c0 0x7f3fa419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa1e00640 1 -- 172.21.15.38:0/2652729371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa419f440 con 0x7f3fa41019c0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.910+0000 7f3fa2800640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fa41079c0 0x7f3fa419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.911+0000 7f3fa1e00640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41019c0 0x7f3fa419a490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3f94033040 tx=0x7f3f94003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.911+0000 7f3f9b400640 1 -- 172.21.15.38:0/2652729371 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94004040 con 0x7f3fa41019c0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.911+0000 7f3f9b400640 1 -- 172.21.15.38:0/2652729371 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f940046c0 con 0x7f3fa41019c0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.911+0000 7f3f9b400640 1 -- 172.21.15.38:0/2652729371 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94046480 con 0x7f3fa41019c0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.911+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa419f6d0 con 0x7f3fa41019c0 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.911+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa41a7010 con 0x7f3fa41019c0 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.912+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa4103100 con 0x7f3fa41019c0 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.914+0000 7f3f9b400640 1 -- 172.21.15.38:0/2652729371 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3f940305a0 con 0x7f3fa41019c0 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.916+0000 7f3f9b400640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3f880a2c90 0x7f3f880a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.916+0000 7f3f9b400640 1 -- 172.21.15.38:0/2652729371 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f3f9402e030 con 0x7f3fa41019c0 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.917+0000 7f3f99400640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3f880a2c90 0x7f3f880a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.917+0000 7f3f99400640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3f880a2c90 0x7f3f880a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fa410e9e0 tx=0x7f3f8c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:47.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:47.921+0000 7f3f9b400640 1 -- 172.21.15.38:0/2652729371 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f9404b060 con 0x7f3fa41019c0 2024-09-12T12:24:48.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.107+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3fa41a71e0 con 0x7f3fa41019c0 2024-09-12T12:24:48.107 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:47 smithi038 ceph-mon[30810]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:24:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.107+0000 7f3f9b400640 1 -- 172.21.15.38:0/2652729371 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3f940bd400 con 0x7f3fa41019c0 2024-09-12T12:24:48.108 INFO:teuthology.orchestra.run.smithi038.stdout:154618822723 2024-09-12T12:24:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3f880a2c90 msgr2=0x7f3f880a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3f880a2c90 0x7f3f880a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fa410e9e0 tx=0x7f3f8c00b410 comp rx=0 tx=0).stop 2024-09-12T12:24:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41019c0 msgr2=0x7f3fa419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41019c0 0x7f3fa419a490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3f94033040 tx=0x7f3f94003970 comp rx=0 tx=0).stop 2024-09-12T12:24:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 shutdown_connections 2024-09-12T12:24:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3f880a2c90 0x7f3f880a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fa41079c0 0x7f3fa419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa4102360 0x7f3fa419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 --2- 172.21.15.38:0/2652729371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fa41019c0 0x7f3fa419a490 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.109+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 >> 172.21.15.38:0/2652729371 conn(0x7f3fa40fd740 msgr2=0x7f3fa410cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.110+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 shutdown_connections 2024-09-12T12:24:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:48.110+0000 7f3fa3200640 1 -- 172.21.15.38:0/2652729371 wait complete. 2024-09-12T12:24:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:47 smithi154 ceph-mon[35578]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:24:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:47 smithi071 ceph-mon[34859]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:24:48.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822721 got 154618822723 for osd.5 2024-09-12T12:24:48.799 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:48.799 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T12:24:48.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:24:49.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:48 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2652729371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:24:49.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:48 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2652729371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:24:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:49.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:48 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2652729371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:24:49.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.742+0000 7f9717c00640 1 -- 172.21.15.38:0/2705205358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 msgr2=0x7f97101089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.742+0000 7f9717c00640 1 --2- 172.21.15.38:0/2705205358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 0x7f97101089f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009900 tx=0x7f96fc02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.743+0000 7f9717c00640 1 -- 172.21.15.38:0/2705205358 shutdown_connections 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.743+0000 7f9717c00640 1 --2- 172.21.15.38:0/2705205358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710109120 0x7f9710110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.743+0000 7f9717c00640 1 --2- 172.21.15.38:0/2705205358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 0x7f97101089f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.743+0000 7f9717c00640 1 --2- 172.21.15.38:0/2705205358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9710103ff0 0x7f97101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.743+0000 7f9717c00640 1 -- 172.21.15.38:0/2705205358 >> 172.21.15.38:0/2705205358 conn(0x7f97100ffa90 msgr2=0x7f9710101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.743+0000 7f9717c00640 1 -- 172.21.15.38:0/2705205358 shutdown_connections 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.743+0000 7f9717c00640 1 -- 172.21.15.38:0/2705205358 wait complete. 2024-09-12T12:24:49.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.744+0000 7f9717c00640 1 Processor -- start 2024-09-12T12:24:49.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.744+0000 7f9717c00640 1 -- start start 2024-09-12T12:24:49.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9717c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710103ff0 0x7f971019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9717c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 0x7f971019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9717c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9710109120 0x7f971019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9717c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9710114140 con 0x7f97101049a0 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9717c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9710113fc0 con 0x7f9710103ff0 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9717c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97101142c0 con 0x7f9710109120 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710103ff0 0x7f971019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f970fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 0x7f971019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710103ff0 0x7f971019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:53876/0 (socket says 172.21.15.38:53876) 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 -- 172.21.15.38:0/2466865482 learned_addr learned my addr 172.21.15.38:0/2466865482 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715c00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9710109120 0x7f971019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 -- 172.21.15.38:0/2466865482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9710109120 msgr2=0x7f971019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9710109120 0x7f971019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 -- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 msgr2=0x7f971019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 0x7f971019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.745+0000 7f9715200640 1 -- 172.21.15.38:0/2466865482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971019f5d0 con 0x7f9710103ff0 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.746+0000 7f9715200640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710103ff0 0x7f971019a620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f970400e9f0 tx=0x7f970400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.746+0000 7f970d600640 1 -- 172.21.15.38:0/2466865482 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970400cd80 con 0x7f9710103ff0 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.746+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971019f8c0 con 0x7f9710103ff0 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.746+0000 7f970d600640 1 -- 172.21.15.38:0/2466865482 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9704005500 con 0x7f9710103ff0 2024-09-12T12:24:49.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.746+0000 7f970d600640 1 -- 172.21.15.38:0/2466865482 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704010690 con 0x7f9710103ff0 2024-09-12T12:24:49.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.746+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97101a71a0 con 0x7f9710103ff0 2024-09-12T12:24:49.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.747+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97101043d0 con 0x7f9710103ff0 2024-09-12T12:24:49.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.749+0000 7f970d600640 1 -- 172.21.15.38:0/2466865482 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f97040046c0 con 0x7f9710103ff0 2024-09-12T12:24:49.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.750+0000 7f970d600640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f96f80a2c10 0x7f96f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.751+0000 7f970d600640 1 -- 172.21.15.38:0/2466865482 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f97040cf9c0 con 0x7f9710103ff0 2024-09-12T12:24:49.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.751+0000 7f970fe00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f96f80a2c10 0x7f96f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.751+0000 7f970fe00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f96f80a2c10 0x7f96f80a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009230 tx=0x7f96fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:49.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.754+0000 7f970d600640 1 -- 172.21.15.38:0/2466865482 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f970409c3b0 con 0x7f9710103ff0 2024-09-12T12:24:49.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.937+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f971010c3d0 con 0x7f96f80a2c10 2024-09-12T12:24:49.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.945+0000 7f970d600640 1 -- 172.21.15.38:0/2466865482 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340434 (secure 0 0 0) 0x7f96fc031630 con 0x7f96f80a2c10 2024-09-12T12:24:49.950 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-12T12:24:49.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f96f80a2c10 msgr2=0x7f96f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f96f80a2c10 0x7f96f80a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009230 tx=0x7f96fc0058d0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710103ff0 msgr2=0x7f971019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710103ff0 0x7f971019a620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f970400e9f0 tx=0x7f970400edf0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 shutdown_connections 2024-09-12T12:24:49.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f96f80a2c10 0x7f96f80a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9710109120 0x7f971019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97101049a0 0x7f971019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 --2- 172.21.15.38:0/2466865482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9710103ff0 0x7f971019a620 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 >> 172.21.15.38:0/2466865482 conn(0x7f97100ffa90 msgr2=0x7f9710100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 shutdown_connections 2024-09-12T12:24:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:49.950+0000 7f9717c00640 1 -- 172.21.15.38:0/2466865482 wait complete. 2024-09-12T12:24:50.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:49 smithi154 ceph-mon[35578]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:24:50.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:49 smithi038 ceph-mon[30810]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:24:50.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:49 smithi071 ceph-mon[34859]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:24:50.725 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-12T12:24:48.101530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660928,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":755,"num_read_kb":499,"num_write":427,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389048,"kb_used_data":14768,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552776,"statfs":{"total":1151940427776,"available":1151542042624,"internally_reserved":0,"allocated":15122432,"data_stored":8342738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":74,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003018"},"pg_stats":[{"pgid":"2.1f","version":"91'13","reported_seq":113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.275217+0000","last_change":"2024-09-12T12:22:51.847865+0000","last_active":"2024-09-12T12:24:45.275217+0000","last_peered":"2024-09-12T12:24:45.275217+0000","last_clean":"2024-09-12T12:24:45.275217+0000","last_became_active":"2024-09-12T12:22:51.847437+0000","last_became_peered":"2024-09-12T12:22:51.847437+0000","last_unstale":"2024-09-12T12:24:45.275217+0000","last_undegraded":"2024-09-12T12:24:45.275217+0000","last_fullsized":"2024-09-12T12:24:45.275217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:34.486264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845391+0000","last_change":"2024-09-12T12:22:54.316759+0000","last_active":"2024-09-12T12:24:35.845391+0000","last_peered":"2024-09-12T12:24:35.845391+0000","last_clean":"2024-09-12T12:24:35.845391+0000","last_became_active":"2024-09-12T12:22:54.315906+0000","last_became_peered":"2024-09-12T12:22:54.315906+0000","last_unstale":"2024-09-12T12:24:35.845391+0000","last_undegraded":"2024-09-12T12:24:35.845391+0000","last_fullsized":"2024-09-12T12:24:35.845391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:54.465835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845427+0000","last_change":"2024-09-12T12:23:03.387327+0000","last_active":"2024-09-12T12:24:35.845427+0000","last_peered":"2024-09-12T12:24:35.845427+0000","last_clean":"2024-09-12T12:24:35.845427+0000","last_became_active":"2024-09-12T12:23:03.386929+0000","last_became_peered":"2024-09-12T12:23:03.386929+0000","last_unstale":"2024-09-12T12:24:35.845427+0000","last_undegraded":"2024-09-12T12:24:35.845427+0000","last_fullsized":"2024-09-12T12:24:35.845427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.033999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845616+0000","last_change":"2024-09-12T12:22:51.990331+0000","last_active":"2024-09-12T12:24:35.845616+0000","last_peered":"2024-09-12T12:24:35.845616+0000","last_clean":"2024-09-12T12:24:35.845616+0000","last_became_active":"2024-09-12T12:22:51.989844+0000","last_became_peered":"2024-09-12T12:22:51.989844+0000","last_unstale":"2024-09-12T12:24:35.845616+0000","last_undegraded":"2024-09-12T12:24:35.845616+0000","last_fullsized":"2024-09-12T12:24:35.845616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:47.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847103+0000","last_change":"2024-09-12T12:22:54.317141+0000","last_active":"2024-09-12T12:24:35.847103+0000","last_peered":"2024-09-12T12:24:35.847103+0000","last_clean":"2024-09-12T12:24:35.847103+0000","last_became_active":"2024-09-12T12:22:54.312292+0000","last_became_peered":"2024-09-12T12:22:54.312292+0000","last_unstale":"2024-09-12T12:24:35.847103+0000","last_undegraded":"2024-09-12T12:24:35.847103+0000","last_fullsized":"2024-09-12T12:24:35.847103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.943100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267513+0000","last_change":"2024-09-12T12:23:03.379532+0000","last_active":"2024-09-12T12:24:36.267513+0000","last_peered":"2024-09-12T12:24:36.267513+0000","last_clean":"2024-09-12T12:24:36.267513+0000","last_became_active":"2024-09-12T12:23:03.379087+0000","last_became_peered":"2024-09-12T12:23:03.379087+0000","last_unstale":"2024-09-12T12:24:36.267513+0000","last_undegraded":"2024-09-12T12:24:36.267513+0000","last_fullsized":"2024-09-12T12:24:36.267513+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.971474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.278754+0000","last_change":"2024-09-12T12:24:36.278754+0000","last_active":"2024-09-12T12:24:36.278754+0000","last_peered":"2024-09-12T12:24:36.278754+0000","last_clean":"2024-09-12T12:24:36.278754+0000","last_became_active":"2024-09-12T12:24:36.269065+0000","last_became_peered":"2024-09-12T12:24:36.269065+0000","last_unstale":"2024-09-12T12:24:36.278754+0000","last_undegraded":"2024-09-12T12:24:36.278754+0000","last_fullsized":"2024-09-12T12:24:36.278754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:12.224802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454663+0000","last_change":"2024-09-12T12:22:54.315178+0000","last_active":"2024-09-12T12:24:36.454663+0000","last_peered":"2024-09-12T12:24:36.454663+0000","last_clean":"2024-09-12T12:24:36.454663+0000","last_became_active":"2024-09-12T12:22:54.314408+0000","last_became_peered":"2024-09-12T12:22:54.314408+0000","last_unstale":"2024-09-12T12:24:36.454663+0000","last_undegraded":"2024-09-12T12:24:36.454663+0000","last_fullsized":"2024-09-12T12:24:36.454663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268023+0000","last_change":"2024-09-12T12:23:03.384629+0000","last_active":"2024-09-12T12:24:36.268023+0000","last_peered":"2024-09-12T12:24:36.268023+0000","last_clean":"2024-09-12T12:24:36.268023+0000","last_became_active":"2024-09-12T12:23:03.383750+0000","last_became_peered":"2024-09-12T12:23:03.383750+0000","last_unstale":"2024-09-12T12:24:36.268023+0000","last_undegraded":"2024-09-12T12:24:36.268023+0000","last_fullsized":"2024-09-12T12:24:36.268023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:24.377269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844481+0000","last_change":"2024-09-12T12:22:51.847561+0000","last_active":"2024-09-12T12:24:35.844481+0000","last_peered":"2024-09-12T12:24:35.844481+0000","last_clean":"2024-09-12T12:24:35.844481+0000","last_became_active":"2024-09-12T12:22:51.846862+0000","last_became_peered":"2024-09-12T12:22:51.846862+0000","last_unstale":"2024-09-12T12:24:35.844481+0000","last_undegraded":"2024-09-12T12:24:35.844481+0000","last_fullsized":"2024-09-12T12:24:35.844481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:37.907652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840622+0000","last_change":"2024-09-12T12:22:54.313493+0000","last_active":"2024-09-12T12:24:35.840622+0000","last_peered":"2024-09-12T12:24:35.840622+0000","last_clean":"2024-09-12T12:24:35.840622+0000","last_became_active":"2024-09-12T12:22:54.313115+0000","last_became_peered":"2024-09-12T12:22:54.313115+0000","last_unstale":"2024-09-12T12:24:35.840622+0000","last_undegraded":"2024-09-12T12:24:35.840622+0000","last_fullsized":"2024-09-12T12:24:35.840622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:39.631537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267698+0000","last_change":"2024-09-12T12:23:03.383997+0000","last_active":"2024-09-12T12:24:36.267698+0000","last_peered":"2024-09-12T12:24:36.267698+0000","last_clean":"2024-09-12T12:24:36.267698+0000","last_became_active":"2024-09-12T12:23:03.382952+0000","last_became_peered":"2024-09-12T12:23:03.382952+0000","last_unstale":"2024-09-12T12:24:36.267698+0000","last_undegraded":"2024-09-12T12:24:36.267698+0000","last_fullsized":"2024-09-12T12:24:36.267698+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:37.949848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846739+0000","last_change":"2024-09-12T12:22:54.311875+0000","last_active":"2024-09-12T12:24:35.846739+0000","last_peered":"2024-09-12T12:24:35.846739+0000","last_clean":"2024-09-12T12:24:35.846739+0000","last_became_active":"2024-09-12T12:22:54.311301+0000","last_became_peered":"2024-09-12T12:22:54.311301+0000","last_unstale":"2024-09-12T12:24:35.846739+0000","last_undegraded":"2024-09-12T12:24:35.846739+0000","last_fullsized":"2024-09-12T12:24:35.846739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:47.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844011+0000","last_change":"2024-09-12T12:22:51.849400+0000","last_active":"2024-09-12T12:24:35.844011+0000","last_peered":"2024-09-12T12:24:35.844011+0000","last_clean":"2024-09-12T12:24:35.844011+0000","last_became_active":"2024-09-12T12:22:51.848295+0000","last_became_peered":"2024-09-12T12:22:51.848295+0000","last_unstale":"2024-09-12T12:24:35.844011+0000","last_undegraded":"2024-09-12T12:24:35.844011+0000","last_fullsized":"2024-09-12T12:24:35.844011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268078+0000","last_change":"2024-09-12T12:23:03.779217+0000","last_active":"2024-09-12T12:24:36.268078+0000","last_peered":"2024-09-12T12:24:36.268078+0000","last_clean":"2024-09-12T12:24:36.268078+0000","last_became_active":"2024-09-12T12:23:03.778732+0000","last_became_peered":"2024-09-12T12:23:03.778732+0000","last_unstale":"2024-09-12T12:24:36.268078+0000","last_undegraded":"2024-09-12T12:24:36.268078+0000","last_fullsized":"2024-09-12T12:24:36.268078+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:49.676157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845202+0000","last_change":"2024-09-12T12:22:54.323222+0000","last_active":"2024-09-12T12:24:35.845202+0000","last_peered":"2024-09-12T12:24:35.845202+0000","last_clean":"2024-09-12T12:24:35.845202+0000","last_became_active":"2024-09-12T12:22:54.321035+0000","last_became_peered":"2024-09-12T12:22:54.321035+0000","last_unstale":"2024-09-12T12:24:35.845202+0000","last_undegraded":"2024-09-12T12:24:35.845202+0000","last_fullsized":"2024-09-12T12:24:35.845202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:04.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.851098+0000","last_change":"2024-09-12T12:24:35.850509+0000","last_active":"2024-09-12T12:24:35.851098+0000","last_peered":"2024-09-12T12:24:35.851098+0000","last_clean":"2024-09-12T12:24:35.851098+0000","last_became_active":"2024-09-12T12:24:35.846578+0000","last_became_peered":"2024-09-12T12:24:35.846578+0000","last_unstale":"2024-09-12T12:24:35.851098+0000","last_undegraded":"2024-09-12T12:24:35.851098+0000","last_fullsized":"2024-09-12T12:24:35.851098+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:10.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267846+0000","last_change":"2024-09-12T12:23:35.079820+0000","last_active":"2024-09-12T12:24:36.267846+0000","last_peered":"2024-09-12T12:24:36.267846+0000","last_clean":"2024-09-12T12:24:36.267846+0000","last_became_active":"2024-09-12T12:23:35.079362+0000","last_became_peered":"2024-09-12T12:23:35.079362+0000","last_unstale":"2024-09-12T12:24:36.267846+0000","last_undegraded":"2024-09-12T12:24:36.267846+0000","last_fullsized":"2024-09-12T12:24:36.267846+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:22.713646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842823+0000","last_change":"2024-09-12T12:22:54.307950+0000","last_active":"2024-09-12T12:24:35.842823+0000","last_peered":"2024-09-12T12:24:35.842823+0000","last_clean":"2024-09-12T12:24:35.842823+0000","last_became_active":"2024-09-12T12:22:54.307595+0000","last_became_peered":"2024-09-12T12:22:54.307595+0000","last_unstale":"2024-09-12T12:24:35.842823+0000","last_undegraded":"2024-09-12T12:24:35.842823+0000","last_fullsized":"2024-09-12T12:24:35.842823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:11.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845231+0000","last_change":"2024-09-12T12:22:51.851424+0000","last_active":"2024-09-12T12:24:35.845231+0000","last_peered":"2024-09-12T12:24:35.845231+0000","last_clean":"2024-09-12T12:24:35.845231+0000","last_became_active":"2024-09-12T12:22:51.851043+0000","last_became_peered":"2024-09-12T12:22:51.851043+0000","last_unstale":"2024-09-12T12:24:35.845231+0000","last_undegraded":"2024-09-12T12:24:35.845231+0000","last_fullsized":"2024-09-12T12:24:35.845231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841159+0000","last_change":"2024-09-12T12:23:03.381773+0000","last_active":"2024-09-12T12:24:35.841159+0000","last_peered":"2024-09-12T12:24:35.841159+0000","last_clean":"2024-09-12T12:24:35.841159+0000","last_became_active":"2024-09-12T12:23:03.378442+0000","last_became_peered":"2024-09-12T12:23:03.378442+0000","last_unstale":"2024-09-12T12:24:35.841159+0000","last_undegraded":"2024-09-12T12:24:35.841159+0000","last_fullsized":"2024-09-12T12:24:35.841159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.570787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843682+0000","last_change":"2024-09-12T12:22:54.310010+0000","last_active":"2024-09-12T12:24:35.843682+0000","last_peered":"2024-09-12T12:24:35.843682+0000","last_clean":"2024-09-12T12:24:35.843682+0000","last_became_active":"2024-09-12T12:22:54.309499+0000","last_became_peered":"2024-09-12T12:22:54.309499+0000","last_unstale":"2024-09-12T12:24:35.843682+0000","last_undegraded":"2024-09-12T12:24:35.843682+0000","last_fullsized":"2024-09-12T12:24:35.843682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.456842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.453940+0000","last_change":"2024-09-12T12:22:51.990294+0000","last_active":"2024-09-12T12:24:36.453940+0000","last_peered":"2024-09-12T12:24:36.453940+0000","last_clean":"2024-09-12T12:24:36.453940+0000","last_became_active":"2024-09-12T12:22:51.989925+0000","last_became_peered":"2024-09-12T12:22:51.989925+0000","last_unstale":"2024-09-12T12:24:36.453940+0000","last_undegraded":"2024-09-12T12:24:36.453940+0000","last_fullsized":"2024-09-12T12:24:36.453940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:56.754802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267887+0000","last_change":"2024-09-12T12:23:03.780256+0000","last_active":"2024-09-12T12:24:36.267887+0000","last_peered":"2024-09-12T12:24:36.267887+0000","last_clean":"2024-09-12T12:24:36.267887+0000","last_became_active":"2024-09-12T12:23:03.779808+0000","last_became_peered":"2024-09-12T12:23:03.779808+0000","last_unstale":"2024-09-12T12:24:36.267887+0000","last_undegraded":"2024-09-12T12:24:36.267887+0000","last_fullsized":"2024-09-12T12:24:36.267887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:58.236749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846910+0000","last_change":"2024-09-12T12:23:35.084287+0000","last_active":"2024-09-12T12:24:35.846910+0000","last_peered":"2024-09-12T12:24:35.846910+0000","last_clean":"2024-09-12T12:24:35.846910+0000","last_became_active":"2024-09-12T12:23:35.083828+0000","last_became_peered":"2024-09-12T12:23:35.083828+0000","last_unstale":"2024-09-12T12:24:35.846910+0000","last_undegraded":"2024-09-12T12:24:35.846910+0000","last_fullsized":"2024-09-12T12:24:35.846910+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:36.183575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268306+0000","last_change":"2024-09-12T12:22:52.557264+0000","last_active":"2024-09-12T12:24:36.268306+0000","last_peered":"2024-09-12T12:24:36.268306+0000","last_clean":"2024-09-12T12:24:36.268306+0000","last_became_active":"2024-09-12T12:22:52.556783+0000","last_became_peered":"2024-09-12T12:22:52.556783+0000","last_unstale":"2024-09-12T12:24:36.268306+0000","last_undegraded":"2024-09-12T12:24:36.268306+0000","last_fullsized":"2024-09-12T12:24:36.268306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:08.815983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845537+0000","last_change":"2024-09-12T12:23:03.376129+0000","last_active":"2024-09-12T12:24:35.845537+0000","last_peered":"2024-09-12T12:24:35.845537+0000","last_clean":"2024-09-12T12:24:35.845537+0000","last_became_active":"2024-09-12T12:23:03.375200+0000","last_became_peered":"2024-09-12T12:23:03.375200+0000","last_unstale":"2024-09-12T12:24:35.845537+0000","last_undegraded":"2024-09-12T12:24:35.845537+0000","last_fullsized":"2024-09-12T12:24:35.845537+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.418366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845751+0000","last_change":"2024-09-12T12:22:54.314708+0000","last_active":"2024-09-12T12:24:35.845751+0000","last_peered":"2024-09-12T12:24:35.845751+0000","last_clean":"2024-09-12T12:24:35.845751+0000","last_became_active":"2024-09-12T12:22:54.314304+0000","last_became_peered":"2024-09-12T12:22:54.314304+0000","last_unstale":"2024-09-12T12:24:35.845751+0000","last_undegraded":"2024-09-12T12:24:35.845751+0000","last_fullsized":"2024-09-12T12:24:35.845751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:52.198831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841551+0000","last_change":"2024-09-12T12:22:51.846753+0000","last_active":"2024-09-12T12:24:35.841551+0000","last_peered":"2024-09-12T12:24:35.841551+0000","last_clean":"2024-09-12T12:24:35.841551+0000","last_became_active":"2024-09-12T12:22:51.846388+0000","last_became_peered":"2024-09-12T12:22:51.846388+0000","last_unstale":"2024-09-12T12:24:35.841551+0000","last_undegraded":"2024-09-12T12:24:35.841551+0000","last_fullsized":"2024-09-12T12:24:35.841551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:34.511644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844810+0000","last_change":"2024-09-12T12:23:03.779254+0000","last_active":"2024-09-12T12:24:35.844810+0000","last_peered":"2024-09-12T12:24:35.844810+0000","last_clean":"2024-09-12T12:24:35.844810+0000","last_became_active":"2024-09-12T12:23:03.778801+0000","last_became_peered":"2024-09-12T12:23:03.778801+0000","last_unstale":"2024-09-12T12:24:35.844810+0000","last_undegraded":"2024-09-12T12:24:35.844810+0000","last_fullsized":"2024-09-12T12:24:35.844810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265309+0000","last_change":"2024-09-12T12:22:54.312002+0000","last_active":"2024-09-12T12:24:36.265309+0000","last_peered":"2024-09-12T12:24:36.265309+0000","last_clean":"2024-09-12T12:24:36.265309+0000","last_became_active":"2024-09-12T12:22:54.311670+0000","last_became_peered":"2024-09-12T12:22:54.311670+0000","last_unstale":"2024-09-12T12:24:36.265309+0000","last_undegraded":"2024-09-12T12:24:36.265309+0000","last_fullsized":"2024-09-12T12:24:36.265309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:08.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.856791+0000","last_change":"2024-09-12T12:24:35.856332+0000","last_active":"2024-09-12T12:24:35.856791+0000","last_peered":"2024-09-12T12:24:35.856791+0000","last_clean":"2024-09-12T12:24:35.856791+0000","last_became_active":"2024-09-12T12:24:35.846638+0000","last_became_peered":"2024-09-12T12:24:35.846638+0000","last_unstale":"2024-09-12T12:24:35.856791+0000","last_undegraded":"2024-09-12T12:24:35.856791+0000","last_fullsized":"2024-09-12T12:24:35.856791+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.181686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842934+0000","last_change":"2024-09-12T12:23:03.379901+0000","last_active":"2024-09-12T12:24:35.842934+0000","last_peered":"2024-09-12T12:24:35.842934+0000","last_clean":"2024-09-12T12:24:35.842934+0000","last_became_active":"2024-09-12T12:23:03.379385+0000","last_became_peered":"2024-09-12T12:23:03.379385+0000","last_unstale":"2024-09-12T12:24:35.842934+0000","last_undegraded":"2024-09-12T12:24:35.842934+0000","last_fullsized":"2024-09-12T12:24:35.842934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:47.939223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840547+0000","last_change":"2024-09-12T12:22:54.316450+0000","last_active":"2024-09-12T12:24:35.840547+0000","last_peered":"2024-09-12T12:24:35.840547+0000","last_clean":"2024-09-12T12:24:35.840547+0000","last_became_active":"2024-09-12T12:22:54.316058+0000","last_became_peered":"2024-09-12T12:22:54.316058+0000","last_unstale":"2024-09-12T12:24:35.840547+0000","last_undegraded":"2024-09-12T12:24:35.840547+0000","last_fullsized":"2024-09-12T12:24:35.840547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:38.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841081+0000","last_change":"2024-09-12T12:22:51.992564+0000","last_active":"2024-09-12T12:24:35.841081+0000","last_peered":"2024-09-12T12:24:35.841081+0000","last_clean":"2024-09-12T12:24:35.841081+0000","last_became_active":"2024-09-12T12:22:51.992012+0000","last_became_peered":"2024-09-12T12:22:51.992012+0000","last_unstale":"2024-09-12T12:24:35.841081+0000","last_undegraded":"2024-09-12T12:24:35.841081+0000","last_fullsized":"2024-09-12T12:24:35.841081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:26.190486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843835+0000","last_change":"2024-09-12T12:23:03.779309+0000","last_active":"2024-09-12T12:24:35.843835+0000","last_peered":"2024-09-12T12:24:35.843835+0000","last_clean":"2024-09-12T12:24:35.843835+0000","last_became_active":"2024-09-12T12:23:03.778812+0000","last_became_peered":"2024-09-12T12:23:03.778812+0000","last_unstale":"2024-09-12T12:24:35.843835+0000","last_undegraded":"2024-09-12T12:24:35.843835+0000","last_fullsized":"2024-09-12T12:24:35.843835+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:56.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840617+0000","last_change":"2024-09-12T12:22:54.309745+0000","last_active":"2024-09-12T12:24:35.840617+0000","last_peered":"2024-09-12T12:24:35.840617+0000","last_clean":"2024-09-12T12:24:35.840617+0000","last_became_active":"2024-09-12T12:22:54.309388+0000","last_became_peered":"2024-09-12T12:22:54.309388+0000","last_unstale":"2024-09-12T12:24:35.840617+0000","last_undegraded":"2024-09-12T12:24:35.840617+0000","last_fullsized":"2024-09-12T12:24:35.840617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.268141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.275864+0000","last_change":"2024-09-12T12:22:51.850494+0000","last_active":"2024-09-12T12:24:45.275864+0000","last_peered":"2024-09-12T12:24:45.275864+0000","last_clean":"2024-09-12T12:24:45.275864+0000","last_became_active":"2024-09-12T12:22:51.849071+0000","last_became_peered":"2024-09-12T12:22:51.849071+0000","last_unstale":"2024-09-12T12:24:45.275864+0000","last_undegraded":"2024-09-12T12:24:45.275864+0000","last_fullsized":"2024-09-12T12:24:45.275864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:19.203267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265100+0000","last_change":"2024-09-12T12:23:03.383096+0000","last_active":"2024-09-12T12:24:36.265100+0000","last_peered":"2024-09-12T12:24:36.265100+0000","last_clean":"2024-09-12T12:24:36.265100+0000","last_became_active":"2024-09-12T12:23:03.382261+0000","last_became_peered":"2024-09-12T12:23:03.382261+0000","last_unstale":"2024-09-12T12:24:36.265100+0000","last_undegraded":"2024-09-12T12:24:36.265100+0000","last_fullsized":"2024-09-12T12:24:36.265100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:08.976679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840724+0000","last_change":"2024-09-12T12:23:35.079333+0000","last_active":"2024-09-12T12:24:35.840724+0000","last_peered":"2024-09-12T12:24:35.840724+0000","last_clean":"2024-09-12T12:24:35.840724+0000","last_became_active":"2024-09-12T12:23:35.078908+0000","last_became_peered":"2024-09-12T12:23:35.078908+0000","last_unstale":"2024-09-12T12:24:35.840724+0000","last_undegraded":"2024-09-12T12:24:35.840724+0000","last_fullsized":"2024-09-12T12:24:35.840724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:55:59.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.276637+0000","last_change":"2024-09-12T12:22:51.990322+0000","last_active":"2024-09-12T12:24:45.276637+0000","last_peered":"2024-09-12T12:24:45.276637+0000","last_clean":"2024-09-12T12:24:45.276637+0000","last_became_active":"2024-09-12T12:22:51.989970+0000","last_became_peered":"2024-09-12T12:22:51.989970+0000","last_unstale":"2024-09-12T12:24:45.276637+0000","last_undegraded":"2024-09-12T12:24:45.276637+0000","last_fullsized":"2024-09-12T12:24:45.276637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:14.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265365+0000","last_change":"2024-09-12T12:23:35.083806+0000","last_active":"2024-09-12T12:24:36.265365+0000","last_peered":"2024-09-12T12:24:36.265365+0000","last_clean":"2024-09-12T12:24:36.265365+0000","last_became_active":"2024-09-12T12:23:35.083379+0000","last_became_peered":"2024-09-12T12:23:35.083379+0000","last_unstale":"2024-09-12T12:24:36.265365+0000","last_undegraded":"2024-09-12T12:24:36.265365+0000","last_fullsized":"2024-09-12T12:24:36.265365+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:54.146429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265280+0000","last_change":"2024-09-12T12:22:54.305747+0000","last_active":"2024-09-12T12:24:36.265280+0000","last_peered":"2024-09-12T12:24:36.265280+0000","last_clean":"2024-09-12T12:24:36.265280+0000","last_became_active":"2024-09-12T12:22:54.305423+0000","last_became_peered":"2024-09-12T12:22:54.305423+0000","last_unstale":"2024-09-12T12:24:36.265280+0000","last_undegraded":"2024-09-12T12:24:36.265280+0000","last_fullsized":"2024-09-12T12:24:36.265280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.463661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846589+0000","last_change":"2024-09-12T12:22:51.852216+0000","last_active":"2024-09-12T12:24:35.846589+0000","last_peered":"2024-09-12T12:24:35.846589+0000","last_clean":"2024-09-12T12:24:35.846589+0000","last_became_active":"2024-09-12T12:22:51.850495+0000","last_became_peered":"2024-09-12T12:22:51.850495+0000","last_unstale":"2024-09-12T12:24:35.846589+0000","last_undegraded":"2024-09-12T12:24:35.846589+0000","last_fullsized":"2024-09-12T12:24:35.846589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:51.711697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840531+0000","last_change":"2024-09-12T12:23:35.118914+0000","last_active":"2024-09-12T12:24:35.840531+0000","last_peered":"2024-09-12T12:24:35.840531+0000","last_clean":"2024-09-12T12:24:35.840531+0000","last_became_active":"2024-09-12T12:23:35.118411+0000","last_became_peered":"2024-09-12T12:23:35.118411+0000","last_unstale":"2024-09-12T12:24:35.840531+0000","last_undegraded":"2024-09-12T12:24:35.840531+0000","last_fullsized":"2024-09-12T12:24:35.840531+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:08.350538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845231+0000","last_change":"2024-09-12T12:22:54.320573+0000","last_active":"2024-09-12T12:24:35.845231+0000","last_peered":"2024-09-12T12:24:35.845231+0000","last_clean":"2024-09-12T12:24:35.845231+0000","last_became_active":"2024-09-12T12:22:54.320120+0000","last_became_peered":"2024-09-12T12:22:54.320120+0000","last_unstale":"2024-09-12T12:24:35.845231+0000","last_undegraded":"2024-09-12T12:24:35.845231+0000","last_fullsized":"2024-09-12T12:24:35.845231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:35.490584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.266972+0000","last_change":"2024-09-12T12:22:51.851098+0000","last_active":"2024-09-12T12:24:36.266972+0000","last_peered":"2024-09-12T12:24:36.266972+0000","last_clean":"2024-09-12T12:24:36.266972+0000","last_became_active":"2024-09-12T12:22:51.850725+0000","last_became_peered":"2024-09-12T12:22:51.850725+0000","last_unstale":"2024-09-12T12:24:36.266972+0000","last_undegraded":"2024-09-12T12:24:36.266972+0000","last_fullsized":"2024-09-12T12:24:36.266972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:18.308742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846840+0000","last_change":"2024-09-12T12:21:34.312000+0000","last_active":"2024-09-12T12:24:35.846840+0000","last_peered":"2024-09-12T12:24:35.846840+0000","last_clean":"2024-09-12T12:24:35.846840+0000","last_became_active":"2024-09-12T12:21:34.311472+0000","last_became_peered":"2024-09-12T12:21:34.311472+0000","last_unstale":"2024-09-12T12:24:35.846840+0000","last_undegraded":"2024-09-12T12:24:35.846840+0000","last_fullsized":"2024-09-12T12:24:35.846840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_clean_scrub_stamp":"2024-09-12T12:17:58.852566+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846936+0000","last_change":"2024-09-12T12:23:03.387802+0000","last_active":"2024-09-12T12:24:35.846936+0000","last_peered":"2024-09-12T12:24:35.846936+0000","last_clean":"2024-09-12T12:24:35.846936+0000","last_became_active":"2024-09-12T12:23:03.387391+0000","last_became_peered":"2024-09-12T12:23:03.387391+0000","last_unstale":"2024-09-12T12:24:35.846936+0000","last_undegraded":"2024-09-12T12:24:35.846936+0000","last_fullsized":"2024-09-12T12:24:35.846936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:24.741915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847218+0000","last_change":"2024-09-12T12:22:54.314326+0000","last_active":"2024-09-12T12:24:35.847218+0000","last_peered":"2024-09-12T12:24:35.847218+0000","last_clean":"2024-09-12T12:24:35.847218+0000","last_became_active":"2024-09-12T12:22:54.313892+0000","last_became_peered":"2024-09-12T12:22:54.313892+0000","last_unstale":"2024-09-12T12:24:35.847218+0000","last_undegraded":"2024-09-12T12:24:35.847218+0000","last_fullsized":"2024-09-12T12:24:35.847218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:50.980891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.277197+0000","last_change":"2024-09-12T12:22:52.557126+0000","last_active":"2024-09-12T12:24:45.277197+0000","last_peered":"2024-09-12T12:24:45.277197+0000","last_clean":"2024-09-12T12:24:45.277197+0000","last_became_active":"2024-09-12T12:22:52.556736+0000","last_became_peered":"2024-09-12T12:22:52.556736+0000","last_unstale":"2024-09-12T12:24:45.277197+0000","last_undegraded":"2024-09-12T12:24:45.277197+0000","last_fullsized":"2024-09-12T12:24:45.277197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:09.199871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454139+0000","last_change":"2024-09-12T12:23:03.380117+0000","last_active":"2024-09-12T12:24:36.454139+0000","last_peered":"2024-09-12T12:24:36.454139+0000","last_clean":"2024-09-12T12:24:36.454139+0000","last_became_active":"2024-09-12T12:23:03.379635+0000","last_became_peered":"2024-09-12T12:23:03.379635+0000","last_unstale":"2024-09-12T12:24:36.454139+0000","last_undegraded":"2024-09-12T12:24:36.454139+0000","last_fullsized":"2024-09-12T12:24:36.454139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:23.227681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846816+0000","last_change":"2024-09-12T12:22:54.316010+0000","last_active":"2024-09-12T12:24:35.846816+0000","last_peered":"2024-09-12T12:24:35.846816+0000","last_clean":"2024-09-12T12:24:35.846816+0000","last_became_active":"2024-09-12T12:22:54.315702+0000","last_became_peered":"2024-09-12T12:22:54.315702+0000","last_unstale":"2024-09-12T12:24:35.846816+0000","last_undegraded":"2024-09-12T12:24:35.846816+0000","last_fullsized":"2024-09-12T12:24:35.846816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:52.370650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840800+0000","last_change":"2024-09-12T12:22:51.854456+0000","last_active":"2024-09-12T12:24:35.840800+0000","last_peered":"2024-09-12T12:24:35.840800+0000","last_clean":"2024-09-12T12:24:35.840800+0000","last_became_active":"2024-09-12T12:22:51.854092+0000","last_became_peered":"2024-09-12T12:22:51.854092+0000","last_unstale":"2024-09-12T12:24:35.840800+0000","last_undegraded":"2024-09-12T12:24:35.840800+0000","last_fullsized":"2024-09-12T12:24:35.840800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:57.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846505+0000","last_change":"2024-09-12T12:23:03.390443+0000","last_active":"2024-09-12T12:24:35.846505+0000","last_peered":"2024-09-12T12:24:35.846505+0000","last_clean":"2024-09-12T12:24:35.846505+0000","last_became_active":"2024-09-12T12:23:03.389825+0000","last_became_peered":"2024-09-12T12:23:03.389825+0000","last_unstale":"2024-09-12T12:24:35.846505+0000","last_undegraded":"2024-09-12T12:24:35.846505+0000","last_fullsized":"2024-09-12T12:24:35.846505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.711075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846984+0000","last_change":"2024-09-12T12:22:54.311694+0000","last_active":"2024-09-12T12:24:35.846984+0000","last_peered":"2024-09-12T12:24:35.846984+0000","last_clean":"2024-09-12T12:24:35.846984+0000","last_became_active":"2024-09-12T12:22:54.311381+0000","last_became_peered":"2024-09-12T12:22:54.311381+0000","last_unstale":"2024-09-12T12:24:35.846984+0000","last_undegraded":"2024-09-12T12:24:35.846984+0000","last_fullsized":"2024-09-12T12:24:35.846984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.378495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.264669+0000","last_change":"2024-09-12T12:22:51.852126+0000","last_active":"2024-09-12T12:24:36.264669+0000","last_peered":"2024-09-12T12:24:36.264669+0000","last_clean":"2024-09-12T12:24:36.264669+0000","last_became_active":"2024-09-12T12:22:51.851766+0000","last_became_peered":"2024-09-12T12:22:51.851766+0000","last_unstale":"2024-09-12T12:24:36.264669+0000","last_undegraded":"2024-09-12T12:24:36.264669+0000","last_fullsized":"2024-09-12T12:24:36.264669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:37.263329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.839944+0000","last_change":"2024-09-12T12:23:03.375569+0000","last_active":"2024-09-12T12:24:35.839944+0000","last_peered":"2024-09-12T12:24:35.839944+0000","last_clean":"2024-09-12T12:24:35.839944+0000","last_became_active":"2024-09-12T12:23:03.375136+0000","last_became_peered":"2024-09-12T12:23:03.375136+0000","last_unstale":"2024-09-12T12:24:35.839944+0000","last_undegraded":"2024-09-12T12:24:35.839944+0000","last_fullsized":"2024-09-12T12:24:35.839944+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:05.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843234+0000","last_change":"2024-09-12T12:22:54.304943+0000","last_active":"2024-09-12T12:24:35.843234+0000","last_peered":"2024-09-12T12:24:35.843234+0000","last_clean":"2024-09-12T12:24:35.843234+0000","last_became_active":"2024-09-12T12:22:54.304573+0000","last_became_peered":"2024-09-12T12:22:54.304573+0000","last_unstale":"2024-09-12T12:24:35.843234+0000","last_undegraded":"2024-09-12T12:24:35.843234+0000","last_fullsized":"2024-09-12T12:24:35.843234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844566+0000","last_change":"2024-09-12T12:22:51.846998+0000","last_active":"2024-09-12T12:24:35.844566+0000","last_peered":"2024-09-12T12:24:35.844566+0000","last_clean":"2024-09-12T12:24:35.844566+0000","last_became_active":"2024-09-12T12:22:51.846617+0000","last_became_peered":"2024-09-12T12:22:51.846617+0000","last_unstale":"2024-09-12T12:24:35.844566+0000","last_undegraded":"2024-09-12T12:24:35.844566+0000","last_fullsized":"2024-09-12T12:24:35.844566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.428244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840001+0000","last_change":"2024-09-12T12:23:03.383519+0000","last_active":"2024-09-12T12:24:35.840001+0000","last_peered":"2024-09-12T12:24:35.840001+0000","last_clean":"2024-09-12T12:24:35.840001+0000","last_became_active":"2024-09-12T12:23:03.383131+0000","last_became_peered":"2024-09-12T12:23:03.383131+0000","last_unstale":"2024-09-12T12:24:35.840001+0000","last_undegraded":"2024-09-12T12:24:35.840001+0000","last_fullsized":"2024-09-12T12:24:35.840001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:59.602027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840217+0000","last_change":"2024-09-12T12:22:54.312418+0000","last_active":"2024-09-12T12:24:35.840217+0000","last_peered":"2024-09-12T12:24:35.840217+0000","last_clean":"2024-09-12T12:24:35.840217+0000","last_became_active":"2024-09-12T12:22:54.311932+0000","last_became_peered":"2024-09-12T12:22:54.311932+0000","last_unstale":"2024-09-12T12:24:35.840217+0000","last_undegraded":"2024-09-12T12:24:35.840217+0000","last_fullsized":"2024-09-12T12:24:35.840217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:48.395607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843694+0000","last_change":"2024-09-12T12:22:51.993506+0000","last_active":"2024-09-12T12:24:35.843694+0000","last_peered":"2024-09-12T12:24:35.843694+0000","last_clean":"2024-09-12T12:24:35.843694+0000","last_became_active":"2024-09-12T12:22:51.993204+0000","last_became_peered":"2024-09-12T12:22:51.993204+0000","last_unstale":"2024-09-12T12:24:35.843694+0000","last_undegraded":"2024-09-12T12:24:35.843694+0000","last_fullsized":"2024-09-12T12:24:35.843694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:34.670023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265386+0000","last_change":"2024-09-12T12:23:03.388552+0000","last_active":"2024-09-12T12:24:36.265386+0000","last_peered":"2024-09-12T12:24:36.265386+0000","last_clean":"2024-09-12T12:24:36.265386+0000","last_became_active":"2024-09-12T12:23:03.388105+0000","last_became_peered":"2024-09-12T12:23:03.388105+0000","last_unstale":"2024-09-12T12:24:36.265386+0000","last_undegraded":"2024-09-12T12:24:36.265386+0000","last_fullsized":"2024-09-12T12:24:36.265386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:08.927714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846503+0000","last_change":"2024-09-12T12:23:35.081015+0000","last_active":"2024-09-12T12:24:35.846503+0000","last_peered":"2024-09-12T12:24:35.846503+0000","last_clean":"2024-09-12T12:24:35.846503+0000","last_became_active":"2024-09-12T12:23:35.080609+0000","last_became_peered":"2024-09-12T12:23:35.080609+0000","last_unstale":"2024-09-12T12:24:35.846503+0000","last_undegraded":"2024-09-12T12:24:35.846503+0000","last_fullsized":"2024-09-12T12:24:35.846503+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:26.700031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.278390+0000","last_change":"2024-09-12T12:22:51.848784+0000","last_active":"2024-09-12T12:24:46.278390+0000","last_peered":"2024-09-12T12:24:46.278390+0000","last_clean":"2024-09-12T12:24:46.278390+0000","last_became_active":"2024-09-12T12:22:51.848255+0000","last_became_peered":"2024-09-12T12:22:51.848255+0000","last_unstale":"2024-09-12T12:24:46.278390+0000","last_undegraded":"2024-09-12T12:24:46.278390+0000","last_fullsized":"2024-09-12T12:24:46.278390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:00.680332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841238+0000","last_change":"2024-09-12T12:23:03.386046+0000","last_active":"2024-09-12T12:24:35.841238+0000","last_peered":"2024-09-12T12:24:35.841238+0000","last_clean":"2024-09-12T12:24:35.841238+0000","last_became_active":"2024-09-12T12:23:03.384264+0000","last_became_peered":"2024-09-12T12:23:03.384264+0000","last_unstale":"2024-09-12T12:24:35.841238+0000","last_undegraded":"2024-09-12T12:24:35.841238+0000","last_fullsized":"2024-09-12T12:24:35.841238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:23.605769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846876+0000","last_change":"2024-09-12T12:22:54.315588+0000","last_active":"2024-09-12T12:24:35.846876+0000","last_peered":"2024-09-12T12:24:35.846876+0000","last_clean":"2024-09-12T12:24:35.846876+0000","last_became_active":"2024-09-12T12:22:54.315216+0000","last_became_peered":"2024-09-12T12:22:54.315216+0000","last_unstale":"2024-09-12T12:24:35.846876+0000","last_undegraded":"2024-09-12T12:24:35.846876+0000","last_fullsized":"2024-09-12T12:24:35.846876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:06.556373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840385+0000","last_change":"2024-09-12T12:22:51.851246+0000","last_active":"2024-09-12T12:24:35.840385+0000","last_peered":"2024-09-12T12:24:35.840385+0000","last_clean":"2024-09-12T12:24:35.840385+0000","last_became_active":"2024-09-12T12:22:51.850963+0000","last_became_peered":"2024-09-12T12:22:51.850963+0000","last_unstale":"2024-09-12T12:24:35.840385+0000","last_undegraded":"2024-09-12T12:24:35.840385+0000","last_fullsized":"2024-09-12T12:24:35.840385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:12.032126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842877+0000","last_change":"2024-09-12T12:23:03.382950+0000","last_active":"2024-09-12T12:24:35.842877+0000","last_peered":"2024-09-12T12:24:35.842877+0000","last_clean":"2024-09-12T12:24:35.842877+0000","last_became_active":"2024-09-12T12:23:03.382503+0000","last_became_peered":"2024-09-12T12:23:03.382503+0000","last_unstale":"2024-09-12T12:24:35.842877+0000","last_undegraded":"2024-09-12T12:24:35.842877+0000","last_fullsized":"2024-09-12T12:24:35.842877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:03.991304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265028+0000","last_change":"2024-09-12T12:22:54.315788+0000","last_active":"2024-09-12T12:24:36.265028+0000","last_peered":"2024-09-12T12:24:36.265028+0000","last_clean":"2024-09-12T12:24:36.265028+0000","last_became_active":"2024-09-12T12:22:54.315343+0000","last_became_peered":"2024-09-12T12:22:54.315343+0000","last_unstale":"2024-09-12T12:24:36.265028+0000","last_undegraded":"2024-09-12T12:24:36.265028+0000","last_fullsized":"2024-09-12T12:24:36.265028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:22.549415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845858+0000","last_change":"2024-09-12T12:22:51.854532+0000","last_active":"2024-09-12T12:24:35.845858+0000","last_peered":"2024-09-12T12:24:35.845858+0000","last_clean":"2024-09-12T12:24:35.845858+0000","last_became_active":"2024-09-12T12:22:51.854206+0000","last_became_peered":"2024-09-12T12:22:51.854206+0000","last_unstale":"2024-09-12T12:24:35.845858+0000","last_undegraded":"2024-09-12T12:24:35.845858+0000","last_fullsized":"2024-09-12T12:24:35.845858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:46.908917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840444+0000","last_change":"2024-09-12T12:23:03.383647+0000","last_active":"2024-09-12T12:24:35.840444+0000","last_peered":"2024-09-12T12:24:35.840444+0000","last_clean":"2024-09-12T12:24:35.840444+0000","last_became_active":"2024-09-12T12:23:03.383094+0000","last_became_peered":"2024-09-12T12:23:03.383094+0000","last_unstale":"2024-09-12T12:24:35.840444+0000","last_undegraded":"2024-09-12T12:24:35.840444+0000","last_fullsized":"2024-09-12T12:24:35.840444+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:03.754250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844164+0000","last_change":"2024-09-12T12:22:54.310717+0000","last_active":"2024-09-12T12:24:35.844164+0000","last_peered":"2024-09-12T12:24:35.844164+0000","last_clean":"2024-09-12T12:24:35.844164+0000","last_became_active":"2024-09-12T12:22:54.309485+0000","last_became_peered":"2024-09-12T12:22:54.309485+0000","last_unstale":"2024-09-12T12:24:35.844164+0000","last_undegraded":"2024-09-12T12:24:35.844164+0000","last_fullsized":"2024-09-12T12:24:35.844164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:10.293726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":198,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.277705+0000","last_change":"2024-09-12T12:22:51.856735+0000","last_active":"2024-09-12T12:24:46.277705+0000","last_peered":"2024-09-12T12:24:46.277705+0000","last_clean":"2024-09-12T12:24:46.277705+0000","last_became_active":"2024-09-12T12:22:51.856340+0000","last_became_peered":"2024-09-12T12:22:51.856340+0000","last_unstale":"2024-09-12T12:24:46.277705+0000","last_undegraded":"2024-09-12T12:24:46.277705+0000","last_fullsized":"2024-09-12T12:24:46.277705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:40.727645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":124,"num_write":36,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840889+0000","last_change":"2024-09-12T12:23:03.379726+0000","last_active":"2024-09-12T12:24:35.840889+0000","last_peered":"2024-09-12T12:24:35.840889+0000","last_clean":"2024-09-12T12:24:35.840889+0000","last_became_active":"2024-09-12T12:23:03.378168+0000","last_became_peered":"2024-09-12T12:23:03.378168+0000","last_unstale":"2024-09-12T12:24:35.840889+0000","last_undegraded":"2024-09-12T12:24:35.840889+0000","last_fullsized":"2024-09-12T12:24:35.840889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454543+0000","last_change":"2024-09-12T12:23:35.083119+0000","last_active":"2024-09-12T12:24:36.454543+0000","last_peered":"2024-09-12T12:24:36.454543+0000","last_clean":"2024-09-12T12:24:36.454543+0000","last_became_active":"2024-09-12T12:23:35.082800+0000","last_became_peered":"2024-09-12T12:23:35.082800+0000","last_unstale":"2024-09-12T12:24:36.454543+0000","last_undegraded":"2024-09-12T12:24:36.454543+0000","last_fullsized":"2024-09-12T12:24:36.454543+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.717540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840724+0000","last_change":"2024-09-12T12:22:51.989886+0000","last_active":"2024-09-12T12:24:35.840724+0000","last_peered":"2024-09-12T12:24:35.840724+0000","last_clean":"2024-09-12T12:24:35.840724+0000","last_became_active":"2024-09-12T12:22:51.989524+0000","last_became_peered":"2024-09-12T12:22:51.989524+0000","last_unstale":"2024-09-12T12:24:35.840724+0000","last_undegraded":"2024-09-12T12:24:35.840724+0000","last_fullsized":"2024-09-12T12:24:35.840724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:26.409342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267934+0000","last_change":"2024-09-12T12:23:03.384583+0000","last_active":"2024-09-12T12:24:36.267934+0000","last_peered":"2024-09-12T12:24:36.267934+0000","last_clean":"2024-09-12T12:24:36.267934+0000","last_became_active":"2024-09-12T12:23:03.383639+0000","last_became_peered":"2024-09-12T12:23:03.383639+0000","last_unstale":"2024-09-12T12:24:36.267934+0000","last_undegraded":"2024-09-12T12:24:36.267934+0000","last_fullsized":"2024-09-12T12:24:36.267934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:09.755052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847161+0000","last_change":"2024-09-12T12:22:54.309874+0000","last_active":"2024-09-12T12:24:35.847161+0000","last_peered":"2024-09-12T12:24:35.847161+0000","last_clean":"2024-09-12T12:24:35.847161+0000","last_became_active":"2024-09-12T12:22:54.309294+0000","last_became_peered":"2024-09-12T12:22:54.309294+0000","last_unstale":"2024-09-12T12:24:35.847161+0000","last_undegraded":"2024-09-12T12:24:35.847161+0000","last_fullsized":"2024-09-12T12:24:35.847161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:50.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847159+0000","last_change":"2024-09-12T12:22:51.849467+0000","last_active":"2024-09-12T12:24:35.847159+0000","last_peered":"2024-09-12T12:24:35.847159+0000","last_clean":"2024-09-12T12:24:35.847159+0000","last_became_active":"2024-09-12T12:22:51.849076+0000","last_became_peered":"2024-09-12T12:22:51.849076+0000","last_unstale":"2024-09-12T12:24:35.847159+0000","last_undegraded":"2024-09-12T12:24:35.847159+0000","last_fullsized":"2024-09-12T12:24:35.847159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:04.821105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843557+0000","last_change":"2024-09-12T12:23:35.083542+0000","last_active":"2024-09-12T12:24:35.843557+0000","last_peered":"2024-09-12T12:24:35.843557+0000","last_clean":"2024-09-12T12:24:35.843557+0000","last_became_active":"2024-09-12T12:23:35.083095+0000","last_became_peered":"2024-09-12T12:23:35.083095+0000","last_unstale":"2024-09-12T12:24:35.843557+0000","last_undegraded":"2024-09-12T12:24:35.843557+0000","last_fullsized":"2024-09-12T12:24:35.843557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:06.750223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454702+0000","last_change":"2024-09-12T12:22:54.315215+0000","last_active":"2024-09-12T12:24:36.454702+0000","last_peered":"2024-09-12T12:24:36.454702+0000","last_clean":"2024-09-12T12:24:36.454702+0000","last_became_active":"2024-09-12T12:22:54.314879+0000","last_became_peered":"2024-09-12T12:22:54.314879+0000","last_unstale":"2024-09-12T12:24:36.454702+0000","last_undegraded":"2024-09-12T12:24:36.454702+0000","last_fullsized":"2024-09-12T12:24:36.454702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:35.501376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.277916+0000","last_change":"2024-09-12T12:22:51.851461+0000","last_active":"2024-09-12T12:24:46.277916+0000","last_peered":"2024-09-12T12:24:46.277916+0000","last_clean":"2024-09-12T12:24:46.277916+0000","last_became_active":"2024-09-12T12:22:51.851105+0000","last_became_peered":"2024-09-12T12:22:51.851105+0000","last_unstale":"2024-09-12T12:24:46.277916+0000","last_undegraded":"2024-09-12T12:24:46.277916+0000","last_fullsized":"2024-09-12T12:24:46.277916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:42.604983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844971+0000","last_change":"2024-09-12T12:23:03.383308+0000","last_active":"2024-09-12T12:24:35.844971+0000","last_peered":"2024-09-12T12:24:35.844971+0000","last_clean":"2024-09-12T12:24:35.844971+0000","last_became_active":"2024-09-12T12:23:03.382294+0000","last_became_peered":"2024-09-12T12:23:03.382294+0000","last_unstale":"2024-09-12T12:24:35.844971+0000","last_undegraded":"2024-09-12T12:24:35.844971+0000","last_fullsized":"2024-09-12T12:24:35.844971+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:43.920306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846720+0000","last_change":"2024-09-12T12:23:03.386850+0000","last_active":"2024-09-12T12:24:35.846720+0000","last_peered":"2024-09-12T12:24:35.846720+0000","last_clean":"2024-09-12T12:24:35.846720+0000","last_became_active":"2024-09-12T12:23:03.386350+0000","last_became_peered":"2024-09-12T12:23:03.386350+0000","last_unstale":"2024-09-12T12:24:35.846720+0000","last_undegraded":"2024-09-12T12:24:35.846720+0000","last_fullsized":"2024-09-12T12:24:35.846720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.295745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840840+0000","last_change":"2024-09-12T12:22:54.320709+0000","last_active":"2024-09-12T12:24:35.840840+0000","last_peered":"2024-09-12T12:24:35.840840+0000","last_clean":"2024-09-12T12:24:35.840840+0000","last_became_active":"2024-09-12T12:22:54.320208+0000","last_became_peered":"2024-09-12T12:22:54.320208+0000","last_unstale":"2024-09-12T12:24:35.840840+0000","last_undegraded":"2024-09-12T12:24:35.840840+0000","last_fullsized":"2024-09-12T12:24:35.840840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:45.452449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840207+0000","last_change":"2024-09-12T12:22:51.853047+0000","last_active":"2024-09-12T12:24:35.840207+0000","last_peered":"2024-09-12T12:24:35.840207+0000","last_clean":"2024-09-12T12:24:35.840207+0000","last_became_active":"2024-09-12T12:22:51.852653+0000","last_became_peered":"2024-09-12T12:22:51.852653+0000","last_unstale":"2024-09-12T12:24:35.840207+0000","last_undegraded":"2024-09-12T12:24:35.840207+0000","last_fullsized":"2024-09-12T12:24:35.840207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:39.035009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843135+0000","last_change":"2024-09-12T12:23:03.382997+0000","last_active":"2024-09-12T12:24:35.843135+0000","last_peered":"2024-09-12T12:24:35.843135+0000","last_clean":"2024-09-12T12:24:35.843135+0000","last_became_active":"2024-09-12T12:23:03.382594+0000","last_became_peered":"2024-09-12T12:23:03.382594+0000","last_unstale":"2024-09-12T12:24:35.843135+0000","last_undegraded":"2024-09-12T12:24:35.843135+0000","last_fullsized":"2024-09-12T12:24:35.843135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:25.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845227+0000","last_change":"2024-09-12T12:22:54.322595+0000","last_active":"2024-09-12T12:24:35.845227+0000","last_peered":"2024-09-12T12:24:35.845227+0000","last_clean":"2024-09-12T12:24:35.845227+0000","last_became_active":"2024-09-12T12:22:54.320182+0000","last_became_peered":"2024-09-12T12:22:54.320182+0000","last_unstale":"2024-09-12T12:24:35.845227+0000","last_undegraded":"2024-09-12T12:24:35.845227+0000","last_fullsized":"2024-09-12T12:24:35.845227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265122+0000","last_change":"2024-09-12T12:22:51.850045+0000","last_active":"2024-09-12T12:24:36.265122+0000","last_peered":"2024-09-12T12:24:36.265122+0000","last_clean":"2024-09-12T12:24:36.265122+0000","last_became_active":"2024-09-12T12:22:51.849643+0000","last_became_peered":"2024-09-12T12:22:51.849643+0000","last_unstale":"2024-09-12T12:24:36.265122+0000","last_undegraded":"2024-09-12T12:24:36.265122+0000","last_fullsized":"2024-09-12T12:24:36.265122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:18.255368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840449+0000","last_change":"2024-09-12T12:22:51.852692+0000","last_active":"2024-09-12T12:24:35.840449+0000","last_peered":"2024-09-12T12:24:35.840449+0000","last_clean":"2024-09-12T12:24:35.840449+0000","last_became_active":"2024-09-12T12:22:51.852265+0000","last_became_peered":"2024-09-12T12:22:51.852265+0000","last_unstale":"2024-09-12T12:24:35.840449+0000","last_undegraded":"2024-09-12T12:24:35.840449+0000","last_fullsized":"2024-09-12T12:24:35.840449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:55.853073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840570+0000","last_change":"2024-09-12T12:22:54.315519+0000","last_active":"2024-09-12T12:24:35.840570+0000","last_peered":"2024-09-12T12:24:35.840570+0000","last_clean":"2024-09-12T12:24:35.840570+0000","last_became_active":"2024-09-12T12:22:54.315158+0000","last_became_peered":"2024-09-12T12:22:54.315158+0000","last_unstale":"2024-09-12T12:24:35.840570+0000","last_undegraded":"2024-09-12T12:24:35.840570+0000","last_fullsized":"2024-09-12T12:24:35.840570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845804+0000","last_change":"2024-09-12T12:23:03.383443+0000","last_active":"2024-09-12T12:24:35.845804+0000","last_peered":"2024-09-12T12:24:35.845804+0000","last_clean":"2024-09-12T12:24:35.845804+0000","last_became_active":"2024-09-12T12:23:03.382865+0000","last_became_peered":"2024-09-12T12:23:03.382865+0000","last_unstale":"2024-09-12T12:24:35.845804+0000","last_undegraded":"2024-09-12T12:24:35.845804+0000","last_fullsized":"2024-09-12T12:24:35.845804+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:26.339910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.278573+0000","last_change":"2024-09-12T12:22:51.849963+0000","last_active":"2024-09-12T12:24:46.278573+0000","last_peered":"2024-09-12T12:24:46.278573+0000","last_clean":"2024-09-12T12:24:46.278573+0000","last_became_active":"2024-09-12T12:22:51.849596+0000","last_became_peered":"2024-09-12T12:22:51.849596+0000","last_unstale":"2024-09-12T12:24:46.278573+0000","last_undegraded":"2024-09-12T12:24:46.278573+0000","last_fullsized":"2024-09-12T12:24:46.278573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:48.695657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843995+0000","last_change":"2024-09-12T12:22:54.312543+0000","last_active":"2024-09-12T12:24:35.843995+0000","last_peered":"2024-09-12T12:24:35.843995+0000","last_clean":"2024-09-12T12:24:35.843995+0000","last_became_active":"2024-09-12T12:22:54.312154+0000","last_became_peered":"2024-09-12T12:22:54.312154+0000","last_unstale":"2024-09-12T12:24:35.843995+0000","last_undegraded":"2024-09-12T12:24:35.843995+0000","last_fullsized":"2024-09-12T12:24:35.843995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:28.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846393+0000","last_change":"2024-09-12T12:23:03.376938+0000","last_active":"2024-09-12T12:24:35.846393+0000","last_peered":"2024-09-12T12:24:35.846393+0000","last_clean":"2024-09-12T12:24:35.846393+0000","last_became_active":"2024-09-12T12:23:03.376450+0000","last_became_peered":"2024-09-12T12:23:03.376450+0000","last_unstale":"2024-09-12T12:24:35.846393+0000","last_undegraded":"2024-09-12T12:24:35.846393+0000","last_fullsized":"2024-09-12T12:24:35.846393+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:35.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842691+0000","last_change":"2024-09-12T12:22:54.305562+0000","last_active":"2024-09-12T12:24:35.842691+0000","last_peered":"2024-09-12T12:24:35.842691+0000","last_clean":"2024-09-12T12:24:35.842691+0000","last_became_active":"2024-09-12T12:22:54.305208+0000","last_became_peered":"2024-09-12T12:22:54.305208+0000","last_unstale":"2024-09-12T12:24:35.842691+0000","last_undegraded":"2024-09-12T12:24:35.842691+0000","last_fullsized":"2024-09-12T12:24:35.842691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:46.643949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845808+0000","last_change":"2024-09-12T12:22:54.310634+0000","last_active":"2024-09-12T12:24:35.845808+0000","last_peered":"2024-09-12T12:24:35.845808+0000","last_clean":"2024-09-12T12:24:35.845808+0000","last_became_active":"2024-09-12T12:22:54.310194+0000","last_became_peered":"2024-09-12T12:22:54.310194+0000","last_unstale":"2024-09-12T12:24:35.845808+0000","last_undegraded":"2024-09-12T12:24:35.845808+0000","last_fullsized":"2024-09-12T12:24:35.845808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:05.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845503+0000","last_change":"2024-09-12T12:22:54.315119+0000","last_active":"2024-09-12T12:24:35.845503+0000","last_peered":"2024-09-12T12:24:35.845503+0000","last_clean":"2024-09-12T12:24:35.845503+0000","last_became_active":"2024-09-12T12:22:54.314729+0000","last_became_peered":"2024-09-12T12:22:54.314729+0000","last_unstale":"2024-09-12T12:24:35.845503+0000","last_undegraded":"2024-09-12T12:24:35.845503+0000","last_fullsized":"2024-09-12T12:24:35.845503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:07.888005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846522+0000","last_change":"2024-09-12T12:23:35.083672+0000","last_active":"2024-09-12T12:24:35.846522+0000","last_peered":"2024-09-12T12:24:35.846522+0000","last_clean":"2024-09-12T12:24:35.846522+0000","last_became_active":"2024-09-12T12:23:35.083222+0000","last_became_peered":"2024-09-12T12:23:35.083222+0000","last_unstale":"2024-09-12T12:24:35.846522+0000","last_undegraded":"2024-09-12T12:24:35.846522+0000","last_fullsized":"2024-09-12T12:24:35.846522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265239+0000","last_change":"2024-09-12T12:22:54.321649+0000","last_active":"2024-09-12T12:24:36.265239+0000","last_peered":"2024-09-12T12:24:36.265239+0000","last_clean":"2024-09-12T12:24:36.265239+0000","last_became_active":"2024-09-12T12:22:54.320859+0000","last_became_peered":"2024-09-12T12:22:54.320859+0000","last_unstale":"2024-09-12T12:24:36.265239+0000","last_undegraded":"2024-09-12T12:24:36.265239+0000","last_fullsized":"2024-09-12T12:24:36.265239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:49.706632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843751+0000","last_change":"2024-09-12T12:22:54.306900+0000","last_active":"2024-09-12T12:24:35.843751+0000","last_peered":"2024-09-12T12:24:35.843751+0000","last_clean":"2024-09-12T12:24:35.843751+0000","last_became_active":"2024-09-12T12:22:54.306432+0000","last_became_peered":"2024-09-12T12:22:54.306432+0000","last_unstale":"2024-09-12T12:24:35.843751+0000","last_undegraded":"2024-09-12T12:24:35.843751+0000","last_fullsized":"2024-09-12T12:24:35.843751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:07.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846477+0000","last_change":"2024-09-12T12:22:54.318123+0000","last_active":"2024-09-12T12:24:35.846477+0000","last_peered":"2024-09-12T12:24:35.846477+0000","last_clean":"2024-09-12T12:24:35.846477+0000","last_became_active":"2024-09-12T12:22:54.317820+0000","last_became_peered":"2024-09-12T12:22:54.317820+0000","last_unstale":"2024-09-12T12:24:35.846477+0000","last_undegraded":"2024-09-12T12:24:35.846477+0000","last_fullsized":"2024-09-12T12:24:35.846477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:19.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845656+0000","last_change":"2024-09-12T12:22:54.318029+0000","last_active":"2024-09-12T12:24:35.845656+0000","last_peered":"2024-09-12T12:24:35.845656+0000","last_clean":"2024-09-12T12:24:35.845656+0000","last_became_active":"2024-09-12T12:22:54.316015+0000","last_became_peered":"2024-09-12T12:22:54.316015+0000","last_unstale":"2024-09-12T12:24:35.845656+0000","last_undegraded":"2024-09-12T12:24:35.845656+0000","last_fullsized":"2024-09-12T12:24:35.845656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840073+0000","last_change":"2024-09-12T12:22:54.325688+0000","last_active":"2024-09-12T12:24:35.840073+0000","last_peered":"2024-09-12T12:24:35.840073+0000","last_clean":"2024-09-12T12:24:35.840073+0000","last_became_active":"2024-09-12T12:22:54.325375+0000","last_became_peered":"2024-09-12T12:22:54.325375+0000","last_unstale":"2024-09-12T12:24:35.840073+0000","last_undegraded":"2024-09-12T12:24:35.840073+0000","last_fullsized":"2024-09-12T12:24:35.840073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:43.971575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845126+0000","last_change":"2024-09-12T12:22:54.315713+0000","last_active":"2024-09-12T12:24:35.845126+0000","last_peered":"2024-09-12T12:24:35.845126+0000","last_clean":"2024-09-12T12:24:35.845126+0000","last_became_active":"2024-09-12T12:22:54.315401+0000","last_became_peered":"2024-09-12T12:22:54.315401+0000","last_unstale":"2024-09-12T12:24:35.845126+0000","last_undegraded":"2024-09-12T12:24:35.845126+0000","last_fullsized":"2024-09-12T12:24:35.845126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:35:31.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454507+0000","last_change":"2024-09-12T12:22:54.314543+0000","last_active":"2024-09-12T12:24:36.454507+0000","last_peered":"2024-09-12T12:24:36.454507+0000","last_clean":"2024-09-12T12:24:36.454507+0000","last_became_active":"2024-09-12T12:22:54.314216+0000","last_became_peered":"2024-09-12T12:22:54.314216+0000","last_unstale":"2024-09-12T12:24:36.454507+0000","last_undegraded":"2024-09-12T12:24:36.454507+0000","last_fullsized":"2024-09-12T12:24:36.454507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:12.180355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265109+0000","last_change":"2024-09-12T12:22:54.313637+0000","last_active":"2024-09-12T12:24:36.265109+0000","last_peered":"2024-09-12T12:24:36.265109+0000","last_clean":"2024-09-12T12:24:36.265109+0000","last_became_active":"2024-09-12T12:22:54.313327+0000","last_became_peered":"2024-09-12T12:22:54.313327+0000","last_unstale":"2024-09-12T12:24:36.265109+0000","last_undegraded":"2024-09-12T12:24:36.265109+0000","last_fullsized":"2024-09-12T12:24:36.265109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:24.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842972+0000","last_change":"2024-09-12T12:22:54.306018+0000","last_active":"2024-09-12T12:24:35.842972+0000","last_peered":"2024-09-12T12:24:35.842972+0000","last_clean":"2024-09-12T12:24:35.842972+0000","last_became_active":"2024-09-12T12:22:54.305683+0000","last_became_peered":"2024-09-12T12:22:54.305683+0000","last_unstale":"2024-09-12T12:24:35.842972+0000","last_undegraded":"2024-09-12T12:24:35.842972+0000","last_fullsized":"2024-09-12T12:24:35.842972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:00.464765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846578+0000","last_change":"2024-09-12T12:22:54.319169+0000","last_active":"2024-09-12T12:24:35.846578+0000","last_peered":"2024-09-12T12:24:35.846578+0000","last_clean":"2024-09-12T12:24:35.846578+0000","last_became_active":"2024-09-12T12:22:54.318831+0000","last_became_peered":"2024-09-12T12:22:54.318831+0000","last_unstale":"2024-09-12T12:24:35.846578+0000","last_undegraded":"2024-09-12T12:24:35.846578+0000","last_fullsized":"2024-09-12T12:24:35.846578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:42.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841502+0000","last_change":"2024-09-12T12:22:54.305760+0000","last_active":"2024-09-12T12:24:35.841502+0000","last_peered":"2024-09-12T12:24:35.841502+0000","last_clean":"2024-09-12T12:24:35.841502+0000","last_became_active":"2024-09-12T12:22:54.305455+0000","last_became_peered":"2024-09-12T12:22:54.305455+0000","last_unstale":"2024-09-12T12:24:35.841502+0000","last_undegraded":"2024-09-12T12:24:35.841502+0000","last_fullsized":"2024-09-12T12:24:35.841502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:54.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843619+0000","last_change":"2024-09-12T12:22:54.311420+0000","last_active":"2024-09-12T12:24:35.843619+0000","last_peered":"2024-09-12T12:24:35.843619+0000","last_clean":"2024-09-12T12:24:35.843619+0000","last_became_active":"2024-09-12T12:22:54.311072+0000","last_became_peered":"2024-09-12T12:22:54.311072+0000","last_unstale":"2024-09-12T12:24:35.843619+0000","last_undegraded":"2024-09-12T12:24:35.843619+0000","last_fullsized":"2024-09-12T12:24:35.843619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:54.476587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454348+0000","last_change":"2024-09-12T12:22:54.313093+0000","last_active":"2024-09-12T12:24:36.454348+0000","last_peered":"2024-09-12T12:24:36.454348+0000","last_clean":"2024-09-12T12:24:36.454348+0000","last_became_active":"2024-09-12T12:22:54.312220+0000","last_became_peered":"2024-09-12T12:22:54.312220+0000","last_unstale":"2024-09-12T12:24:36.454348+0000","last_undegraded":"2024-09-12T12:24:36.454348+0000","last_fullsized":"2024-09-12T12:24:36.454348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:33.241798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846293+0000","last_change":"2024-09-12T12:22:54.310536+0000","last_active":"2024-09-12T12:24:35.846293+0000","last_peered":"2024-09-12T12:24:35.846293+0000","last_clean":"2024-09-12T12:24:35.846293+0000","last_became_active":"2024-09-12T12:22:54.310203+0000","last_became_peered":"2024-09-12T12:22:54.310203+0000","last_unstale":"2024-09-12T12:24:35.846293+0000","last_undegraded":"2024-09-12T12:24:35.846293+0000","last_fullsized":"2024-09-12T12:24:35.846293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:40.957367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846379+0000","last_change":"2024-09-12T12:22:54.312898+0000","last_active":"2024-09-12T12:24:35.846379+0000","last_peered":"2024-09-12T12:24:35.846379+0000","last_clean":"2024-09-12T12:24:35.846379+0000","last_became_active":"2024-09-12T12:22:54.312449+0000","last_became_peered":"2024-09-12T12:22:54.312449+0000","last_unstale":"2024-09-12T12:24:35.846379+0000","last_undegraded":"2024-09-12T12:24:35.846379+0000","last_fullsized":"2024-09-12T12:24:35.846379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:57.384949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265050+0000","last_change":"2024-09-12T12:22:54.312206+0000","last_active":"2024-09-12T12:24:36.265050+0000","last_peered":"2024-09-12T12:24:36.265050+0000","last_clean":"2024-09-12T12:24:36.265050+0000","last_became_active":"2024-09-12T12:22:54.311187+0000","last_became_peered":"2024-09-12T12:22:54.311187+0000","last_unstale":"2024-09-12T12:24:36.265050+0000","last_undegraded":"2024-09-12T12:24:36.265050+0000","last_fullsized":"2024-09-12T12:24:36.265050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:22.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268021+0000","last_change":"2024-09-12T12:22:54.312083+0000","last_active":"2024-09-12T12:24:36.268021+0000","last_peered":"2024-09-12T12:24:36.268021+0000","last_clean":"2024-09-12T12:24:36.268021+0000","last_became_active":"2024-09-12T12:22:54.310716+0000","last_became_peered":"2024-09-12T12:22:54.310716+0000","last_unstale":"2024-09-12T12:24:36.268021+0000","last_undegraded":"2024-09-12T12:24:36.268021+0000","last_fullsized":"2024-09-12T12:24:36.268021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:22.717416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847115+0000","last_change":"2024-09-12T12:22:54.315088+0000","last_active":"2024-09-12T12:24:35.847115+0000","last_peered":"2024-09-12T12:24:35.847115+0000","last_clean":"2024-09-12T12:24:35.847115+0000","last_became_active":"2024-09-12T12:22:54.314601+0000","last_became_peered":"2024-09-12T12:22:54.314601+0000","last_unstale":"2024-09-12T12:24:35.847115+0000","last_undegraded":"2024-09-12T12:24:35.847115+0000","last_fullsized":"2024-09-12T12:24:35.847115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:35.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840900+0000","last_change":"2024-09-12T12:22:54.305332+0000","last_active":"2024-09-12T12:24:35.840900+0000","last_peered":"2024-09-12T12:24:35.840900+0000","last_clean":"2024-09-12T12:24:35.840900+0000","last_became_active":"2024-09-12T12:22:54.305017+0000","last_became_peered":"2024-09-12T12:22:54.305017+0000","last_unstale":"2024-09-12T12:24:35.840900+0000","last_undegraded":"2024-09-12T12:24:35.840900+0000","last_fullsized":"2024-09-12T12:24:35.840900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:16.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454808+0000","last_change":"2024-09-12T12:22:54.319768+0000","last_active":"2024-09-12T12:24:36.454808+0000","last_peered":"2024-09-12T12:24:36.454808+0000","last_clean":"2024-09-12T12:24:36.454808+0000","last_became_active":"2024-09-12T12:22:54.319451+0000","last_became_peered":"2024-09-12T12:22:54.319451+0000","last_unstale":"2024-09-12T12:24:36.454808+0000","last_undegraded":"2024-09-12T12:24:36.454808+0000","last_fullsized":"2024-09-12T12:24:36.454808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:56.368891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845095+0000","last_change":"2024-09-12T12:22:54.323162+0000","last_active":"2024-09-12T12:24:35.845095+0000","last_peered":"2024-09-12T12:24:35.845095+0000","last_clean":"2024-09-12T12:24:35.845095+0000","last_became_active":"2024-09-12T12:22:54.322068+0000","last_became_peered":"2024-09-12T12:22:54.322068+0000","last_unstale":"2024-09-12T12:24:35.845095+0000","last_undegraded":"2024-09-12T12:24:35.845095+0000","last_fullsized":"2024-09-12T12:24:35.845095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:54.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846581+0000","last_change":"2024-09-12T12:22:54.306125+0000","last_active":"2024-09-12T12:24:35.846581+0000","last_peered":"2024-09-12T12:24:35.846581+0000","last_clean":"2024-09-12T12:24:35.846581+0000","last_became_active":"2024-09-12T12:22:54.305790+0000","last_became_peered":"2024-09-12T12:22:54.305790+0000","last_unstale":"2024-09-12T12:24:35.846581+0000","last_undegraded":"2024-09-12T12:24:35.846581+0000","last_fullsized":"2024-09-12T12:24:35.846581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:36.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840388+0000","last_change":"2024-09-12T12:22:54.305099+0000","last_active":"2024-09-12T12:24:35.840388+0000","last_peered":"2024-09-12T12:24:35.840388+0000","last_clean":"2024-09-12T12:24:35.840388+0000","last_became_active":"2024-09-12T12:22:54.304649+0000","last_became_peered":"2024-09-12T12:22:54.304649+0000","last_unstale":"2024-09-12T12:24:35.840388+0000","last_undegraded":"2024-09-12T12:24:35.840388+0000","last_fullsized":"2024-09-12T12:24:35.840388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:05.771434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843912+0000","last_change":"2024-09-12T12:22:54.319247+0000","last_active":"2024-09-12T12:24:35.843912+0000","last_peered":"2024-09-12T12:24:35.843912+0000","last_clean":"2024-09-12T12:24:35.843912+0000","last_became_active":"2024-09-12T12:22:54.318894+0000","last_became_peered":"2024-09-12T12:22:54.318894+0000","last_unstale":"2024-09-12T12:24:35.843912+0000","last_undegraded":"2024-09-12T12:24:35.843912+0000","last_fullsized":"2024-09-12T12:24:35.843912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:55.692071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840909+0000","last_change":"2024-09-12T12:23:35.076997+0000","last_active":"2024-09-12T12:24:35.840909+0000","last_peered":"2024-09-12T12:24:35.840909+0000","last_clean":"2024-09-12T12:24:35.840909+0000","last_became_active":"2024-09-12T12:23:35.076506+0000","last_became_peered":"2024-09-12T12:23:35.076506+0000","last_unstale":"2024-09-12T12:24:35.840909+0000","last_undegraded":"2024-09-12T12:24:35.840909+0000","last_fullsized":"2024-09-12T12:24:35.840909+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846705+0000","last_change":"2024-09-12T12:22:54.314298+0000","last_active":"2024-09-12T12:24:35.846705+0000","last_peered":"2024-09-12T12:24:35.846705+0000","last_clean":"2024-09-12T12:24:35.846705+0000","last_became_active":"2024-09-12T12:22:54.311726+0000","last_became_peered":"2024-09-12T12:22:54.311726+0000","last_unstale":"2024-09-12T12:24:35.846705+0000","last_undegraded":"2024-09-12T12:24:35.846705+0000","last_fullsized":"2024-09-12T12:24:35.846705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:13.298082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846823+0000","last_change":"2024-09-12T12:22:54.304397+0000","last_active":"2024-09-12T12:24:35.846823+0000","last_peered":"2024-09-12T12:24:35.846823+0000","last_clean":"2024-09-12T12:24:35.846823+0000","last_became_active":"2024-09-12T12:22:54.304048+0000","last_became_peered":"2024-09-12T12:22:54.304048+0000","last_unstale":"2024-09-12T12:24:35.846823+0000","last_undegraded":"2024-09-12T12:24:35.846823+0000","last_fullsized":"2024-09-12T12:24:35.846823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:13.518433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843515+0000","last_change":"2024-09-12T12:22:54.312229+0000","last_active":"2024-09-12T12:24:35.843515+0000","last_peered":"2024-09-12T12:24:35.843515+0000","last_clean":"2024-09-12T12:24:35.843515+0000","last_became_active":"2024-09-12T12:22:54.311806+0000","last_became_peered":"2024-09-12T12:22:54.311806+0000","last_unstale":"2024-09-12T12:24:35.843515+0000","last_undegraded":"2024-09-12T12:24:35.843515+0000","last_fullsized":"2024-09-12T12:24:35.843515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:28.865595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70326,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":629,"num_read_kb":390,"num_write":244,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514533,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":533117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28764,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716388,"statfs":{"total":95995035648,"available":95965581312,"internally_reserved":0,"allocated":1777664,"data_stored":1187035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1101824,"data_stored":532542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135926,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1089536,"data_stored":532808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397562,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37008,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708144,"statfs":{"total":95995035648,"available":95957139456,"internally_reserved":0,"allocated":1695744,"data_stored":1129026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561088,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712908,"statfs":{"total":95995035648,"available":95962017792,"internally_reserved":0,"allocated":1077248,"data_stored":528046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37012,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708140,"statfs":{"total":95995035648,"available":95957135360,"internally_reserved":0,"allocated":1703936,"data_stored":1124608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1085440,"data_stored":532120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1089536,"data_stored":527754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36488,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708664,"statfs":{"total":95995035648,"available":95957671936,"internally_reserved":0,"allocated":1167360,"data_stored":593200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1146880,"data_stored":592587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1101824,"data_stored":529895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:50.732 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:24:50.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:50 smithi038 ceph-mon[30810]: from='client.24953 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:51.110 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:51.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:50 smithi154 ceph-mon[35578]: from='client.24953 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:51.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:50 smithi071 ceph-mon[34859]: from='client.24953 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 -- 172.21.15.38:0/510190619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 msgr2=0x7f502c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 --2- 172.21.15.38:0/510190619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 0x7f502c110ca0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5024009ca0 tx=0x7f502402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 -- 172.21.15.38:0/510190619 shutdown_connections 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 --2- 172.21.15.38:0/510190619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 0x7f502c110ca0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 --2- 172.21.15.38:0/510190619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f502c1049a0 0x7f502c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 --2- 172.21.15.38:0/510190619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 0x7f502c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 -- 172.21.15.38:0/510190619 >> 172.21.15.38:0/510190619 conn(0x7f502c0ffa90 msgr2=0x7f502c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 -- 172.21.15.38:0/510190619 shutdown_connections 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.696+0000 7f5033600640 1 -- 172.21.15.38:0/510190619 wait complete. 2024-09-12T12:24:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.697+0000 7f5033600640 1 Processor -- start 2024-09-12T12:24:51.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.697+0000 7f5033600640 1 -- start start 2024-09-12T12:24:51.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5033600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 0x7f502c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5033600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f502c1049a0 0x7f502c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5033600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 0x7f502c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5033600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f502c114180 con 0x7f502c109120 2024-09-12T12:24:51.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5033600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f502c114000 con 0x7f502c1049a0 2024-09-12T12:24:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5033600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f502c114300 con 0x7f502c103ff0 2024-09-12T12:24:51.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5031600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 0x7f502c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5030c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 0x7f502c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5030c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 0x7f502c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:49022/0 (socket says 172.21.15.38:49022) 2024-09-12T12:24:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5031600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 0x7f502c19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38838/0 (socket says 172.21.15.38:38838) 2024-09-12T12:24:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f502be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f502c1049a0 0x7f502c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.698+0000 7f5030c00640 1 -- 172.21.15.38:0/2780504105 learned_addr learned my addr 172.21.15.38:0/2780504105 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5030c00640 1 -- 172.21.15.38:0/2780504105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f502c1049a0 msgr2=0x7f502c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5030c00640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f502c1049a0 0x7f502c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5030c00640 1 -- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 msgr2=0x7f502c19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5030c00640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 0x7f502c19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5030c00640 1 -- 172.21.15.38:0/2780504105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c19f550 con 0x7f502c103ff0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f502be00640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f502c1049a0 0x7f502c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5030c00640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 0x7f502c19a5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f502000d950 tx=0x7f502000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5029600640 1 -- 172.21.15.38:0/2780504105 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020017030 con 0x7f502c103ff0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c19f840 con 0x7f502c103ff0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5029600640 1 -- 172.21.15.38:0/2780504105 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5020004020 con 0x7f502c103ff0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5029600640 1 -- 172.21.15.38:0/2780504105 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50200047a0 con 0x7f502c103ff0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.699+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c1a7120 con 0x7f502c103ff0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.701+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502c1043d0 con 0x7f502c103ff0 2024-09-12T12:24:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.703+0000 7f5029600640 1 -- 172.21.15.38:0/2780504105 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f50200041d0 con 0x7f502c103ff0 2024-09-12T12:24:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.704+0000 7f5029600640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f50140a2c10 0x7f50140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.704+0000 7f5029600640 1 -- 172.21.15.38:0/2780504105 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f50200cf1b0 con 0x7f502c103ff0 2024-09-12T12:24:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.704+0000 7f502be00640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f50140a2c10 0x7f50140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.705+0000 7f502be00640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f50140a2c10 0x7f50140a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f502c10aaf0 tx=0x7f5018005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.706+0000 7f5029600640 1 -- 172.21.15.38:0/2780504105 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f502009bba0 con 0x7f502c103ff0 2024-09-12T12:24:51.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.889+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f502c100cc0 con 0x7f50140a2c10 2024-09-12T12:24:51.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.897+0000 7f5029600640 1 -- 172.21.15.38:0/2780504105 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340430 (secure 0 0 0) 0x7f502c100cc0 con 0x7f50140a2c10 2024-09-12T12:24:51.902 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:51.903 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-12T12:24:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.901+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f50140a2c10 msgr2=0x7f50140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.901+0000 7f5033600640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f50140a2c10 0x7f50140a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f502c10aaf0 tx=0x7f5018005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 msgr2=0x7f502c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 0x7f502c19a5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f502000d950 tx=0x7f502000de10 comp rx=0 tx=0).stop 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 shutdown_connections 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f50140a2c10 0x7f50140a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f502c109120 0x7f502c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f502c1049a0 0x7f502c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 --2- 172.21.15.38:0/2780504105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f502c103ff0 0x7f502c19a5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 >> 172.21.15.38:0/2780504105 conn(0x7f502c0ffa90 msgr2=0x7f502c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 shutdown_connections 2024-09-12T12:24:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:51.902+0000 7f5033600640 1 -- 172.21.15.38:0/2780504105 wait complete. 2024-09-12T12:24:52.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:51 smithi154 ceph-mon[35578]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:52.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:51 smithi038 ceph-mon[30810]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:51 smithi071 ceph-mon[34859]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:52.669 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-12T12:24:50.102162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660928,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":755,"num_read_kb":499,"num_write":427,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389048,"kb_used_data":14768,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552776,"statfs":{"total":1151940427776,"available":1151542042624,"internally_reserved":0,"allocated":15122432,"data_stored":8342738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003232"},"pg_stats":[{"pgid":"2.1f","version":"91'13","reported_seq":113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.275217+0000","last_change":"2024-09-12T12:22:51.847865+0000","last_active":"2024-09-12T12:24:45.275217+0000","last_peered":"2024-09-12T12:24:45.275217+0000","last_clean":"2024-09-12T12:24:45.275217+0000","last_became_active":"2024-09-12T12:22:51.847437+0000","last_became_peered":"2024-09-12T12:22:51.847437+0000","last_unstale":"2024-09-12T12:24:45.275217+0000","last_undegraded":"2024-09-12T12:24:45.275217+0000","last_fullsized":"2024-09-12T12:24:45.275217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:34.486264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845391+0000","last_change":"2024-09-12T12:22:54.316759+0000","last_active":"2024-09-12T12:24:35.845391+0000","last_peered":"2024-09-12T12:24:35.845391+0000","last_clean":"2024-09-12T12:24:35.845391+0000","last_became_active":"2024-09-12T12:22:54.315906+0000","last_became_peered":"2024-09-12T12:22:54.315906+0000","last_unstale":"2024-09-12T12:24:35.845391+0000","last_undegraded":"2024-09-12T12:24:35.845391+0000","last_fullsized":"2024-09-12T12:24:35.845391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:54.465835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845427+0000","last_change":"2024-09-12T12:23:03.387327+0000","last_active":"2024-09-12T12:24:35.845427+0000","last_peered":"2024-09-12T12:24:35.845427+0000","last_clean":"2024-09-12T12:24:35.845427+0000","last_became_active":"2024-09-12T12:23:03.386929+0000","last_became_peered":"2024-09-12T12:23:03.386929+0000","last_unstale":"2024-09-12T12:24:35.845427+0000","last_undegraded":"2024-09-12T12:24:35.845427+0000","last_fullsized":"2024-09-12T12:24:35.845427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.033999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845616+0000","last_change":"2024-09-12T12:22:51.990331+0000","last_active":"2024-09-12T12:24:35.845616+0000","last_peered":"2024-09-12T12:24:35.845616+0000","last_clean":"2024-09-12T12:24:35.845616+0000","last_became_active":"2024-09-12T12:22:51.989844+0000","last_became_peered":"2024-09-12T12:22:51.989844+0000","last_unstale":"2024-09-12T12:24:35.845616+0000","last_undegraded":"2024-09-12T12:24:35.845616+0000","last_fullsized":"2024-09-12T12:24:35.845616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:47.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847103+0000","last_change":"2024-09-12T12:22:54.317141+0000","last_active":"2024-09-12T12:24:35.847103+0000","last_peered":"2024-09-12T12:24:35.847103+0000","last_clean":"2024-09-12T12:24:35.847103+0000","last_became_active":"2024-09-12T12:22:54.312292+0000","last_became_peered":"2024-09-12T12:22:54.312292+0000","last_unstale":"2024-09-12T12:24:35.847103+0000","last_undegraded":"2024-09-12T12:24:35.847103+0000","last_fullsized":"2024-09-12T12:24:35.847103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.943100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267513+0000","last_change":"2024-09-12T12:23:03.379532+0000","last_active":"2024-09-12T12:24:36.267513+0000","last_peered":"2024-09-12T12:24:36.267513+0000","last_clean":"2024-09-12T12:24:36.267513+0000","last_became_active":"2024-09-12T12:23:03.379087+0000","last_became_peered":"2024-09-12T12:23:03.379087+0000","last_unstale":"2024-09-12T12:24:36.267513+0000","last_undegraded":"2024-09-12T12:24:36.267513+0000","last_fullsized":"2024-09-12T12:24:36.267513+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.971474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.278754+0000","last_change":"2024-09-12T12:24:36.278754+0000","last_active":"2024-09-12T12:24:36.278754+0000","last_peered":"2024-09-12T12:24:36.278754+0000","last_clean":"2024-09-12T12:24:36.278754+0000","last_became_active":"2024-09-12T12:24:36.269065+0000","last_became_peered":"2024-09-12T12:24:36.269065+0000","last_unstale":"2024-09-12T12:24:36.278754+0000","last_undegraded":"2024-09-12T12:24:36.278754+0000","last_fullsized":"2024-09-12T12:24:36.278754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:12.224802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454663+0000","last_change":"2024-09-12T12:22:54.315178+0000","last_active":"2024-09-12T12:24:36.454663+0000","last_peered":"2024-09-12T12:24:36.454663+0000","last_clean":"2024-09-12T12:24:36.454663+0000","last_became_active":"2024-09-12T12:22:54.314408+0000","last_became_peered":"2024-09-12T12:22:54.314408+0000","last_unstale":"2024-09-12T12:24:36.454663+0000","last_undegraded":"2024-09-12T12:24:36.454663+0000","last_fullsized":"2024-09-12T12:24:36.454663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268023+0000","last_change":"2024-09-12T12:23:03.384629+0000","last_active":"2024-09-12T12:24:36.268023+0000","last_peered":"2024-09-12T12:24:36.268023+0000","last_clean":"2024-09-12T12:24:36.268023+0000","last_became_active":"2024-09-12T12:23:03.383750+0000","last_became_peered":"2024-09-12T12:23:03.383750+0000","last_unstale":"2024-09-12T12:24:36.268023+0000","last_undegraded":"2024-09-12T12:24:36.268023+0000","last_fullsized":"2024-09-12T12:24:36.268023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:24.377269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844481+0000","last_change":"2024-09-12T12:22:51.847561+0000","last_active":"2024-09-12T12:24:35.844481+0000","last_peered":"2024-09-12T12:24:35.844481+0000","last_clean":"2024-09-12T12:24:35.844481+0000","last_became_active":"2024-09-12T12:22:51.846862+0000","last_became_peered":"2024-09-12T12:22:51.846862+0000","last_unstale":"2024-09-12T12:24:35.844481+0000","last_undegraded":"2024-09-12T12:24:35.844481+0000","last_fullsized":"2024-09-12T12:24:35.844481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:37.907652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840622+0000","last_change":"2024-09-12T12:22:54.313493+0000","last_active":"2024-09-12T12:24:35.840622+0000","last_peered":"2024-09-12T12:24:35.840622+0000","last_clean":"2024-09-12T12:24:35.840622+0000","last_became_active":"2024-09-12T12:22:54.313115+0000","last_became_peered":"2024-09-12T12:22:54.313115+0000","last_unstale":"2024-09-12T12:24:35.840622+0000","last_undegraded":"2024-09-12T12:24:35.840622+0000","last_fullsized":"2024-09-12T12:24:35.840622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:39.631537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267698+0000","last_change":"2024-09-12T12:23:03.383997+0000","last_active":"2024-09-12T12:24:36.267698+0000","last_peered":"2024-09-12T12:24:36.267698+0000","last_clean":"2024-09-12T12:24:36.267698+0000","last_became_active":"2024-09-12T12:23:03.382952+0000","last_became_peered":"2024-09-12T12:23:03.382952+0000","last_unstale":"2024-09-12T12:24:36.267698+0000","last_undegraded":"2024-09-12T12:24:36.267698+0000","last_fullsized":"2024-09-12T12:24:36.267698+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:37.949848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846739+0000","last_change":"2024-09-12T12:22:54.311875+0000","last_active":"2024-09-12T12:24:35.846739+0000","last_peered":"2024-09-12T12:24:35.846739+0000","last_clean":"2024-09-12T12:24:35.846739+0000","last_became_active":"2024-09-12T12:22:54.311301+0000","last_became_peered":"2024-09-12T12:22:54.311301+0000","last_unstale":"2024-09-12T12:24:35.846739+0000","last_undegraded":"2024-09-12T12:24:35.846739+0000","last_fullsized":"2024-09-12T12:24:35.846739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:47.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844011+0000","last_change":"2024-09-12T12:22:51.849400+0000","last_active":"2024-09-12T12:24:35.844011+0000","last_peered":"2024-09-12T12:24:35.844011+0000","last_clean":"2024-09-12T12:24:35.844011+0000","last_became_active":"2024-09-12T12:22:51.848295+0000","last_became_peered":"2024-09-12T12:22:51.848295+0000","last_unstale":"2024-09-12T12:24:35.844011+0000","last_undegraded":"2024-09-12T12:24:35.844011+0000","last_fullsized":"2024-09-12T12:24:35.844011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268078+0000","last_change":"2024-09-12T12:23:03.779217+0000","last_active":"2024-09-12T12:24:36.268078+0000","last_peered":"2024-09-12T12:24:36.268078+0000","last_clean":"2024-09-12T12:24:36.268078+0000","last_became_active":"2024-09-12T12:23:03.778732+0000","last_became_peered":"2024-09-12T12:23:03.778732+0000","last_unstale":"2024-09-12T12:24:36.268078+0000","last_undegraded":"2024-09-12T12:24:36.268078+0000","last_fullsized":"2024-09-12T12:24:36.268078+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:49.676157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845202+0000","last_change":"2024-09-12T12:22:54.323222+0000","last_active":"2024-09-12T12:24:35.845202+0000","last_peered":"2024-09-12T12:24:35.845202+0000","last_clean":"2024-09-12T12:24:35.845202+0000","last_became_active":"2024-09-12T12:22:54.321035+0000","last_became_peered":"2024-09-12T12:22:54.321035+0000","last_unstale":"2024-09-12T12:24:35.845202+0000","last_undegraded":"2024-09-12T12:24:35.845202+0000","last_fullsized":"2024-09-12T12:24:35.845202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:04.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.851098+0000","last_change":"2024-09-12T12:24:35.850509+0000","last_active":"2024-09-12T12:24:35.851098+0000","last_peered":"2024-09-12T12:24:35.851098+0000","last_clean":"2024-09-12T12:24:35.851098+0000","last_became_active":"2024-09-12T12:24:35.846578+0000","last_became_peered":"2024-09-12T12:24:35.846578+0000","last_unstale":"2024-09-12T12:24:35.851098+0000","last_undegraded":"2024-09-12T12:24:35.851098+0000","last_fullsized":"2024-09-12T12:24:35.851098+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:10.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267846+0000","last_change":"2024-09-12T12:23:35.079820+0000","last_active":"2024-09-12T12:24:36.267846+0000","last_peered":"2024-09-12T12:24:36.267846+0000","last_clean":"2024-09-12T12:24:36.267846+0000","last_became_active":"2024-09-12T12:23:35.079362+0000","last_became_peered":"2024-09-12T12:23:35.079362+0000","last_unstale":"2024-09-12T12:24:36.267846+0000","last_undegraded":"2024-09-12T12:24:36.267846+0000","last_fullsized":"2024-09-12T12:24:36.267846+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:22.713646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842823+0000","last_change":"2024-09-12T12:22:54.307950+0000","last_active":"2024-09-12T12:24:35.842823+0000","last_peered":"2024-09-12T12:24:35.842823+0000","last_clean":"2024-09-12T12:24:35.842823+0000","last_became_active":"2024-09-12T12:22:54.307595+0000","last_became_peered":"2024-09-12T12:22:54.307595+0000","last_unstale":"2024-09-12T12:24:35.842823+0000","last_undegraded":"2024-09-12T12:24:35.842823+0000","last_fullsized":"2024-09-12T12:24:35.842823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:11.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845231+0000","last_change":"2024-09-12T12:22:51.851424+0000","last_active":"2024-09-12T12:24:35.845231+0000","last_peered":"2024-09-12T12:24:35.845231+0000","last_clean":"2024-09-12T12:24:35.845231+0000","last_became_active":"2024-09-12T12:22:51.851043+0000","last_became_peered":"2024-09-12T12:22:51.851043+0000","last_unstale":"2024-09-12T12:24:35.845231+0000","last_undegraded":"2024-09-12T12:24:35.845231+0000","last_fullsized":"2024-09-12T12:24:35.845231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841159+0000","last_change":"2024-09-12T12:23:03.381773+0000","last_active":"2024-09-12T12:24:35.841159+0000","last_peered":"2024-09-12T12:24:35.841159+0000","last_clean":"2024-09-12T12:24:35.841159+0000","last_became_active":"2024-09-12T12:23:03.378442+0000","last_became_peered":"2024-09-12T12:23:03.378442+0000","last_unstale":"2024-09-12T12:24:35.841159+0000","last_undegraded":"2024-09-12T12:24:35.841159+0000","last_fullsized":"2024-09-12T12:24:35.841159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.570787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843682+0000","last_change":"2024-09-12T12:22:54.310010+0000","last_active":"2024-09-12T12:24:35.843682+0000","last_peered":"2024-09-12T12:24:35.843682+0000","last_clean":"2024-09-12T12:24:35.843682+0000","last_became_active":"2024-09-12T12:22:54.309499+0000","last_became_peered":"2024-09-12T12:22:54.309499+0000","last_unstale":"2024-09-12T12:24:35.843682+0000","last_undegraded":"2024-09-12T12:24:35.843682+0000","last_fullsized":"2024-09-12T12:24:35.843682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.456842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.453940+0000","last_change":"2024-09-12T12:22:51.990294+0000","last_active":"2024-09-12T12:24:36.453940+0000","last_peered":"2024-09-12T12:24:36.453940+0000","last_clean":"2024-09-12T12:24:36.453940+0000","last_became_active":"2024-09-12T12:22:51.989925+0000","last_became_peered":"2024-09-12T12:22:51.989925+0000","last_unstale":"2024-09-12T12:24:36.453940+0000","last_undegraded":"2024-09-12T12:24:36.453940+0000","last_fullsized":"2024-09-12T12:24:36.453940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:56.754802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267887+0000","last_change":"2024-09-12T12:23:03.780256+0000","last_active":"2024-09-12T12:24:36.267887+0000","last_peered":"2024-09-12T12:24:36.267887+0000","last_clean":"2024-09-12T12:24:36.267887+0000","last_became_active":"2024-09-12T12:23:03.779808+0000","last_became_peered":"2024-09-12T12:23:03.779808+0000","last_unstale":"2024-09-12T12:24:36.267887+0000","last_undegraded":"2024-09-12T12:24:36.267887+0000","last_fullsized":"2024-09-12T12:24:36.267887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:58.236749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846910+0000","last_change":"2024-09-12T12:23:35.084287+0000","last_active":"2024-09-12T12:24:35.846910+0000","last_peered":"2024-09-12T12:24:35.846910+0000","last_clean":"2024-09-12T12:24:35.846910+0000","last_became_active":"2024-09-12T12:23:35.083828+0000","last_became_peered":"2024-09-12T12:23:35.083828+0000","last_unstale":"2024-09-12T12:24:35.846910+0000","last_undegraded":"2024-09-12T12:24:35.846910+0000","last_fullsized":"2024-09-12T12:24:35.846910+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:36.183575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268306+0000","last_change":"2024-09-12T12:22:52.557264+0000","last_active":"2024-09-12T12:24:36.268306+0000","last_peered":"2024-09-12T12:24:36.268306+0000","last_clean":"2024-09-12T12:24:36.268306+0000","last_became_active":"2024-09-12T12:22:52.556783+0000","last_became_peered":"2024-09-12T12:22:52.556783+0000","last_unstale":"2024-09-12T12:24:36.268306+0000","last_undegraded":"2024-09-12T12:24:36.268306+0000","last_fullsized":"2024-09-12T12:24:36.268306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:08.815983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845537+0000","last_change":"2024-09-12T12:23:03.376129+0000","last_active":"2024-09-12T12:24:35.845537+0000","last_peered":"2024-09-12T12:24:35.845537+0000","last_clean":"2024-09-12T12:24:35.845537+0000","last_became_active":"2024-09-12T12:23:03.375200+0000","last_became_peered":"2024-09-12T12:23:03.375200+0000","last_unstale":"2024-09-12T12:24:35.845537+0000","last_undegraded":"2024-09-12T12:24:35.845537+0000","last_fullsized":"2024-09-12T12:24:35.845537+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.418366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845751+0000","last_change":"2024-09-12T12:22:54.314708+0000","last_active":"2024-09-12T12:24:35.845751+0000","last_peered":"2024-09-12T12:24:35.845751+0000","last_clean":"2024-09-12T12:24:35.845751+0000","last_became_active":"2024-09-12T12:22:54.314304+0000","last_became_peered":"2024-09-12T12:22:54.314304+0000","last_unstale":"2024-09-12T12:24:35.845751+0000","last_undegraded":"2024-09-12T12:24:35.845751+0000","last_fullsized":"2024-09-12T12:24:35.845751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:52.198831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841551+0000","last_change":"2024-09-12T12:22:51.846753+0000","last_active":"2024-09-12T12:24:35.841551+0000","last_peered":"2024-09-12T12:24:35.841551+0000","last_clean":"2024-09-12T12:24:35.841551+0000","last_became_active":"2024-09-12T12:22:51.846388+0000","last_became_peered":"2024-09-12T12:22:51.846388+0000","last_unstale":"2024-09-12T12:24:35.841551+0000","last_undegraded":"2024-09-12T12:24:35.841551+0000","last_fullsized":"2024-09-12T12:24:35.841551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:34.511644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844810+0000","last_change":"2024-09-12T12:23:03.779254+0000","last_active":"2024-09-12T12:24:35.844810+0000","last_peered":"2024-09-12T12:24:35.844810+0000","last_clean":"2024-09-12T12:24:35.844810+0000","last_became_active":"2024-09-12T12:23:03.778801+0000","last_became_peered":"2024-09-12T12:23:03.778801+0000","last_unstale":"2024-09-12T12:24:35.844810+0000","last_undegraded":"2024-09-12T12:24:35.844810+0000","last_fullsized":"2024-09-12T12:24:35.844810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265309+0000","last_change":"2024-09-12T12:22:54.312002+0000","last_active":"2024-09-12T12:24:36.265309+0000","last_peered":"2024-09-12T12:24:36.265309+0000","last_clean":"2024-09-12T12:24:36.265309+0000","last_became_active":"2024-09-12T12:22:54.311670+0000","last_became_peered":"2024-09-12T12:22:54.311670+0000","last_unstale":"2024-09-12T12:24:36.265309+0000","last_undegraded":"2024-09-12T12:24:36.265309+0000","last_fullsized":"2024-09-12T12:24:36.265309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:08.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.856791+0000","last_change":"2024-09-12T12:24:35.856332+0000","last_active":"2024-09-12T12:24:35.856791+0000","last_peered":"2024-09-12T12:24:35.856791+0000","last_clean":"2024-09-12T12:24:35.856791+0000","last_became_active":"2024-09-12T12:24:35.846638+0000","last_became_peered":"2024-09-12T12:24:35.846638+0000","last_unstale":"2024-09-12T12:24:35.856791+0000","last_undegraded":"2024-09-12T12:24:35.856791+0000","last_fullsized":"2024-09-12T12:24:35.856791+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.181686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842934+0000","last_change":"2024-09-12T12:23:03.379901+0000","last_active":"2024-09-12T12:24:35.842934+0000","last_peered":"2024-09-12T12:24:35.842934+0000","last_clean":"2024-09-12T12:24:35.842934+0000","last_became_active":"2024-09-12T12:23:03.379385+0000","last_became_peered":"2024-09-12T12:23:03.379385+0000","last_unstale":"2024-09-12T12:24:35.842934+0000","last_undegraded":"2024-09-12T12:24:35.842934+0000","last_fullsized":"2024-09-12T12:24:35.842934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:47.939223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840547+0000","last_change":"2024-09-12T12:22:54.316450+0000","last_active":"2024-09-12T12:24:35.840547+0000","last_peered":"2024-09-12T12:24:35.840547+0000","last_clean":"2024-09-12T12:24:35.840547+0000","last_became_active":"2024-09-12T12:22:54.316058+0000","last_became_peered":"2024-09-12T12:22:54.316058+0000","last_unstale":"2024-09-12T12:24:35.840547+0000","last_undegraded":"2024-09-12T12:24:35.840547+0000","last_fullsized":"2024-09-12T12:24:35.840547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:38.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841081+0000","last_change":"2024-09-12T12:22:51.992564+0000","last_active":"2024-09-12T12:24:35.841081+0000","last_peered":"2024-09-12T12:24:35.841081+0000","last_clean":"2024-09-12T12:24:35.841081+0000","last_became_active":"2024-09-12T12:22:51.992012+0000","last_became_peered":"2024-09-12T12:22:51.992012+0000","last_unstale":"2024-09-12T12:24:35.841081+0000","last_undegraded":"2024-09-12T12:24:35.841081+0000","last_fullsized":"2024-09-12T12:24:35.841081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:26.190486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843835+0000","last_change":"2024-09-12T12:23:03.779309+0000","last_active":"2024-09-12T12:24:35.843835+0000","last_peered":"2024-09-12T12:24:35.843835+0000","last_clean":"2024-09-12T12:24:35.843835+0000","last_became_active":"2024-09-12T12:23:03.778812+0000","last_became_peered":"2024-09-12T12:23:03.778812+0000","last_unstale":"2024-09-12T12:24:35.843835+0000","last_undegraded":"2024-09-12T12:24:35.843835+0000","last_fullsized":"2024-09-12T12:24:35.843835+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:56.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840617+0000","last_change":"2024-09-12T12:22:54.309745+0000","last_active":"2024-09-12T12:24:35.840617+0000","last_peered":"2024-09-12T12:24:35.840617+0000","last_clean":"2024-09-12T12:24:35.840617+0000","last_became_active":"2024-09-12T12:22:54.309388+0000","last_became_peered":"2024-09-12T12:22:54.309388+0000","last_unstale":"2024-09-12T12:24:35.840617+0000","last_undegraded":"2024-09-12T12:24:35.840617+0000","last_fullsized":"2024-09-12T12:24:35.840617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.268141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.275864+0000","last_change":"2024-09-12T12:22:51.850494+0000","last_active":"2024-09-12T12:24:45.275864+0000","last_peered":"2024-09-12T12:24:45.275864+0000","last_clean":"2024-09-12T12:24:45.275864+0000","last_became_active":"2024-09-12T12:22:51.849071+0000","last_became_peered":"2024-09-12T12:22:51.849071+0000","last_unstale":"2024-09-12T12:24:45.275864+0000","last_undegraded":"2024-09-12T12:24:45.275864+0000","last_fullsized":"2024-09-12T12:24:45.275864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:19.203267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265100+0000","last_change":"2024-09-12T12:23:03.383096+0000","last_active":"2024-09-12T12:24:36.265100+0000","last_peered":"2024-09-12T12:24:36.265100+0000","last_clean":"2024-09-12T12:24:36.265100+0000","last_became_active":"2024-09-12T12:23:03.382261+0000","last_became_peered":"2024-09-12T12:23:03.382261+0000","last_unstale":"2024-09-12T12:24:36.265100+0000","last_undegraded":"2024-09-12T12:24:36.265100+0000","last_fullsized":"2024-09-12T12:24:36.265100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:08.976679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840724+0000","last_change":"2024-09-12T12:23:35.079333+0000","last_active":"2024-09-12T12:24:35.840724+0000","last_peered":"2024-09-12T12:24:35.840724+0000","last_clean":"2024-09-12T12:24:35.840724+0000","last_became_active":"2024-09-12T12:23:35.078908+0000","last_became_peered":"2024-09-12T12:23:35.078908+0000","last_unstale":"2024-09-12T12:24:35.840724+0000","last_undegraded":"2024-09-12T12:24:35.840724+0000","last_fullsized":"2024-09-12T12:24:35.840724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:55:59.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.276637+0000","last_change":"2024-09-12T12:22:51.990322+0000","last_active":"2024-09-12T12:24:45.276637+0000","last_peered":"2024-09-12T12:24:45.276637+0000","last_clean":"2024-09-12T12:24:45.276637+0000","last_became_active":"2024-09-12T12:22:51.989970+0000","last_became_peered":"2024-09-12T12:22:51.989970+0000","last_unstale":"2024-09-12T12:24:45.276637+0000","last_undegraded":"2024-09-12T12:24:45.276637+0000","last_fullsized":"2024-09-12T12:24:45.276637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:14.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265365+0000","last_change":"2024-09-12T12:23:35.083806+0000","last_active":"2024-09-12T12:24:36.265365+0000","last_peered":"2024-09-12T12:24:36.265365+0000","last_clean":"2024-09-12T12:24:36.265365+0000","last_became_active":"2024-09-12T12:23:35.083379+0000","last_became_peered":"2024-09-12T12:23:35.083379+0000","last_unstale":"2024-09-12T12:24:36.265365+0000","last_undegraded":"2024-09-12T12:24:36.265365+0000","last_fullsized":"2024-09-12T12:24:36.265365+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:54.146429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265280+0000","last_change":"2024-09-12T12:22:54.305747+0000","last_active":"2024-09-12T12:24:36.265280+0000","last_peered":"2024-09-12T12:24:36.265280+0000","last_clean":"2024-09-12T12:24:36.265280+0000","last_became_active":"2024-09-12T12:22:54.305423+0000","last_became_peered":"2024-09-12T12:22:54.305423+0000","last_unstale":"2024-09-12T12:24:36.265280+0000","last_undegraded":"2024-09-12T12:24:36.265280+0000","last_fullsized":"2024-09-12T12:24:36.265280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.463661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846589+0000","last_change":"2024-09-12T12:22:51.852216+0000","last_active":"2024-09-12T12:24:35.846589+0000","last_peered":"2024-09-12T12:24:35.846589+0000","last_clean":"2024-09-12T12:24:35.846589+0000","last_became_active":"2024-09-12T12:22:51.850495+0000","last_became_peered":"2024-09-12T12:22:51.850495+0000","last_unstale":"2024-09-12T12:24:35.846589+0000","last_undegraded":"2024-09-12T12:24:35.846589+0000","last_fullsized":"2024-09-12T12:24:35.846589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:51.711697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840531+0000","last_change":"2024-09-12T12:23:35.118914+0000","last_active":"2024-09-12T12:24:35.840531+0000","last_peered":"2024-09-12T12:24:35.840531+0000","last_clean":"2024-09-12T12:24:35.840531+0000","last_became_active":"2024-09-12T12:23:35.118411+0000","last_became_peered":"2024-09-12T12:23:35.118411+0000","last_unstale":"2024-09-12T12:24:35.840531+0000","last_undegraded":"2024-09-12T12:24:35.840531+0000","last_fullsized":"2024-09-12T12:24:35.840531+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:08.350538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845231+0000","last_change":"2024-09-12T12:22:54.320573+0000","last_active":"2024-09-12T12:24:35.845231+0000","last_peered":"2024-09-12T12:24:35.845231+0000","last_clean":"2024-09-12T12:24:35.845231+0000","last_became_active":"2024-09-12T12:22:54.320120+0000","last_became_peered":"2024-09-12T12:22:54.320120+0000","last_unstale":"2024-09-12T12:24:35.845231+0000","last_undegraded":"2024-09-12T12:24:35.845231+0000","last_fullsized":"2024-09-12T12:24:35.845231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:35.490584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.266972+0000","last_change":"2024-09-12T12:22:51.851098+0000","last_active":"2024-09-12T12:24:36.266972+0000","last_peered":"2024-09-12T12:24:36.266972+0000","last_clean":"2024-09-12T12:24:36.266972+0000","last_became_active":"2024-09-12T12:22:51.850725+0000","last_became_peered":"2024-09-12T12:22:51.850725+0000","last_unstale":"2024-09-12T12:24:36.266972+0000","last_undegraded":"2024-09-12T12:24:36.266972+0000","last_fullsized":"2024-09-12T12:24:36.266972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:18.308742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846840+0000","last_change":"2024-09-12T12:21:34.312000+0000","last_active":"2024-09-12T12:24:35.846840+0000","last_peered":"2024-09-12T12:24:35.846840+0000","last_clean":"2024-09-12T12:24:35.846840+0000","last_became_active":"2024-09-12T12:21:34.311472+0000","last_became_peered":"2024-09-12T12:21:34.311472+0000","last_unstale":"2024-09-12T12:24:35.846840+0000","last_undegraded":"2024-09-12T12:24:35.846840+0000","last_fullsized":"2024-09-12T12:24:35.846840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_clean_scrub_stamp":"2024-09-12T12:17:58.852566+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846936+0000","last_change":"2024-09-12T12:23:03.387802+0000","last_active":"2024-09-12T12:24:35.846936+0000","last_peered":"2024-09-12T12:24:35.846936+0000","last_clean":"2024-09-12T12:24:35.846936+0000","last_became_active":"2024-09-12T12:23:03.387391+0000","last_became_peered":"2024-09-12T12:23:03.387391+0000","last_unstale":"2024-09-12T12:24:35.846936+0000","last_undegraded":"2024-09-12T12:24:35.846936+0000","last_fullsized":"2024-09-12T12:24:35.846936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:24.741915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847218+0000","last_change":"2024-09-12T12:22:54.314326+0000","last_active":"2024-09-12T12:24:35.847218+0000","last_peered":"2024-09-12T12:24:35.847218+0000","last_clean":"2024-09-12T12:24:35.847218+0000","last_became_active":"2024-09-12T12:22:54.313892+0000","last_became_peered":"2024-09-12T12:22:54.313892+0000","last_unstale":"2024-09-12T12:24:35.847218+0000","last_undegraded":"2024-09-12T12:24:35.847218+0000","last_fullsized":"2024-09-12T12:24:35.847218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:50.980891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:45.277197+0000","last_change":"2024-09-12T12:22:52.557126+0000","last_active":"2024-09-12T12:24:45.277197+0000","last_peered":"2024-09-12T12:24:45.277197+0000","last_clean":"2024-09-12T12:24:45.277197+0000","last_became_active":"2024-09-12T12:22:52.556736+0000","last_became_peered":"2024-09-12T12:22:52.556736+0000","last_unstale":"2024-09-12T12:24:45.277197+0000","last_undegraded":"2024-09-12T12:24:45.277197+0000","last_fullsized":"2024-09-12T12:24:45.277197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:09.199871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454139+0000","last_change":"2024-09-12T12:23:03.380117+0000","last_active":"2024-09-12T12:24:36.454139+0000","last_peered":"2024-09-12T12:24:36.454139+0000","last_clean":"2024-09-12T12:24:36.454139+0000","last_became_active":"2024-09-12T12:23:03.379635+0000","last_became_peered":"2024-09-12T12:23:03.379635+0000","last_unstale":"2024-09-12T12:24:36.454139+0000","last_undegraded":"2024-09-12T12:24:36.454139+0000","last_fullsized":"2024-09-12T12:24:36.454139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:23.227681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846816+0000","last_change":"2024-09-12T12:22:54.316010+0000","last_active":"2024-09-12T12:24:35.846816+0000","last_peered":"2024-09-12T12:24:35.846816+0000","last_clean":"2024-09-12T12:24:35.846816+0000","last_became_active":"2024-09-12T12:22:54.315702+0000","last_became_peered":"2024-09-12T12:22:54.315702+0000","last_unstale":"2024-09-12T12:24:35.846816+0000","last_undegraded":"2024-09-12T12:24:35.846816+0000","last_fullsized":"2024-09-12T12:24:35.846816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:52.370650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840800+0000","last_change":"2024-09-12T12:22:51.854456+0000","last_active":"2024-09-12T12:24:35.840800+0000","last_peered":"2024-09-12T12:24:35.840800+0000","last_clean":"2024-09-12T12:24:35.840800+0000","last_became_active":"2024-09-12T12:22:51.854092+0000","last_became_peered":"2024-09-12T12:22:51.854092+0000","last_unstale":"2024-09-12T12:24:35.840800+0000","last_undegraded":"2024-09-12T12:24:35.840800+0000","last_fullsized":"2024-09-12T12:24:35.840800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:57.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846505+0000","last_change":"2024-09-12T12:23:03.390443+0000","last_active":"2024-09-12T12:24:35.846505+0000","last_peered":"2024-09-12T12:24:35.846505+0000","last_clean":"2024-09-12T12:24:35.846505+0000","last_became_active":"2024-09-12T12:23:03.389825+0000","last_became_peered":"2024-09-12T12:23:03.389825+0000","last_unstale":"2024-09-12T12:24:35.846505+0000","last_undegraded":"2024-09-12T12:24:35.846505+0000","last_fullsized":"2024-09-12T12:24:35.846505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.711075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846984+0000","last_change":"2024-09-12T12:22:54.311694+0000","last_active":"2024-09-12T12:24:35.846984+0000","last_peered":"2024-09-12T12:24:35.846984+0000","last_clean":"2024-09-12T12:24:35.846984+0000","last_became_active":"2024-09-12T12:22:54.311381+0000","last_became_peered":"2024-09-12T12:22:54.311381+0000","last_unstale":"2024-09-12T12:24:35.846984+0000","last_undegraded":"2024-09-12T12:24:35.846984+0000","last_fullsized":"2024-09-12T12:24:35.846984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.378495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.264669+0000","last_change":"2024-09-12T12:22:51.852126+0000","last_active":"2024-09-12T12:24:36.264669+0000","last_peered":"2024-09-12T12:24:36.264669+0000","last_clean":"2024-09-12T12:24:36.264669+0000","last_became_active":"2024-09-12T12:22:51.851766+0000","last_became_peered":"2024-09-12T12:22:51.851766+0000","last_unstale":"2024-09-12T12:24:36.264669+0000","last_undegraded":"2024-09-12T12:24:36.264669+0000","last_fullsized":"2024-09-12T12:24:36.264669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:37.263329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.839944+0000","last_change":"2024-09-12T12:23:03.375569+0000","last_active":"2024-09-12T12:24:35.839944+0000","last_peered":"2024-09-12T12:24:35.839944+0000","last_clean":"2024-09-12T12:24:35.839944+0000","last_became_active":"2024-09-12T12:23:03.375136+0000","last_became_peered":"2024-09-12T12:23:03.375136+0000","last_unstale":"2024-09-12T12:24:35.839944+0000","last_undegraded":"2024-09-12T12:24:35.839944+0000","last_fullsized":"2024-09-12T12:24:35.839944+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:05.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843234+0000","last_change":"2024-09-12T12:22:54.304943+0000","last_active":"2024-09-12T12:24:35.843234+0000","last_peered":"2024-09-12T12:24:35.843234+0000","last_clean":"2024-09-12T12:24:35.843234+0000","last_became_active":"2024-09-12T12:22:54.304573+0000","last_became_peered":"2024-09-12T12:22:54.304573+0000","last_unstale":"2024-09-12T12:24:35.843234+0000","last_undegraded":"2024-09-12T12:24:35.843234+0000","last_fullsized":"2024-09-12T12:24:35.843234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844566+0000","last_change":"2024-09-12T12:22:51.846998+0000","last_active":"2024-09-12T12:24:35.844566+0000","last_peered":"2024-09-12T12:24:35.844566+0000","last_clean":"2024-09-12T12:24:35.844566+0000","last_became_active":"2024-09-12T12:22:51.846617+0000","last_became_peered":"2024-09-12T12:22:51.846617+0000","last_unstale":"2024-09-12T12:24:35.844566+0000","last_undegraded":"2024-09-12T12:24:35.844566+0000","last_fullsized":"2024-09-12T12:24:35.844566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.428244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840001+0000","last_change":"2024-09-12T12:23:03.383519+0000","last_active":"2024-09-12T12:24:35.840001+0000","last_peered":"2024-09-12T12:24:35.840001+0000","last_clean":"2024-09-12T12:24:35.840001+0000","last_became_active":"2024-09-12T12:23:03.383131+0000","last_became_peered":"2024-09-12T12:23:03.383131+0000","last_unstale":"2024-09-12T12:24:35.840001+0000","last_undegraded":"2024-09-12T12:24:35.840001+0000","last_fullsized":"2024-09-12T12:24:35.840001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:59.602027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840217+0000","last_change":"2024-09-12T12:22:54.312418+0000","last_active":"2024-09-12T12:24:35.840217+0000","last_peered":"2024-09-12T12:24:35.840217+0000","last_clean":"2024-09-12T12:24:35.840217+0000","last_became_active":"2024-09-12T12:22:54.311932+0000","last_became_peered":"2024-09-12T12:22:54.311932+0000","last_unstale":"2024-09-12T12:24:35.840217+0000","last_undegraded":"2024-09-12T12:24:35.840217+0000","last_fullsized":"2024-09-12T12:24:35.840217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:48.395607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843694+0000","last_change":"2024-09-12T12:22:51.993506+0000","last_active":"2024-09-12T12:24:35.843694+0000","last_peered":"2024-09-12T12:24:35.843694+0000","last_clean":"2024-09-12T12:24:35.843694+0000","last_became_active":"2024-09-12T12:22:51.993204+0000","last_became_peered":"2024-09-12T12:22:51.993204+0000","last_unstale":"2024-09-12T12:24:35.843694+0000","last_undegraded":"2024-09-12T12:24:35.843694+0000","last_fullsized":"2024-09-12T12:24:35.843694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:34.670023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265386+0000","last_change":"2024-09-12T12:23:03.388552+0000","last_active":"2024-09-12T12:24:36.265386+0000","last_peered":"2024-09-12T12:24:36.265386+0000","last_clean":"2024-09-12T12:24:36.265386+0000","last_became_active":"2024-09-12T12:23:03.388105+0000","last_became_peered":"2024-09-12T12:23:03.388105+0000","last_unstale":"2024-09-12T12:24:36.265386+0000","last_undegraded":"2024-09-12T12:24:36.265386+0000","last_fullsized":"2024-09-12T12:24:36.265386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:08.927714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846503+0000","last_change":"2024-09-12T12:23:35.081015+0000","last_active":"2024-09-12T12:24:35.846503+0000","last_peered":"2024-09-12T12:24:35.846503+0000","last_clean":"2024-09-12T12:24:35.846503+0000","last_became_active":"2024-09-12T12:23:35.080609+0000","last_became_peered":"2024-09-12T12:23:35.080609+0000","last_unstale":"2024-09-12T12:24:35.846503+0000","last_undegraded":"2024-09-12T12:24:35.846503+0000","last_fullsized":"2024-09-12T12:24:35.846503+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:26.700031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.278390+0000","last_change":"2024-09-12T12:22:51.848784+0000","last_active":"2024-09-12T12:24:46.278390+0000","last_peered":"2024-09-12T12:24:46.278390+0000","last_clean":"2024-09-12T12:24:46.278390+0000","last_became_active":"2024-09-12T12:22:51.848255+0000","last_became_peered":"2024-09-12T12:22:51.848255+0000","last_unstale":"2024-09-12T12:24:46.278390+0000","last_undegraded":"2024-09-12T12:24:46.278390+0000","last_fullsized":"2024-09-12T12:24:46.278390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:00.680332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841238+0000","last_change":"2024-09-12T12:23:03.386046+0000","last_active":"2024-09-12T12:24:35.841238+0000","last_peered":"2024-09-12T12:24:35.841238+0000","last_clean":"2024-09-12T12:24:35.841238+0000","last_became_active":"2024-09-12T12:23:03.384264+0000","last_became_peered":"2024-09-12T12:23:03.384264+0000","last_unstale":"2024-09-12T12:24:35.841238+0000","last_undegraded":"2024-09-12T12:24:35.841238+0000","last_fullsized":"2024-09-12T12:24:35.841238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:23.605769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846876+0000","last_change":"2024-09-12T12:22:54.315588+0000","last_active":"2024-09-12T12:24:35.846876+0000","last_peered":"2024-09-12T12:24:35.846876+0000","last_clean":"2024-09-12T12:24:35.846876+0000","last_became_active":"2024-09-12T12:22:54.315216+0000","last_became_peered":"2024-09-12T12:22:54.315216+0000","last_unstale":"2024-09-12T12:24:35.846876+0000","last_undegraded":"2024-09-12T12:24:35.846876+0000","last_fullsized":"2024-09-12T12:24:35.846876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:06.556373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840385+0000","last_change":"2024-09-12T12:22:51.851246+0000","last_active":"2024-09-12T12:24:35.840385+0000","last_peered":"2024-09-12T12:24:35.840385+0000","last_clean":"2024-09-12T12:24:35.840385+0000","last_became_active":"2024-09-12T12:22:51.850963+0000","last_became_peered":"2024-09-12T12:22:51.850963+0000","last_unstale":"2024-09-12T12:24:35.840385+0000","last_undegraded":"2024-09-12T12:24:35.840385+0000","last_fullsized":"2024-09-12T12:24:35.840385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:12.032126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842877+0000","last_change":"2024-09-12T12:23:03.382950+0000","last_active":"2024-09-12T12:24:35.842877+0000","last_peered":"2024-09-12T12:24:35.842877+0000","last_clean":"2024-09-12T12:24:35.842877+0000","last_became_active":"2024-09-12T12:23:03.382503+0000","last_became_peered":"2024-09-12T12:23:03.382503+0000","last_unstale":"2024-09-12T12:24:35.842877+0000","last_undegraded":"2024-09-12T12:24:35.842877+0000","last_fullsized":"2024-09-12T12:24:35.842877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:03.991304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265028+0000","last_change":"2024-09-12T12:22:54.315788+0000","last_active":"2024-09-12T12:24:36.265028+0000","last_peered":"2024-09-12T12:24:36.265028+0000","last_clean":"2024-09-12T12:24:36.265028+0000","last_became_active":"2024-09-12T12:22:54.315343+0000","last_became_peered":"2024-09-12T12:22:54.315343+0000","last_unstale":"2024-09-12T12:24:36.265028+0000","last_undegraded":"2024-09-12T12:24:36.265028+0000","last_fullsized":"2024-09-12T12:24:36.265028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:22.549415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845858+0000","last_change":"2024-09-12T12:22:51.854532+0000","last_active":"2024-09-12T12:24:35.845858+0000","last_peered":"2024-09-12T12:24:35.845858+0000","last_clean":"2024-09-12T12:24:35.845858+0000","last_became_active":"2024-09-12T12:22:51.854206+0000","last_became_peered":"2024-09-12T12:22:51.854206+0000","last_unstale":"2024-09-12T12:24:35.845858+0000","last_undegraded":"2024-09-12T12:24:35.845858+0000","last_fullsized":"2024-09-12T12:24:35.845858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:46.908917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840444+0000","last_change":"2024-09-12T12:23:03.383647+0000","last_active":"2024-09-12T12:24:35.840444+0000","last_peered":"2024-09-12T12:24:35.840444+0000","last_clean":"2024-09-12T12:24:35.840444+0000","last_became_active":"2024-09-12T12:23:03.383094+0000","last_became_peered":"2024-09-12T12:23:03.383094+0000","last_unstale":"2024-09-12T12:24:35.840444+0000","last_undegraded":"2024-09-12T12:24:35.840444+0000","last_fullsized":"2024-09-12T12:24:35.840444+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:03.754250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844164+0000","last_change":"2024-09-12T12:22:54.310717+0000","last_active":"2024-09-12T12:24:35.844164+0000","last_peered":"2024-09-12T12:24:35.844164+0000","last_clean":"2024-09-12T12:24:35.844164+0000","last_became_active":"2024-09-12T12:22:54.309485+0000","last_became_peered":"2024-09-12T12:22:54.309485+0000","last_unstale":"2024-09-12T12:24:35.844164+0000","last_undegraded":"2024-09-12T12:24:35.844164+0000","last_fullsized":"2024-09-12T12:24:35.844164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:10.293726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":198,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.277705+0000","last_change":"2024-09-12T12:22:51.856735+0000","last_active":"2024-09-12T12:24:46.277705+0000","last_peered":"2024-09-12T12:24:46.277705+0000","last_clean":"2024-09-12T12:24:46.277705+0000","last_became_active":"2024-09-12T12:22:51.856340+0000","last_became_peered":"2024-09-12T12:22:51.856340+0000","last_unstale":"2024-09-12T12:24:46.277705+0000","last_undegraded":"2024-09-12T12:24:46.277705+0000","last_fullsized":"2024-09-12T12:24:46.277705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:40.727645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":124,"num_write":36,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840889+0000","last_change":"2024-09-12T12:23:03.379726+0000","last_active":"2024-09-12T12:24:35.840889+0000","last_peered":"2024-09-12T12:24:35.840889+0000","last_clean":"2024-09-12T12:24:35.840889+0000","last_became_active":"2024-09-12T12:23:03.378168+0000","last_became_peered":"2024-09-12T12:23:03.378168+0000","last_unstale":"2024-09-12T12:24:35.840889+0000","last_undegraded":"2024-09-12T12:24:35.840889+0000","last_fullsized":"2024-09-12T12:24:35.840889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454543+0000","last_change":"2024-09-12T12:23:35.083119+0000","last_active":"2024-09-12T12:24:36.454543+0000","last_peered":"2024-09-12T12:24:36.454543+0000","last_clean":"2024-09-12T12:24:36.454543+0000","last_became_active":"2024-09-12T12:23:35.082800+0000","last_became_peered":"2024-09-12T12:23:35.082800+0000","last_unstale":"2024-09-12T12:24:36.454543+0000","last_undegraded":"2024-09-12T12:24:36.454543+0000","last_fullsized":"2024-09-12T12:24:36.454543+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.717540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840724+0000","last_change":"2024-09-12T12:22:51.989886+0000","last_active":"2024-09-12T12:24:35.840724+0000","last_peered":"2024-09-12T12:24:35.840724+0000","last_clean":"2024-09-12T12:24:35.840724+0000","last_became_active":"2024-09-12T12:22:51.989524+0000","last_became_peered":"2024-09-12T12:22:51.989524+0000","last_unstale":"2024-09-12T12:24:35.840724+0000","last_undegraded":"2024-09-12T12:24:35.840724+0000","last_fullsized":"2024-09-12T12:24:35.840724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:26.409342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267934+0000","last_change":"2024-09-12T12:23:03.384583+0000","last_active":"2024-09-12T12:24:36.267934+0000","last_peered":"2024-09-12T12:24:36.267934+0000","last_clean":"2024-09-12T12:24:36.267934+0000","last_became_active":"2024-09-12T12:23:03.383639+0000","last_became_peered":"2024-09-12T12:23:03.383639+0000","last_unstale":"2024-09-12T12:24:36.267934+0000","last_undegraded":"2024-09-12T12:24:36.267934+0000","last_fullsized":"2024-09-12T12:24:36.267934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:09.755052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847161+0000","last_change":"2024-09-12T12:22:54.309874+0000","last_active":"2024-09-12T12:24:35.847161+0000","last_peered":"2024-09-12T12:24:35.847161+0000","last_clean":"2024-09-12T12:24:35.847161+0000","last_became_active":"2024-09-12T12:22:54.309294+0000","last_became_peered":"2024-09-12T12:22:54.309294+0000","last_unstale":"2024-09-12T12:24:35.847161+0000","last_undegraded":"2024-09-12T12:24:35.847161+0000","last_fullsized":"2024-09-12T12:24:35.847161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:50.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847159+0000","last_change":"2024-09-12T12:22:51.849467+0000","last_active":"2024-09-12T12:24:35.847159+0000","last_peered":"2024-09-12T12:24:35.847159+0000","last_clean":"2024-09-12T12:24:35.847159+0000","last_became_active":"2024-09-12T12:22:51.849076+0000","last_became_peered":"2024-09-12T12:22:51.849076+0000","last_unstale":"2024-09-12T12:24:35.847159+0000","last_undegraded":"2024-09-12T12:24:35.847159+0000","last_fullsized":"2024-09-12T12:24:35.847159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:04.821105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843557+0000","last_change":"2024-09-12T12:23:35.083542+0000","last_active":"2024-09-12T12:24:35.843557+0000","last_peered":"2024-09-12T12:24:35.843557+0000","last_clean":"2024-09-12T12:24:35.843557+0000","last_became_active":"2024-09-12T12:23:35.083095+0000","last_became_peered":"2024-09-12T12:23:35.083095+0000","last_unstale":"2024-09-12T12:24:35.843557+0000","last_undegraded":"2024-09-12T12:24:35.843557+0000","last_fullsized":"2024-09-12T12:24:35.843557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:06.750223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454702+0000","last_change":"2024-09-12T12:22:54.315215+0000","last_active":"2024-09-12T12:24:36.454702+0000","last_peered":"2024-09-12T12:24:36.454702+0000","last_clean":"2024-09-12T12:24:36.454702+0000","last_became_active":"2024-09-12T12:22:54.314879+0000","last_became_peered":"2024-09-12T12:22:54.314879+0000","last_unstale":"2024-09-12T12:24:36.454702+0000","last_undegraded":"2024-09-12T12:24:36.454702+0000","last_fullsized":"2024-09-12T12:24:36.454702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:35.501376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.277916+0000","last_change":"2024-09-12T12:22:51.851461+0000","last_active":"2024-09-12T12:24:46.277916+0000","last_peered":"2024-09-12T12:24:46.277916+0000","last_clean":"2024-09-12T12:24:46.277916+0000","last_became_active":"2024-09-12T12:22:51.851105+0000","last_became_peered":"2024-09-12T12:22:51.851105+0000","last_unstale":"2024-09-12T12:24:46.277916+0000","last_undegraded":"2024-09-12T12:24:46.277916+0000","last_fullsized":"2024-09-12T12:24:46.277916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:42.604983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844971+0000","last_change":"2024-09-12T12:23:03.383308+0000","last_active":"2024-09-12T12:24:35.844971+0000","last_peered":"2024-09-12T12:24:35.844971+0000","last_clean":"2024-09-12T12:24:35.844971+0000","last_became_active":"2024-09-12T12:23:03.382294+0000","last_became_peered":"2024-09-12T12:23:03.382294+0000","last_unstale":"2024-09-12T12:24:35.844971+0000","last_undegraded":"2024-09-12T12:24:35.844971+0000","last_fullsized":"2024-09-12T12:24:35.844971+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:43.920306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846720+0000","last_change":"2024-09-12T12:23:03.386850+0000","last_active":"2024-09-12T12:24:35.846720+0000","last_peered":"2024-09-12T12:24:35.846720+0000","last_clean":"2024-09-12T12:24:35.846720+0000","last_became_active":"2024-09-12T12:23:03.386350+0000","last_became_peered":"2024-09-12T12:23:03.386350+0000","last_unstale":"2024-09-12T12:24:35.846720+0000","last_undegraded":"2024-09-12T12:24:35.846720+0000","last_fullsized":"2024-09-12T12:24:35.846720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.295745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840840+0000","last_change":"2024-09-12T12:22:54.320709+0000","last_active":"2024-09-12T12:24:35.840840+0000","last_peered":"2024-09-12T12:24:35.840840+0000","last_clean":"2024-09-12T12:24:35.840840+0000","last_became_active":"2024-09-12T12:22:54.320208+0000","last_became_peered":"2024-09-12T12:22:54.320208+0000","last_unstale":"2024-09-12T12:24:35.840840+0000","last_undegraded":"2024-09-12T12:24:35.840840+0000","last_fullsized":"2024-09-12T12:24:35.840840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:45.452449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840207+0000","last_change":"2024-09-12T12:22:51.853047+0000","last_active":"2024-09-12T12:24:35.840207+0000","last_peered":"2024-09-12T12:24:35.840207+0000","last_clean":"2024-09-12T12:24:35.840207+0000","last_became_active":"2024-09-12T12:22:51.852653+0000","last_became_peered":"2024-09-12T12:22:51.852653+0000","last_unstale":"2024-09-12T12:24:35.840207+0000","last_undegraded":"2024-09-12T12:24:35.840207+0000","last_fullsized":"2024-09-12T12:24:35.840207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:39.035009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843135+0000","last_change":"2024-09-12T12:23:03.382997+0000","last_active":"2024-09-12T12:24:35.843135+0000","last_peered":"2024-09-12T12:24:35.843135+0000","last_clean":"2024-09-12T12:24:35.843135+0000","last_became_active":"2024-09-12T12:23:03.382594+0000","last_became_peered":"2024-09-12T12:23:03.382594+0000","last_unstale":"2024-09-12T12:24:35.843135+0000","last_undegraded":"2024-09-12T12:24:35.843135+0000","last_fullsized":"2024-09-12T12:24:35.843135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:25.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845227+0000","last_change":"2024-09-12T12:22:54.322595+0000","last_active":"2024-09-12T12:24:35.845227+0000","last_peered":"2024-09-12T12:24:35.845227+0000","last_clean":"2024-09-12T12:24:35.845227+0000","last_became_active":"2024-09-12T12:22:54.320182+0000","last_became_peered":"2024-09-12T12:22:54.320182+0000","last_unstale":"2024-09-12T12:24:35.845227+0000","last_undegraded":"2024-09-12T12:24:35.845227+0000","last_fullsized":"2024-09-12T12:24:35.845227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265122+0000","last_change":"2024-09-12T12:22:51.850045+0000","last_active":"2024-09-12T12:24:36.265122+0000","last_peered":"2024-09-12T12:24:36.265122+0000","last_clean":"2024-09-12T12:24:36.265122+0000","last_became_active":"2024-09-12T12:22:51.849643+0000","last_became_peered":"2024-09-12T12:22:51.849643+0000","last_unstale":"2024-09-12T12:24:36.265122+0000","last_undegraded":"2024-09-12T12:24:36.265122+0000","last_fullsized":"2024-09-12T12:24:36.265122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:18.255368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840449+0000","last_change":"2024-09-12T12:22:51.852692+0000","last_active":"2024-09-12T12:24:35.840449+0000","last_peered":"2024-09-12T12:24:35.840449+0000","last_clean":"2024-09-12T12:24:35.840449+0000","last_became_active":"2024-09-12T12:22:51.852265+0000","last_became_peered":"2024-09-12T12:22:51.852265+0000","last_unstale":"2024-09-12T12:24:35.840449+0000","last_undegraded":"2024-09-12T12:24:35.840449+0000","last_fullsized":"2024-09-12T12:24:35.840449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:55.853073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840570+0000","last_change":"2024-09-12T12:22:54.315519+0000","last_active":"2024-09-12T12:24:35.840570+0000","last_peered":"2024-09-12T12:24:35.840570+0000","last_clean":"2024-09-12T12:24:35.840570+0000","last_became_active":"2024-09-12T12:22:54.315158+0000","last_became_peered":"2024-09-12T12:22:54.315158+0000","last_unstale":"2024-09-12T12:24:35.840570+0000","last_undegraded":"2024-09-12T12:24:35.840570+0000","last_fullsized":"2024-09-12T12:24:35.840570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845804+0000","last_change":"2024-09-12T12:23:03.383443+0000","last_active":"2024-09-12T12:24:35.845804+0000","last_peered":"2024-09-12T12:24:35.845804+0000","last_clean":"2024-09-12T12:24:35.845804+0000","last_became_active":"2024-09-12T12:23:03.382865+0000","last_became_peered":"2024-09-12T12:23:03.382865+0000","last_unstale":"2024-09-12T12:24:35.845804+0000","last_undegraded":"2024-09-12T12:24:35.845804+0000","last_fullsized":"2024-09-12T12:24:35.845804+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:26.339910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:46.278573+0000","last_change":"2024-09-12T12:22:51.849963+0000","last_active":"2024-09-12T12:24:46.278573+0000","last_peered":"2024-09-12T12:24:46.278573+0000","last_clean":"2024-09-12T12:24:46.278573+0000","last_became_active":"2024-09-12T12:22:51.849596+0000","last_became_peered":"2024-09-12T12:22:51.849596+0000","last_unstale":"2024-09-12T12:24:46.278573+0000","last_undegraded":"2024-09-12T12:24:46.278573+0000","last_fullsized":"2024-09-12T12:24:46.278573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:48.695657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843995+0000","last_change":"2024-09-12T12:22:54.312543+0000","last_active":"2024-09-12T12:24:35.843995+0000","last_peered":"2024-09-12T12:24:35.843995+0000","last_clean":"2024-09-12T12:24:35.843995+0000","last_became_active":"2024-09-12T12:22:54.312154+0000","last_became_peered":"2024-09-12T12:22:54.312154+0000","last_unstale":"2024-09-12T12:24:35.843995+0000","last_undegraded":"2024-09-12T12:24:35.843995+0000","last_fullsized":"2024-09-12T12:24:35.843995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:28.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846393+0000","last_change":"2024-09-12T12:23:03.376938+0000","last_active":"2024-09-12T12:24:35.846393+0000","last_peered":"2024-09-12T12:24:35.846393+0000","last_clean":"2024-09-12T12:24:35.846393+0000","last_became_active":"2024-09-12T12:23:03.376450+0000","last_became_peered":"2024-09-12T12:23:03.376450+0000","last_unstale":"2024-09-12T12:24:35.846393+0000","last_undegraded":"2024-09-12T12:24:35.846393+0000","last_fullsized":"2024-09-12T12:24:35.846393+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:35.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842691+0000","last_change":"2024-09-12T12:22:54.305562+0000","last_active":"2024-09-12T12:24:35.842691+0000","last_peered":"2024-09-12T12:24:35.842691+0000","last_clean":"2024-09-12T12:24:35.842691+0000","last_became_active":"2024-09-12T12:22:54.305208+0000","last_became_peered":"2024-09-12T12:22:54.305208+0000","last_unstale":"2024-09-12T12:24:35.842691+0000","last_undegraded":"2024-09-12T12:24:35.842691+0000","last_fullsized":"2024-09-12T12:24:35.842691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:46.643949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845808+0000","last_change":"2024-09-12T12:22:54.310634+0000","last_active":"2024-09-12T12:24:35.845808+0000","last_peered":"2024-09-12T12:24:35.845808+0000","last_clean":"2024-09-12T12:24:35.845808+0000","last_became_active":"2024-09-12T12:22:54.310194+0000","last_became_peered":"2024-09-12T12:22:54.310194+0000","last_unstale":"2024-09-12T12:24:35.845808+0000","last_undegraded":"2024-09-12T12:24:35.845808+0000","last_fullsized":"2024-09-12T12:24:35.845808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:05.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845503+0000","last_change":"2024-09-12T12:22:54.315119+0000","last_active":"2024-09-12T12:24:35.845503+0000","last_peered":"2024-09-12T12:24:35.845503+0000","last_clean":"2024-09-12T12:24:35.845503+0000","last_became_active":"2024-09-12T12:22:54.314729+0000","last_became_peered":"2024-09-12T12:22:54.314729+0000","last_unstale":"2024-09-12T12:24:35.845503+0000","last_undegraded":"2024-09-12T12:24:35.845503+0000","last_fullsized":"2024-09-12T12:24:35.845503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:07.888005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846522+0000","last_change":"2024-09-12T12:23:35.083672+0000","last_active":"2024-09-12T12:24:35.846522+0000","last_peered":"2024-09-12T12:24:35.846522+0000","last_clean":"2024-09-12T12:24:35.846522+0000","last_became_active":"2024-09-12T12:23:35.083222+0000","last_became_peered":"2024-09-12T12:23:35.083222+0000","last_unstale":"2024-09-12T12:24:35.846522+0000","last_undegraded":"2024-09-12T12:24:35.846522+0000","last_fullsized":"2024-09-12T12:24:35.846522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265239+0000","last_change":"2024-09-12T12:22:54.321649+0000","last_active":"2024-09-12T12:24:36.265239+0000","last_peered":"2024-09-12T12:24:36.265239+0000","last_clean":"2024-09-12T12:24:36.265239+0000","last_became_active":"2024-09-12T12:22:54.320859+0000","last_became_peered":"2024-09-12T12:22:54.320859+0000","last_unstale":"2024-09-12T12:24:36.265239+0000","last_undegraded":"2024-09-12T12:24:36.265239+0000","last_fullsized":"2024-09-12T12:24:36.265239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:49.706632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843751+0000","last_change":"2024-09-12T12:22:54.306900+0000","last_active":"2024-09-12T12:24:35.843751+0000","last_peered":"2024-09-12T12:24:35.843751+0000","last_clean":"2024-09-12T12:24:35.843751+0000","last_became_active":"2024-09-12T12:22:54.306432+0000","last_became_peered":"2024-09-12T12:22:54.306432+0000","last_unstale":"2024-09-12T12:24:35.843751+0000","last_undegraded":"2024-09-12T12:24:35.843751+0000","last_fullsized":"2024-09-12T12:24:35.843751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:07.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846477+0000","last_change":"2024-09-12T12:22:54.318123+0000","last_active":"2024-09-12T12:24:35.846477+0000","last_peered":"2024-09-12T12:24:35.846477+0000","last_clean":"2024-09-12T12:24:35.846477+0000","last_became_active":"2024-09-12T12:22:54.317820+0000","last_became_peered":"2024-09-12T12:22:54.317820+0000","last_unstale":"2024-09-12T12:24:35.846477+0000","last_undegraded":"2024-09-12T12:24:35.846477+0000","last_fullsized":"2024-09-12T12:24:35.846477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:19.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845656+0000","last_change":"2024-09-12T12:22:54.318029+0000","last_active":"2024-09-12T12:24:35.845656+0000","last_peered":"2024-09-12T12:24:35.845656+0000","last_clean":"2024-09-12T12:24:35.845656+0000","last_became_active":"2024-09-12T12:22:54.316015+0000","last_became_peered":"2024-09-12T12:22:54.316015+0000","last_unstale":"2024-09-12T12:24:35.845656+0000","last_undegraded":"2024-09-12T12:24:35.845656+0000","last_fullsized":"2024-09-12T12:24:35.845656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840073+0000","last_change":"2024-09-12T12:22:54.325688+0000","last_active":"2024-09-12T12:24:35.840073+0000","last_peered":"2024-09-12T12:24:35.840073+0000","last_clean":"2024-09-12T12:24:35.840073+0000","last_became_active":"2024-09-12T12:22:54.325375+0000","last_became_peered":"2024-09-12T12:22:54.325375+0000","last_unstale":"2024-09-12T12:24:35.840073+0000","last_undegraded":"2024-09-12T12:24:35.840073+0000","last_fullsized":"2024-09-12T12:24:35.840073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:43.971575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845126+0000","last_change":"2024-09-12T12:22:54.315713+0000","last_active":"2024-09-12T12:24:35.845126+0000","last_peered":"2024-09-12T12:24:35.845126+0000","last_clean":"2024-09-12T12:24:35.845126+0000","last_became_active":"2024-09-12T12:22:54.315401+0000","last_became_peered":"2024-09-12T12:22:54.315401+0000","last_unstale":"2024-09-12T12:24:35.845126+0000","last_undegraded":"2024-09-12T12:24:35.845126+0000","last_fullsized":"2024-09-12T12:24:35.845126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:35:31.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454507+0000","last_change":"2024-09-12T12:22:54.314543+0000","last_active":"2024-09-12T12:24:36.454507+0000","last_peered":"2024-09-12T12:24:36.454507+0000","last_clean":"2024-09-12T12:24:36.454507+0000","last_became_active":"2024-09-12T12:22:54.314216+0000","last_became_peered":"2024-09-12T12:22:54.314216+0000","last_unstale":"2024-09-12T12:24:36.454507+0000","last_undegraded":"2024-09-12T12:24:36.454507+0000","last_fullsized":"2024-09-12T12:24:36.454507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:12.180355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265109+0000","last_change":"2024-09-12T12:22:54.313637+0000","last_active":"2024-09-12T12:24:36.265109+0000","last_peered":"2024-09-12T12:24:36.265109+0000","last_clean":"2024-09-12T12:24:36.265109+0000","last_became_active":"2024-09-12T12:22:54.313327+0000","last_became_peered":"2024-09-12T12:22:54.313327+0000","last_unstale":"2024-09-12T12:24:36.265109+0000","last_undegraded":"2024-09-12T12:24:36.265109+0000","last_fullsized":"2024-09-12T12:24:36.265109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:24.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842972+0000","last_change":"2024-09-12T12:22:54.306018+0000","last_active":"2024-09-12T12:24:35.842972+0000","last_peered":"2024-09-12T12:24:35.842972+0000","last_clean":"2024-09-12T12:24:35.842972+0000","last_became_active":"2024-09-12T12:22:54.305683+0000","last_became_peered":"2024-09-12T12:22:54.305683+0000","last_unstale":"2024-09-12T12:24:35.842972+0000","last_undegraded":"2024-09-12T12:24:35.842972+0000","last_fullsized":"2024-09-12T12:24:35.842972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:00.464765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846578+0000","last_change":"2024-09-12T12:22:54.319169+0000","last_active":"2024-09-12T12:24:35.846578+0000","last_peered":"2024-09-12T12:24:35.846578+0000","last_clean":"2024-09-12T12:24:35.846578+0000","last_became_active":"2024-09-12T12:22:54.318831+0000","last_became_peered":"2024-09-12T12:22:54.318831+0000","last_unstale":"2024-09-12T12:24:35.846578+0000","last_undegraded":"2024-09-12T12:24:35.846578+0000","last_fullsized":"2024-09-12T12:24:35.846578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:42.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841502+0000","last_change":"2024-09-12T12:22:54.305760+0000","last_active":"2024-09-12T12:24:35.841502+0000","last_peered":"2024-09-12T12:24:35.841502+0000","last_clean":"2024-09-12T12:24:35.841502+0000","last_became_active":"2024-09-12T12:22:54.305455+0000","last_became_peered":"2024-09-12T12:22:54.305455+0000","last_unstale":"2024-09-12T12:24:35.841502+0000","last_undegraded":"2024-09-12T12:24:35.841502+0000","last_fullsized":"2024-09-12T12:24:35.841502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:54.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843619+0000","last_change":"2024-09-12T12:22:54.311420+0000","last_active":"2024-09-12T12:24:35.843619+0000","last_peered":"2024-09-12T12:24:35.843619+0000","last_clean":"2024-09-12T12:24:35.843619+0000","last_became_active":"2024-09-12T12:22:54.311072+0000","last_became_peered":"2024-09-12T12:22:54.311072+0000","last_unstale":"2024-09-12T12:24:35.843619+0000","last_undegraded":"2024-09-12T12:24:35.843619+0000","last_fullsized":"2024-09-12T12:24:35.843619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:54.476587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454348+0000","last_change":"2024-09-12T12:22:54.313093+0000","last_active":"2024-09-12T12:24:36.454348+0000","last_peered":"2024-09-12T12:24:36.454348+0000","last_clean":"2024-09-12T12:24:36.454348+0000","last_became_active":"2024-09-12T12:22:54.312220+0000","last_became_peered":"2024-09-12T12:22:54.312220+0000","last_unstale":"2024-09-12T12:24:36.454348+0000","last_undegraded":"2024-09-12T12:24:36.454348+0000","last_fullsized":"2024-09-12T12:24:36.454348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:33.241798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846293+0000","last_change":"2024-09-12T12:22:54.310536+0000","last_active":"2024-09-12T12:24:35.846293+0000","last_peered":"2024-09-12T12:24:35.846293+0000","last_clean":"2024-09-12T12:24:35.846293+0000","last_became_active":"2024-09-12T12:22:54.310203+0000","last_became_peered":"2024-09-12T12:22:54.310203+0000","last_unstale":"2024-09-12T12:24:35.846293+0000","last_undegraded":"2024-09-12T12:24:35.846293+0000","last_fullsized":"2024-09-12T12:24:35.846293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:40.957367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846379+0000","last_change":"2024-09-12T12:22:54.312898+0000","last_active":"2024-09-12T12:24:35.846379+0000","last_peered":"2024-09-12T12:24:35.846379+0000","last_clean":"2024-09-12T12:24:35.846379+0000","last_became_active":"2024-09-12T12:22:54.312449+0000","last_became_peered":"2024-09-12T12:22:54.312449+0000","last_unstale":"2024-09-12T12:24:35.846379+0000","last_undegraded":"2024-09-12T12:24:35.846379+0000","last_fullsized":"2024-09-12T12:24:35.846379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:57.384949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265050+0000","last_change":"2024-09-12T12:22:54.312206+0000","last_active":"2024-09-12T12:24:36.265050+0000","last_peered":"2024-09-12T12:24:36.265050+0000","last_clean":"2024-09-12T12:24:36.265050+0000","last_became_active":"2024-09-12T12:22:54.311187+0000","last_became_peered":"2024-09-12T12:22:54.311187+0000","last_unstale":"2024-09-12T12:24:36.265050+0000","last_undegraded":"2024-09-12T12:24:36.265050+0000","last_fullsized":"2024-09-12T12:24:36.265050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:22.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268021+0000","last_change":"2024-09-12T12:22:54.312083+0000","last_active":"2024-09-12T12:24:36.268021+0000","last_peered":"2024-09-12T12:24:36.268021+0000","last_clean":"2024-09-12T12:24:36.268021+0000","last_became_active":"2024-09-12T12:22:54.310716+0000","last_became_peered":"2024-09-12T12:22:54.310716+0000","last_unstale":"2024-09-12T12:24:36.268021+0000","last_undegraded":"2024-09-12T12:24:36.268021+0000","last_fullsized":"2024-09-12T12:24:36.268021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:22.717416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847115+0000","last_change":"2024-09-12T12:22:54.315088+0000","last_active":"2024-09-12T12:24:35.847115+0000","last_peered":"2024-09-12T12:24:35.847115+0000","last_clean":"2024-09-12T12:24:35.847115+0000","last_became_active":"2024-09-12T12:22:54.314601+0000","last_became_peered":"2024-09-12T12:22:54.314601+0000","last_unstale":"2024-09-12T12:24:35.847115+0000","last_undegraded":"2024-09-12T12:24:35.847115+0000","last_fullsized":"2024-09-12T12:24:35.847115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:35.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840900+0000","last_change":"2024-09-12T12:22:54.305332+0000","last_active":"2024-09-12T12:24:35.840900+0000","last_peered":"2024-09-12T12:24:35.840900+0000","last_clean":"2024-09-12T12:24:35.840900+0000","last_became_active":"2024-09-12T12:22:54.305017+0000","last_became_peered":"2024-09-12T12:22:54.305017+0000","last_unstale":"2024-09-12T12:24:35.840900+0000","last_undegraded":"2024-09-12T12:24:35.840900+0000","last_fullsized":"2024-09-12T12:24:35.840900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:16.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454808+0000","last_change":"2024-09-12T12:22:54.319768+0000","last_active":"2024-09-12T12:24:36.454808+0000","last_peered":"2024-09-12T12:24:36.454808+0000","last_clean":"2024-09-12T12:24:36.454808+0000","last_became_active":"2024-09-12T12:22:54.319451+0000","last_became_peered":"2024-09-12T12:22:54.319451+0000","last_unstale":"2024-09-12T12:24:36.454808+0000","last_undegraded":"2024-09-12T12:24:36.454808+0000","last_fullsized":"2024-09-12T12:24:36.454808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:56.368891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845095+0000","last_change":"2024-09-12T12:22:54.323162+0000","last_active":"2024-09-12T12:24:35.845095+0000","last_peered":"2024-09-12T12:24:35.845095+0000","last_clean":"2024-09-12T12:24:35.845095+0000","last_became_active":"2024-09-12T12:22:54.322068+0000","last_became_peered":"2024-09-12T12:22:54.322068+0000","last_unstale":"2024-09-12T12:24:35.845095+0000","last_undegraded":"2024-09-12T12:24:35.845095+0000","last_fullsized":"2024-09-12T12:24:35.845095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:54.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846581+0000","last_change":"2024-09-12T12:22:54.306125+0000","last_active":"2024-09-12T12:24:35.846581+0000","last_peered":"2024-09-12T12:24:35.846581+0000","last_clean":"2024-09-12T12:24:35.846581+0000","last_became_active":"2024-09-12T12:22:54.305790+0000","last_became_peered":"2024-09-12T12:22:54.305790+0000","last_unstale":"2024-09-12T12:24:35.846581+0000","last_undegraded":"2024-09-12T12:24:35.846581+0000","last_fullsized":"2024-09-12T12:24:35.846581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:36.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840388+0000","last_change":"2024-09-12T12:22:54.305099+0000","last_active":"2024-09-12T12:24:35.840388+0000","last_peered":"2024-09-12T12:24:35.840388+0000","last_clean":"2024-09-12T12:24:35.840388+0000","last_became_active":"2024-09-12T12:22:54.304649+0000","last_became_peered":"2024-09-12T12:22:54.304649+0000","last_unstale":"2024-09-12T12:24:35.840388+0000","last_undegraded":"2024-09-12T12:24:35.840388+0000","last_fullsized":"2024-09-12T12:24:35.840388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:05.771434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843912+0000","last_change":"2024-09-12T12:22:54.319247+0000","last_active":"2024-09-12T12:24:35.843912+0000","last_peered":"2024-09-12T12:24:35.843912+0000","last_clean":"2024-09-12T12:24:35.843912+0000","last_became_active":"2024-09-12T12:22:54.318894+0000","last_became_peered":"2024-09-12T12:22:54.318894+0000","last_unstale":"2024-09-12T12:24:35.843912+0000","last_undegraded":"2024-09-12T12:24:35.843912+0000","last_fullsized":"2024-09-12T12:24:35.843912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:55.692071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840909+0000","last_change":"2024-09-12T12:23:35.076997+0000","last_active":"2024-09-12T12:24:35.840909+0000","last_peered":"2024-09-12T12:24:35.840909+0000","last_clean":"2024-09-12T12:24:35.840909+0000","last_became_active":"2024-09-12T12:23:35.076506+0000","last_became_peered":"2024-09-12T12:23:35.076506+0000","last_unstale":"2024-09-12T12:24:35.840909+0000","last_undegraded":"2024-09-12T12:24:35.840909+0000","last_fullsized":"2024-09-12T12:24:35.840909+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846705+0000","last_change":"2024-09-12T12:22:54.314298+0000","last_active":"2024-09-12T12:24:35.846705+0000","last_peered":"2024-09-12T12:24:35.846705+0000","last_clean":"2024-09-12T12:24:35.846705+0000","last_became_active":"2024-09-12T12:22:54.311726+0000","last_became_peered":"2024-09-12T12:22:54.311726+0000","last_unstale":"2024-09-12T12:24:35.846705+0000","last_undegraded":"2024-09-12T12:24:35.846705+0000","last_fullsized":"2024-09-12T12:24:35.846705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:13.298082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846823+0000","last_change":"2024-09-12T12:22:54.304397+0000","last_active":"2024-09-12T12:24:35.846823+0000","last_peered":"2024-09-12T12:24:35.846823+0000","last_clean":"2024-09-12T12:24:35.846823+0000","last_became_active":"2024-09-12T12:22:54.304048+0000","last_became_peered":"2024-09-12T12:22:54.304048+0000","last_unstale":"2024-09-12T12:24:35.846823+0000","last_undegraded":"2024-09-12T12:24:35.846823+0000","last_fullsized":"2024-09-12T12:24:35.846823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:13.518433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843515+0000","last_change":"2024-09-12T12:22:54.312229+0000","last_active":"2024-09-12T12:24:35.843515+0000","last_peered":"2024-09-12T12:24:35.843515+0000","last_clean":"2024-09-12T12:24:35.843515+0000","last_became_active":"2024-09-12T12:22:54.311806+0000","last_became_peered":"2024-09-12T12:22:54.311806+0000","last_unstale":"2024-09-12T12:24:35.843515+0000","last_undegraded":"2024-09-12T12:24:35.843515+0000","last_fullsized":"2024-09-12T12:24:35.843515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:28.865595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70326,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":629,"num_read_kb":390,"num_write":244,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514533,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":533117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28764,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716388,"statfs":{"total":95995035648,"available":95965581312,"internally_reserved":0,"allocated":1777664,"data_stored":1187035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1101824,"data_stored":532542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135926,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1089536,"data_stored":532808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397562,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37008,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708144,"statfs":{"total":95995035648,"available":95957139456,"internally_reserved":0,"allocated":1695744,"data_stored":1129026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561088,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712908,"statfs":{"total":95995035648,"available":95962017792,"internally_reserved":0,"allocated":1077248,"data_stored":528046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37012,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708140,"statfs":{"total":95995035648,"available":95957135360,"internally_reserved":0,"allocated":1703936,"data_stored":1124608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1085440,"data_stored":532120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1089536,"data_stored":527754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36488,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708664,"statfs":{"total":95995035648,"available":95957671936,"internally_reserved":0,"allocated":1167360,"data_stored":593200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1146880,"data_stored":592587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1101824,"data_stored":529895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:52.674 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T12:24:52.674 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T12:24:52.674 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T12:24:52.674 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T12:24:53.052 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:53.191 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:52 smithi038 ceph-mon[30810]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:53.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:52 smithi071 ceph-mon[34859]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:53.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:52 smithi154 ceph-mon[35578]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:53.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.603+0000 7feadc800640 1 -- 172.21.15.38:0/1428156822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead41049a0 msgr2=0x7fead41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.603+0000 7feadc800640 1 --2- 172.21.15.38:0/1428156822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead41049a0 0x7fead41089f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feac4009900 tx=0x7feac402a400 comp rx=0 tx=0).stop 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.603+0000 7feadc800640 1 -- 172.21.15.38:0/1428156822 shutdown_connections 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.603+0000 7feadc800640 1 --2- 172.21.15.38:0/1428156822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fead4109120 0x7fead4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.603+0000 7feadc800640 1 --2- 172.21.15.38:0/1428156822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead41049a0 0x7fead41089f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.603+0000 7feadc800640 1 --2- 172.21.15.38:0/1428156822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead4103ff0 0x7fead41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.603+0000 7feadc800640 1 -- 172.21.15.38:0/1428156822 >> 172.21.15.38:0/1428156822 conn(0x7fead40ffa90 msgr2=0x7fead4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.604+0000 7feadc800640 1 -- 172.21.15.38:0/1428156822 shutdown_connections 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.604+0000 7feadc800640 1 -- 172.21.15.38:0/1428156822 wait complete. 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.604+0000 7feadc800640 1 Processor -- start 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feadc800640 1 -- start start 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feadc800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead4103ff0 0x7fead419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feadc800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fead41049a0 0x7fead419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feadc800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead4109120 0x7fead419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feadc800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fead4114170 con 0x7fead4109120 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feadc800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fead4113ff0 con 0x7fead4103ff0 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feadc800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fead41142f0 con 0x7fead41049a0 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feada800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead4109120 0x7fead419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feada800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead4109120 0x7fead419ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38866/0 (socket says 172.21.15.38:38866) 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7feada800640 1 -- 172.21.15.38:0/2884301315 learned_addr learned my addr 172.21.15.38:0/2884301315 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7fead9e00640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead4103ff0 0x7fead419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.605+0000 7fead9400640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fead41049a0 0x7fead419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feada800640 1 -- 172.21.15.38:0/2884301315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fead41049a0 msgr2=0x7fead419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feada800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fead41049a0 0x7fead419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feada800640 1 -- 172.21.15.38:0/2884301315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead4103ff0 msgr2=0x7fead419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feada800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead4103ff0 0x7fead419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feada800640 1 -- 172.21.15.38:0/2884301315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead419f600 con 0x7fead4109120 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feada800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead4109120 0x7fead419ef20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fead0009fd0 tx=0x7fead000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feacea00640 1 -- 172.21.15.38:0/2884301315 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0017070 con 0x7fead4109120 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feacea00640 1 -- 172.21.15.38:0/2884301315 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead0003e50 con 0x7fead4109120 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead419f8f0 con 0x7fead4109120 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feacea00640 1 -- 172.21.15.38:0/2884301315 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead00106c0 con 0x7fead4109120 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.606+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead41a71d0 con 0x7fead4109120 2024-09-12T12:24:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.608+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead41043d0 con 0x7fead4109120 2024-09-12T12:24:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.610+0000 7feacea00640 1 -- 172.21.15.38:0/2884301315 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fead0003970 con 0x7fead4109120 2024-09-12T12:24:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.611+0000 7feacea00640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feabc0a2c90 0x7feabc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.611+0000 7feacea00640 1 -- 172.21.15.38:0/2884301315 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fead00cf1d0 con 0x7fead4109120 2024-09-12T12:24:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.611+0000 7fead9e00640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feabc0a2c90 0x7feabc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.612+0000 7fead9e00640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feabc0a2c90 0x7feabc0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feac800bbe0 tx=0x7feac800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.615+0000 7feacea00640 1 -- 172.21.15.38:0/2884301315 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fead009b570 con 0x7fead4109120 2024-09-12T12:24:53.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.839+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fead410c3c0 con 0x7fead4109120 2024-09-12T12:24:53.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.839+0000 7feacea00640 1 -- 172.21.15.38:0/2884301315 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fead009f870 con 0x7fead4109120 2024-09-12T12:24:53.840 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:53.840 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T12:24:53.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.841+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feabc0a2c90 msgr2=0x7feabc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.841+0000 7feadc800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feabc0a2c90 0x7feabc0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feac800bbe0 tx=0x7feac800b390 comp rx=0 tx=0).stop 2024-09-12T12:24:53.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.841+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead4109120 msgr2=0x7fead419ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.841+0000 7feadc800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead4109120 0x7fead419ef20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fead0009fd0 tx=0x7fead000b260 comp rx=0 tx=0).stop 2024-09-12T12:24:53.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.841+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 shutdown_connections 2024-09-12T12:24:53.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.841+0000 7feadc800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feabc0a2c90 0x7feabc0a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.842+0000 7feadc800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead4109120 0x7fead419ef20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.842+0000 7feadc800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fead41049a0 0x7fead419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.842+0000 7feadc800640 1 --2- 172.21.15.38:0/2884301315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead4103ff0 0x7fead419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.842+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 >> 172.21.15.38:0/2884301315 conn(0x7fead40ffa90 msgr2=0x7fead4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.842+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 shutdown_connections 2024-09-12T12:24:53.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:53.842+0000 7feadc800640 1 -- 172.21.15.38:0/2884301315 wait complete. 2024-09-12T12:24:54.212 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:53 smithi038 ceph-mon[30810]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:24:54.212 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:53 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2884301315' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:24:54.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:53 smithi071 ceph-mon[34859]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:24:54.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:53 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2884301315' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:24:54.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:53 smithi154 ceph-mon[35578]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:24:54.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:53 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2884301315' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:24:54.603 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T12:24:54.604 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:24:54.983 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 -- 172.21.15.38:0/2810151516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 msgr2=0x7f243c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 --2- 172.21.15.38:0/2810151516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c076b00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f242c009860 tx=0x7f242c02a340 comp rx=0 tx=0).stop 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 -- 172.21.15.38:0/2810151516 shutdown_connections 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 --2- 172.21.15.38:0/2810151516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c112a50 0x7f243c114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 --2- 172.21.15.38:0/2810151516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c077040 0x7f243c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 --2- 172.21.15.38:0/2810151516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c076b00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 -- 172.21.15.38:0/2810151516 >> 172.21.15.38:0/2810151516 conn(0x7f243c0ffa50 msgr2=0x7f243c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 -- 172.21.15.38:0/2810151516 shutdown_connections 2024-09-12T12:24:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.668+0000 7f2442800640 1 -- 172.21.15.38:0/2810151516 wait complete. 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.669+0000 7f2442800640 1 Processor -- start 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.669+0000 7f2442800640 1 -- start start 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f2442800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f2442800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c077040 0x7f243c1a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f2442800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c112a50 0x7f243c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f2442800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f243c1185c0 con 0x7f243c077040 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f2442800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f243c118440 con 0x7f243c076720 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f2442800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f243c118740 con 0x7f243c112a50 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c1a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:43146/0 (socket says 172.21.15.38:43146) 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 -- 172.21.15.38:0/2427535140 learned_addr learned my addr 172.21.15.38:0/2427535140 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243aa00640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c077040 0x7f243c1a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243be00640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c112a50 0x7f243c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 -- 172.21.15.38:0/2427535140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c112a50 msgr2=0x7f243c19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c112a50 0x7f243c19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 -- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c077040 msgr2=0x7f243c1a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c077040 0x7f243c1a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.670+0000 7f243b400640 1 -- 172.21.15.38:0/2427535140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c19f020 con 0x7f243c076720 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.671+0000 7f243b400640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c1a4730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f242c035040 tx=0x7f242c033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.671+0000 7f2433e00640 1 -- 172.21.15.38:0/2427535140 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c037040 con 0x7f243c076720 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.671+0000 7f2433e00640 1 -- 172.21.15.38:0/2427535140 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f242c040070 con 0x7f243c076720 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.671+0000 7f2433e00640 1 -- 172.21.15.38:0/2427535140 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c003a50 con 0x7f243c076720 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.671+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243c19f2b0 con 0x7f243c076720 2024-09-12T12:24:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.671+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243c1ab600 con 0x7f243c076720 2024-09-12T12:24:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.672+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243c077e60 con 0x7f243c076720 2024-09-12T12:24:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.674+0000 7f2433e00640 1 -- 172.21.15.38:0/2427535140 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f242c003bf0 con 0x7f243c076720 2024-09-12T12:24:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.675+0000 7f2433e00640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f24200a2c90 0x7f24200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.675+0000 7f2433e00640 1 -- 172.21.15.38:0/2427535140 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f242c0ef7f0 con 0x7f243c076720 2024-09-12T12:24:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.676+0000 7f243aa00640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f24200a2c90 0x7f24200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.676+0000 7f243aa00640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f24200a2c90 0x7f24200a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f243c079290 tx=0x7f242800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.677+0000 7f2433e00640 1 -- 172.21.15.38:0/2427535140 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f242c0bc2f0 con 0x7f243c076720 2024-09-12T12:24:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.922+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f243c076b00 con 0x7f243c076720 2024-09-12T12:24:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.923+0000 7f2433e00640 1 -- 172.21.15.38:0/2427535140 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11968 (secure 0 0 0) 0x7f242c0bbbf0 con 0x7f243c076720 2024-09-12T12:24:55.924 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:55.924 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"btime":"2024-09-12T12:23:49:190760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:48.221685+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24502,24515,24508,24529,24557]},"id":1}]} 2024-09-12T12:24:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f24200a2c90 msgr2=0x7f24200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f24200a2c90 0x7f24200a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f243c079290 tx=0x7f242800b390 comp rx=0 tx=0).stop 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 msgr2=0x7f243c1a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c1a4730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f242c035040 tx=0x7f242c033d90 comp rx=0 tx=0).stop 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 shutdown_connections 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f24200a2c90 0x7f24200a5150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c112a50 0x7f243c19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c077040 0x7f243c1a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 --2- 172.21.15.38:0/2427535140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f243c076720 0x7f243c1a4730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 >> 172.21.15.38:0/2427535140 conn(0x7f243c0ffa50 msgr2=0x7f243c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 shutdown_connections 2024-09-12T12:24:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:55.927+0000 7f2442800640 1 -- 172.21.15.38:0/2427535140 wait complete. 2024-09-12T12:24:56.069 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:55 smithi154 ceph-mon[35578]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:56.069 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:55 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:56.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:55 smithi038 ceph-mon[30810]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:56.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:55 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:55 smithi071 ceph-mon[34859]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:24:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:55 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:57.009 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:24:57.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:56 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2427535140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:57.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:56 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:56 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:56 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:56 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:56 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2427535140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:56 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:56 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:56 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:56 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:56 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2427535140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:57.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:56 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:56 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:56 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:56 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:24:57.418 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 -- 172.21.15.38:0/1065640489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 msgr2=0x7fdacc1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1065640489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc1043f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009860 tx=0x7fdabc02a340 comp rx=0 tx=0).stop 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 -- 172.21.15.38:0/1065640489 shutdown_connections 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1065640489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc109140 0x7fdacc110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1065640489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdacc1049c0 0x7fdacc108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1065640489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc1043f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 -- 172.21.15.38:0/1065640489 >> 172.21.15.38:0/1065640489 conn(0x7fdacc0ffa50 msgr2=0x7fdacc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 -- 172.21.15.38:0/1065640489 shutdown_connections 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.007+0000 7fdad1e00640 1 -- 172.21.15.38:0/1065640489 wait complete. 2024-09-12T12:24:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 Processor -- start 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 -- start start 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1049c0 0x7fdacc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdacc109140 0x7fdacc19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc114170 con 0x7fdacc109140 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc113ff0 con 0x7fdacc1049c0 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.008+0000 7fdad1e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc1142f0 con 0x7fdacc104010 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:49310/0 (socket says 172.21.15.38:49310) 2024-09-12T12:24:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 -- 172.21.15.38:0/1578930733 learned_addr learned my addr 172.21.15.38:0/1578930733 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacb400640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdacc109140 0x7fdacc19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdaca000640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1049c0 0x7fdacc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 -- 172.21.15.38:0/1578930733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1049c0 msgr2=0x7fdacc19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1049c0 0x7fdacc19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 -- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdacc109140 msgr2=0x7fdacc19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdacc109140 0x7fdacc19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 -- 172.21.15.38:0/1578930733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc19f5e0 con 0x7fdacc104010 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.009+0000 7fdacaa00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc19a630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdabc035040 tx=0x7fdabc033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.010+0000 7fdad0a00640 1 -- 172.21.15.38:0/1578930733 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc03f020 con 0x7fdacc104010 2024-09-12T12:24:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.010+0000 7fdad0a00640 1 -- 172.21.15.38:0/1578930733 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdabc032770 con 0x7fdacc104010 2024-09-12T12:24:58.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.010+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdacc19f870 con 0x7fdacc104010 2024-09-12T12:24:58.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.010+0000 7fdad0a00640 1 -- 172.21.15.38:0/1578930733 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc037040 con 0x7fdacc104010 2024-09-12T12:24:58.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.010+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdacc1a71b0 con 0x7fdacc104010 2024-09-12T12:24:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.011+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdacc1043f0 con 0x7fdacc104010 2024-09-12T12:24:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.013+0000 7fdad0a00640 1 -- 172.21.15.38:0/1578930733 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdabc042020 con 0x7fdacc104010 2024-09-12T12:24:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.014+0000 7fdad0a00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdab00a2c90 0x7fdab00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.014+0000 7fdad0a00640 1 -- 172.21.15.38:0/1578930733 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fdabc0ef5e0 con 0x7fdacc104010 2024-09-12T12:24:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.014+0000 7fdaca000640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdab00a2c90 0x7fdab00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.015+0000 7fdaca000640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdab00a2c90 0x7fdab00a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0fff70 tx=0x7fdab8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.018+0000 7fdad0a00640 1 -- 172.21.15.38:0/1578930733 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdabc049020 con 0x7fdacc104010 2024-09-12T12:24:58.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:57 smithi038 ceph-mon[30810]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:58.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.260+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdacc19b990 con 0x7fdacc104010 2024-09-12T12:24:58.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.262+0000 7fdad0a00640 1 -- 172.21.15.38:0/1578930733 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11968 (secure 0 0 0) 0x7fdabc0bc0e0 con 0x7fdacc104010 2024-09-12T12:24:58.261 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:24:58.262 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"btime":"2024-09-12T12:23:49:190760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:48.221685+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24502,24515,24508,24529,24557]},"id":1}]} 2024-09-12T12:24:58.262 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-12T12:24:58.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:57 smithi071 ceph-mon[34859]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdab00a2c90 msgr2=0x7fdab00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdab00a2c90 0x7fdab00a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0fff70 tx=0x7fdab8009260 comp rx=0 tx=0).stop 2024-09-12T12:24:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 msgr2=0x7fdacc19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc19a630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdabc035040 tx=0x7fdabc033d90 comp rx=0 tx=0).stop 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 shutdown_connections 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdab00a2c90 0x7fdab00a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdacc109140 0x7fdacc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1049c0 0x7fdacc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 --2- 172.21.15.38:0/1578930733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdacc104010 0x7fdacc19a630 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 >> 172.21.15.38:0/1578930733 conn(0x7fdacc0ffa50 msgr2=0x7fdacc100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 shutdown_connections 2024-09-12T12:24:58.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:24:58.264+0000 7fdad1e00640 1 -- 172.21.15.38:0/1578930733 wait complete. 2024-09-12T12:24:58.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:57 smithi154 ceph-mon[35578]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:59.069 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:59.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:58 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1578930733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:59.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:58 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1578930733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:59.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:58 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1578930733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:59.455 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 -- 172.21.15.38:0/4099319373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4109120 msgr2=0x7f9ff4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 --2- 172.21.15.38:0/4099319373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4109120 0x7f9ff4110ca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009ca0 tx=0x7f9fec02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 -- 172.21.15.38:0/4099319373 shutdown_connections 2024-09-12T12:25:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 --2- 172.21.15.38:0/4099319373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4109120 0x7f9ff4110ca0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 --2- 172.21.15.38:0/4099319373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ff41049a0 0x7f9ff41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 --2- 172.21.15.38:0/4099319373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff4103ff0 0x7f9ff41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 -- 172.21.15.38:0/4099319373 >> 172.21.15.38:0/4099319373 conn(0x7f9ff40ffa90 msgr2=0x7f9ff4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 -- 172.21.15.38:0/4099319373 shutdown_connections 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.062+0000 7f9ffac00640 1 -- 172.21.15.38:0/4099319373 wait complete. 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.063+0000 7f9ffac00640 1 Processor -- start 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.063+0000 7f9ffac00640 1 -- start start 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.063+0000 7f9ffac00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4103ff0 0x7f9ff419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.063+0000 7f9ffac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff41049a0 0x7f9ff419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.063+0000 7f9ffac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ff4109120 0x7f9ff419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ffac00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41141a0 con 0x7f9ff4103ff0 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ffac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4114020 con 0x7f9ff4109120 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ffac00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4114320 con 0x7f9ff41049a0 2024-09-12T12:25:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4103ff0 0x7f9ff419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4103ff0 0x7f9ff419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57198/0 (socket says 172.21.15.38:57198) 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 -- 172.21.15.38:0/2228083194 learned_addr learned my addr 172.21.15.38:0/2228083194 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3400640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff41049a0 0x7f9ff419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff8c00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ff4109120 0x7f9ff419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 -- 172.21.15.38:0/2228083194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff41049a0 msgr2=0x7f9ff419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff41049a0 0x7f9ff419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 -- 172.21.15.38:0/2228083194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ff4109120 msgr2=0x7f9ff419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ff4109120 0x7f9ff419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3e00640 1 -- 172.21.15.38:0/2228083194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff419f570 con 0x7f9ff4103ff0 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.064+0000 7f9ff3400640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff41049a0 0x7f9ff419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.065+0000 7f9ff3e00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4103ff0 0x7f9ff419a5c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400e9f0 tx=0x7f9fe400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.065+0000 7f9ff0c00640 1 -- 172.21.15.38:0/2228083194 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400cd80 con 0x7f9ff4103ff0 2024-09-12T12:25:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.065+0000 7f9ff0c00640 1 -- 172.21.15.38:0/2228083194 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe4005500 con 0x7f9ff4103ff0 2024-09-12T12:25:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.065+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff419f860 con 0x7f9ff4103ff0 2024-09-12T12:25:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.065+0000 7f9ff0c00640 1 -- 172.21.15.38:0/2228083194 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4010690 con 0x7f9ff4103ff0 2024-09-12T12:25:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.065+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff41a7140 con 0x7f9ff4103ff0 2024-09-12T12:25:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.066+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff41043d0 con 0x7f9ff4103ff0 2024-09-12T12:25:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.069+0000 7f9ff0c00640 1 -- 172.21.15.38:0/2228083194 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9fe40046c0 con 0x7f9ff4103ff0 2024-09-12T12:25:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.070+0000 7f9ff0c00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.070+0000 7f9ff0c00640 1 -- 172.21.15.38:0/2228083194 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f9fe40cfbf0 con 0x7f9ff4103ff0 2024-09-12T12:25:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.071+0000 7f9ff3400640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.072+0000 7f9ff3400640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ff410aaf0 tx=0x7f9fe0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.073+0000 7f9ff0c00640 1 -- 172.21.15.38:0/2228083194 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fe40541b0 con 0x7f9ff4103ff0 2024-09-12T12:25:00.205 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:59 smithi038 ceph-mon[30810]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:00.205 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:59 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:00.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:24:59 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:59 smithi071 ceph-mon[34859]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:59 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:24:59 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:00.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.291+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ff419b920 con 0x7f9ff4103ff0 2024-09-12T12:25:00.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.292+0000 7f9ff0c00640 1 -- 172.21.15.38:0/2228083194 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24865 (secure 0 0 0) 0x7f9fe409c5e0 con 0x7f9ff4103ff0 2024-09-12T12:25:00.292 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:00.292 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:24:35.829591+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:00.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9fd80a2c10 msgr2=0x7f9fd80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ff410aaf0 tx=0x7f9fe0005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:00.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4103ff0 msgr2=0x7f9ff419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4103ff0 0x7f9ff419a5c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400e9f0 tx=0x7f9fe400edf0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 shutdown_connections 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9fd80a2c10 0x7f9fd80a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ff4109120 0x7f9ff419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff41049a0 0x7f9ff419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 --2- 172.21.15.38:0/2228083194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff4103ff0 0x7f9ff419a5c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 >> 172.21.15.38:0/2228083194 conn(0x7f9ff40ffa90 msgr2=0x7f9ff41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 shutdown_connections 2024-09-12T12:25:00.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:00.295+0000 7f9ffac00640 1 -- 172.21.15.38:0/2228083194 wait complete. 2024-09-12T12:25:00.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:59 smithi154 ceph-mon[35578]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:00.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:59 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:00.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:24:59 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:01.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:01.145 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:00 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:01.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:00 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:01.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:00 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:01.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:00 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2228083194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:00 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:00 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:00 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:01.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:00 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2228083194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:01.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:00 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:01.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:00 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:01.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:00 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:25:01.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:00 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2228083194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 -- 172.21.15.38:0/96854990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c103ff0 msgr2=0x7f314c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 --2- 172.21.15.38:0/96854990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c103ff0 0x7f314c1043d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f313c009860 tx=0x7f313c02a340 comp rx=0 tx=0).stop 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 -- 172.21.15.38:0/96854990 shutdown_connections 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 --2- 172.21.15.38:0/96854990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 0x7f314c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 --2- 172.21.15.38:0/96854990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f314c1049a0 0x7f314c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 --2- 172.21.15.38:0/96854990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c103ff0 0x7f314c1043d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 -- 172.21.15.38:0/96854990 >> 172.21.15.38:0/96854990 conn(0x7f314c0ffa90 msgr2=0x7f314c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 -- 172.21.15.38:0/96854990 shutdown_connections 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.072+0000 7f3151e00640 1 -- 172.21.15.38:0/96854990 wait complete. 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.073+0000 7f3151e00640 1 Processor -- start 2024-09-12T12:25:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.073+0000 7f3151e00640 1 -- start start 2024-09-12T12:25:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f3151e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f314c103ff0 0x7f314c076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f3151e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c1049a0 0x7f314c076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f3151e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 0x7f314c077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f3151e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f314c114140 con 0x7f314c109120 2024-09-12T12:25:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f3151e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f314c113fc0 con 0x7f314c1049a0 2024-09-12T12:25:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f3151e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1142c0 con 0x7f314c103ff0 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f314b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 0x7f314c077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f314aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f314c103ff0 0x7f314c076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f314b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 0x7f314c077180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57210/0 (socket says 172.21.15.38:57210) 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f314b400640 1 -- 172.21.15.38:0/3276865046 learned_addr learned my addr 172.21.15.38:0/3276865046 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.074+0000 7f3142000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c1049a0 0x7f314c076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f314b400640 1 -- 172.21.15.38:0/3276865046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f314c103ff0 msgr2=0x7f314c076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f314b400640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f314c103ff0 0x7f314c076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f314b400640 1 -- 172.21.15.38:0/3276865046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c1049a0 msgr2=0x7f314c076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f314b400640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c1049a0 0x7f314c076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f314b400640 1 -- 172.21.15.38:0/3276865046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c1aacc0 con 0x7f314c109120 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f314b400640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 0x7f314c077180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f314400c370 tx=0x7f314400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f3150a00640 1 -- 172.21.15.38:0/3276865046 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144003970 con 0x7f314c109120 2024-09-12T12:25:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f3150a00640 1 -- 172.21.15.38:0/3276865046 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3144004020 con 0x7f314c109120 2024-09-12T12:25:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c1aafb0 con 0x7f314c109120 2024-09-12T12:25:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f3150a00640 1 -- 172.21.15.38:0/3276865046 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314400bad0 con 0x7f314c109120 2024-09-12T12:25:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.075+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c1ab460 con 0x7f314c109120 2024-09-12T12:25:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.077+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314c1054d0 con 0x7f314c109120 2024-09-12T12:25:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.078+0000 7f3150a00640 1 -- 172.21.15.38:0/3276865046 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f314401d020 con 0x7f314c109120 2024-09-12T12:25:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.081+0000 7f3150a00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31300a2c10 0x7f31300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.081+0000 7f3150a00640 1 -- 172.21.15.38:0/3276865046 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f31440cf2c0 con 0x7f314c109120 2024-09-12T12:25:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.081+0000 7f314aa00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31300a2c10 0x7f31300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.082+0000 7f314aa00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31300a2c10 0x7f31300a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f313c02a930 tx=0x7f313c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.085+0000 7f3150a00640 1 -- 172.21.15.38:0/3276865046 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f314409bcb0 con 0x7f314c109120 2024-09-12T12:25:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:01 smithi038 ceph-mon[30810]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:01 smithi071 ceph-mon[34859]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:02.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.306+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f314c077c30 con 0x7f314c109120 2024-09-12T12:25:02.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.306+0000 7f3150a00640 1 -- 172.21.15.38:0/3276865046 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11968 (secure 0 0 0) 0x7f314409b5b0 con 0x7f314c109120 2024-09-12T12:25:02.307 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:02.307 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"btime":"2024-09-12T12:23:49:190760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:48.221685+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24502,24515,24508,24529,24557]},"id":1}]} 2024-09-12T12:25:02.307 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-12T12:25:02.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31300a2c10 msgr2=0x7f31300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31300a2c10 0x7f31300a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f313c02a930 tx=0x7f313c0056d0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 msgr2=0x7f314c077180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 0x7f314c077180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f314400c370 tx=0x7f314400c830 comp rx=0 tx=0).stop 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 shutdown_connections 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31300a2c10 0x7f31300a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c109120 0x7f314c077180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f314c1049a0 0x7f314c076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 --2- 172.21.15.38:0/3276865046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f314c103ff0 0x7f314c076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 >> 172.21.15.38:0/3276865046 conn(0x7f314c0ffa90 msgr2=0x7f314c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 shutdown_connections 2024-09-12T12:25:02.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:02.309+0000 7f3151e00640 1 -- 172.21.15.38:0/3276865046 wait complete. 2024-09-12T12:25:02.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:01 smithi154 ceph-mon[35578]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:03.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:22:55.298669+0000', 'modified': '2024-09-12T12:23:48.221685+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24557, 'mds_1': 24529, 'mds_2': 24515, 'mds_3': 24508, 'mds_4': 24502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14526': {'gid': 14526, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6839/4044590502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6838', 'nonce': 4044590502}, {'type': 'v1', 'addr': '172.21.15.38:6839', 'nonce': 4044590502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14538': {'gid': 14538, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6841/1563078137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6840', 'nonce': 1563078137}, {'type': 'v1', 'addr': '172.21.15.38:6841', 'nonce': 1563078137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6833/3768607144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 3768607144}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 3768607144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/632951998', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 632951998}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 632951998}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/2977480232', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 2977480232}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 2977480232}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.154:6835/3632627850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3632627850}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3632627850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.154:6837/973401105', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 973401105}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 973401105}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.71:6837/293615032', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 293615032}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 293615032}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.154:6839/2253548650', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 2253548650}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 2253548650}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24557': {'gid': 24557, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.71:6839/3960727102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3960727102}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3960727102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24557, 'qdb_cluster': [24502, 24515, 24508, 24529, 24557]} 2024-09-12T12:25:03.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T12:25:03.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T12:25:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:02 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3276865046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:02 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3276865046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:03.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:02 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3276865046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:03.486 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 -- 172.21.15.38:0/3375644351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f4108f60 msgr2=0x7f79f4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 --2- 172.21.15.38:0/3375644351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f4108f60 0x7f79f4110ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009ca0 tx=0x7f79ec02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 -- 172.21.15.38:0/3375644351 shutdown_connections 2024-09-12T12:25:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 --2- 172.21.15.38:0/3375644351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f4108f60 0x7f79f4110ae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 --2- 172.21.15.38:0/3375644351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79f41047e0 0x7f79f4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 --2- 172.21.15.38:0/3375644351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f4103e30 0x7f79f4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 -- 172.21.15.38:0/3375644351 >> 172.21.15.38:0/3375644351 conn(0x7f79f40ff8d0 msgr2=0x7f79f4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 -- 172.21.15.38:0/3375644351 shutdown_connections 2024-09-12T12:25:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.039+0000 7f79fae00640 1 -- 172.21.15.38:0/3375644351 wait complete. 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.040+0000 7f79fae00640 1 Processor -- start 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.040+0000 7f79fae00640 1 -- start start 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79fae00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f4103e30 0x7f79f419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79fae00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f41047e0 0x7f79f419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79fae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79f4108f60 0x7f79f419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79fae00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4114010 con 0x7f79f41047e0 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79fae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4113e90 con 0x7f79f4108f60 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79fae00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4114190 con 0x7f79f4103e30 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79f9000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f41047e0 0x7f79f419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79f9a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f4103e30 0x7f79f419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79f9000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f41047e0 0x7f79f419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57238/0 (socket says 172.21.15.38:57238) 2024-09-12T12:25:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79f9000640 1 -- 172.21.15.38:0/780639682 learned_addr learned my addr 172.21.15.38:0/780639682 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.041+0000 7f79fa400640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79f4108f60 0x7f79f419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f9000640 1 -- 172.21.15.38:0/780639682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f4103e30 msgr2=0x7f79f419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f9000640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f4103e30 0x7f79f419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f9000640 1 -- 172.21.15.38:0/780639682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79f4108f60 msgr2=0x7f79f419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f9000640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79f4108f60 0x7f79f419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f9000640 1 -- 172.21.15.38:0/780639682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f419f3e0 con 0x7f79f41047e0 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f9a00640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f4103e30 0x7f79f419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f9000640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f41047e0 0x7f79f419a970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f79e000e9f0 tx=0x7f79e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f2000640 1 -- 172.21.15.38:0/780639682 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e000cd80 con 0x7f79f41047e0 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f2000640 1 -- 172.21.15.38:0/780639682 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e0010910 con 0x7f79f41047e0 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79f2000640 1 -- 172.21.15.38:0/780639682 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0018990 con 0x7f79f41047e0 2024-09-12T12:25:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.042+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f419f6d0 con 0x7f79f41047e0 2024-09-12T12:25:04.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.043+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f41a6fb0 con 0x7f79f41047e0 2024-09-12T12:25:04.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 Processor -- start 2024-09-12T12:25:04.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79f2000640 1 -- 172.21.15.38:0/780639682 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f79e0010ac0 con 0x7f79f41047e0 2024-09-12T12:25:04.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 -- start start 2024-09-12T12:25:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f240434e0 0x558f240438c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f2404e6c0 0x558f24050ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558f23fa90b0 con 0x558f240434e0 2024-09-12T12:25:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558f23f50ab0 con 0x558f2404e6c0 2024-09-12T12:25:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.046+0000 7f79fee7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558f23fa5070 con 0x558f24043e00 2024-09-12T12:25:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79fa400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f240434e0 0x558f240438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79fa400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f240434e0 0x558f240438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57242/0 (socket says 172.21.15.38:57242) 2024-09-12T12:25:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79fa400640 1 -- 172.21.15.38:0/1843266805 learned_addr learned my addr 172.21.15.38:0/1843266805 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9000640 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f2404e6c0 0x558f24050ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9a00640 1 -- 172.21.15.38:0/1843266805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f2404e6c0 msgr2=0x558f24050ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9a00640 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f2404e6c0 0x558f24050ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9a00640 1 -- 172.21.15.38:0/1843266805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f240434e0 msgr2=0x558f240438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9a00640 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f240434e0 0x558f240438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9a00640 1 -- 172.21.15.38:0/1843266805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f23f5d4a0 con 0x558f24043e00 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79fa400640 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f240434e0 0x558f240438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.047+0000 7f79f9000640 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f2404e6c0 0x558f24050ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.048+0000 7f79f9a00640 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404e180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009fd0 tx=0x7f79e80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eea3e95bdbcf4f84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.048+0000 7f79f2000640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79dc0a2c90 0x7f79dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.048+0000 7f79e6a00640 1 -- 172.21.15.38:0/1843266805 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8004310 con 0x558f24043e00 2024-09-12T12:25:04.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.048+0000 7f79e6a00640 1 -- 172.21.15.38:0/1843266805 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e80044b0 con 0x558f24043e00 2024-09-12T12:25:04.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.048+0000 7f79f2000640 1 -- 172.21.15.38:0/780639682 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f79e00cf7b0 con 0x7f79f41047e0 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.048+0000 7f79e6a00640 1 -- 172.21.15.38:0/1843266805 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80035f0 con 0x558f24043e00 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.048+0000 7f79fa400640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79dc0a2c90 0x7f79dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 -- 172.21.15.38:0/1843266805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 msgr2=0x558f2404e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404e180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009fd0 tx=0x7f79e80118d0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fa400640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79dc0a2c90 0x7f79dc0a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f79ec02aeb0 tx=0x7f79ec005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 -- 172.21.15.38:0/1843266805 shutdown_connections 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f2404e6c0 0x558f24050ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404e180 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1843266805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f240434e0 0x558f240438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 -- 172.21.15.38:0/1843266805 >> 172.21.15.38:0/1843266805 conn(0x558f2403fa70 msgr2=0x558f2403fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 -- 172.21.15.38:0/1843266805 shutdown_connections 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 -- 172.21.15.38:0/1843266805 wait complete. 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.049+0000 7f79fee7d740 1 -- start start 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 1 Processor -- start 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f2404b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f2404bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558f24051330 con 0x558f2404e6c0 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558f23f31920 con 0x558f240434e0 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558f240514b0 con 0x558f24043e00 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.050+0000 7f79fee7d740 10 client.0 _ll_register_callbacks cb 0x558f23f558a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79fa400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f2404bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:49386/0 (socket says 172.21.15.38:49386) 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79fa400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f2404bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57248/0 (socket says 172.21.15.38:57248) 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 -- 172.21.15.38:0/1180691997 learned_addr learned my addr 172.21.15.38:0/1180691997 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9a00640 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f2404b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 -- 172.21.15.38:0/1180691997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 msgr2=0x558f2404b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f2404b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 -- 172.21.15.38:0/1180691997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 msgr2=0x558f2404bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f2404bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 -- 172.21.15.38:0/1180691997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f23d1a2b0 con 0x558f24043e00 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79f9000640 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404ba40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c6a0 tx=0x7f79e009b5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21eb5451ba2cba26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.051+0000 7f79db400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79db400640 1 -- 172.21.15.38:0/1180691997 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e00cfba0 con 0x558f24043e00 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79e80044b0 con 0x558f24043e00 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79db400640 1 -- 172.21.15.38:0/1180691997 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f79e00cfd40 con 0x558f24043e00 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79db400640 1 -- 172.21.15.38:0/1180691997 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f79e0018b30 con 0x558f24043e00 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79fee7d740 10 client.24988 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558f2405cef0 con 0x558f24043e00 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79db400640 1 -- 172.21.15.38:0/1180691997 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e80044b0 con 0x558f24043e00 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79db400640 1 -- 172.21.15.38:0/1180691997 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f79e00d1ce0 con 0x558f24043e00 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79fee7d740 10 client.24988 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79fee7d740 10 client.24988 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79fee7d740 20 client.24988 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.052+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f2405f4f0 0x558f24060960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.053+0000 7f79fee7d740 4 client.24988 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.053+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f23fb6620 con 0x558f2405f4f0 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.053+0000 7f79f9a00640 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f2405f4f0 0x558f24060960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.053+0000 7f79f9a00640 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f2405f4f0 0x558f24060960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=db54fdc5e4711eb4 server_cookie=68c8d0020c7eda4e in_seq=0 out_seq=0 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.053+0000 7f79db400640 10 client.24988 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.054+0000 7f79db400640 1 -- 172.21.15.38:0/1180691997 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f23fb6620 con 0x558f2405f4f0 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.054+0000 7f79db400640 10 client.24988 handle_command_reply: tid=0 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 client.24988 shutdown 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 msgr2=0x558f2404ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404ba40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c6a0 tx=0x7f79e009b5a0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 shutdown_connections 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f2405f4f0 0x558f24060960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f2404bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f2404ba40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79db400640 0 client.24988 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 --2- 172.21.15.38:0/1180691997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f2404b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 >> 172.21.15.38:0/1180691997 conn(0x558f2403fa70 msgr2=0x558f240457a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 shutdown_connections 2024-09-12T12:25:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 1 -- 172.21.15.38:0/1180691997 wait complete. 2024-09-12T12:25:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.055+0000 7f79fee7d740 20 client.24988 trim_cache size 0 max 16384 2024-09-12T12:25:04.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.091+0000 7f79fee7d740 1 Processor -- start 2024-09-12T12:25:04.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.092+0000 7f79fee7d740 1 -- start start 2024-09-12T12:25:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.092+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24045f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.092+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f24043e00 0x558f2405e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.092+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f2404e6c0 0x558f2404a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.092+0000 7f79fee7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558f2405eca0 con 0x558f24043e00 2024-09-12T12:25:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.092+0000 7f79fee7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558f2405f370 con 0x558f240434e0 2024-09-12T12:25:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.092+0000 7f79fee7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558f2405fa40 con 0x558f2404e6c0 2024-09-12T12:25:04.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.093+0000 7f79f9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24045f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.093+0000 7f79fa400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f2404e6c0 0x558f2404a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.093+0000 7f79fa400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f2404e6c0 0x558f2404a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:49400/0 (socket says 172.21.15.38:49400) 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.093+0000 7f79fa400640 1 -- 172.21.15.38:0/2896717995 learned_addr learned my addr 172.21.15.38:0/2896717995 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.094+0000 7f79fa400640 1 -- 172.21.15.38:0/2896717995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 msgr2=0x558f24045f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.094+0000 7f79fa400640 1 --2- 172.21.15.38:0/2896717995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24045f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.094+0000 7f79fa400640 1 -- 172.21.15.38:0/2896717995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f24043e00 msgr2=0x558f2405e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.094+0000 7f79fa400640 1 --2- 172.21.15.38:0/2896717995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f24043e00 0x558f2405e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.094+0000 7f79fa400640 1 -- 172.21.15.38:0/2896717995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f24043c30 con 0x558f2404e6c0 2024-09-12T12:25:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.095+0000 7f79fa400640 1 --2- 172.21.15.38:0/2896717995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f2404e6c0 0x558f2404a4e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f79ec035000 tx=0x7f79ec041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0045a63bbac131 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.095+0000 7f79e6000640 1 -- 172.21.15.38:0/2896717995 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec003b30 con 0x558f2404e6c0 2024-09-12T12:25:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.095+0000 7f79e6000640 1 -- 172.21.15.38:0/2896717995 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec036050 con 0x558f2404e6c0 2024-09-12T12:25:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.095+0000 7f79e6000640 1 -- 172.21.15.38:0/2896717995 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec004540 con 0x558f2404e6c0 2024-09-12T12:25:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.096+0000 7f79fee7d740 1 -- 172.21.15.38:0/2896717995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f2404e6c0 msgr2=0x558f2404a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.096+0000 7f79fee7d740 1 --2- 172.21.15.38:0/2896717995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f2404e6c0 0x558f2404a4e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f79ec035000 tx=0x7f79ec041000 comp rx=0 tx=0).stop 2024-09-12T12:25:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.097+0000 7f79fee7d740 1 -- 172.21.15.38:0/2896717995 shutdown_connections 2024-09-12T12:25:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.097+0000 7f79fee7d740 1 --2- 172.21.15.38:0/2896717995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f2404e6c0 0x558f2404a4e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.097+0000 7f79fee7d740 1 --2- 172.21.15.38:0/2896717995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f24043e00 0x558f2405e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.097+0000 7f79fee7d740 1 --2- 172.21.15.38:0/2896717995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24045f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.097+0000 7f79fee7d740 1 -- 172.21.15.38:0/2896717995 >> 172.21.15.38:0/2896717995 conn(0x558f2403fa70 msgr2=0x558f24049dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.097+0000 7f79fee7d740 1 -- 172.21.15.38:0/2896717995 shutdown_connections 2024-09-12T12:25:04.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.097+0000 7f79fee7d740 1 -- 172.21.15.38:0/2896717995 wait complete. 2024-09-12T12:25:04.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.098+0000 7f79fee7d740 1 -- start start 2024-09-12T12:25:04.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.098+0000 7f79fee7d740 1 Processor -- start 2024-09-12T12:25:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.099+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24062d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.099+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f240632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.099+0000 7f79fee7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f24067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.099+0000 7f79fee7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558f240607e0 con 0x558f2404e6c0 2024-09-12T12:25:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.099+0000 7f79fee7d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558f24060110 con 0x558f240434e0 2024-09-12T12:25:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.100+0000 7f79fee7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558f24060eb0 con 0x558f24043e00 2024-09-12T12:25:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.100+0000 7f79fee7d740 10 client.0 _ll_register_callbacks cb 0x7f79e009b780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:04.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.100+0000 7f79f9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.100+0000 7f79f9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24062d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:43266/0 (socket says 172.21.15.38:43266) 2024-09-12T12:25:04.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.100+0000 7f79f9a00640 1 -- 172.21.15.38:0/3454156811 learned_addr learned my addr 172.21.15.38:0/3454156811 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:04.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.101+0000 7f79f9a00640 1 -- 172.21.15.38:0/3454156811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 msgr2=0x558f240632b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:25:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.101+0000 7f79f9a00640 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f240632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.101+0000 7f79f9a00640 1 -- 172.21.15.38:0/3454156811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 msgr2=0x558f24067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.101+0000 7f79f9a00640 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f24067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.101+0000 7f79f9a00640 1 -- 172.21.15.38:0/3454156811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f24067aa0 con 0x558f240434e0 2024-09-12T12:25:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.102+0000 7f79db400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.102+0000 7f79f9a00640 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24062d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009d60 tx=0x7f79e8011e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514d7af9a654929d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.102+0000 7f79db400640 1 -- 172.21.15.38:0/3454156811 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8033060 con 0x558f240434e0 2024-09-12T12:25:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.103+0000 7f79db400640 1 -- 172.21.15.38:0/3454156811 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f79e8004740 con 0x558f240434e0 2024-09-12T12:25:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.103+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79ec036050 con 0x558f240434e0 2024-09-12T12:25:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.104+0000 7f79db400640 1 -- 172.21.15.38:0/3454156811 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f79e8033060 con 0x558f240434e0 2024-09-12T12:25:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.104+0000 7f79fee7d740 10 client.25001 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.104+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558f240c4370 con 0x558f240434e0 2024-09-12T12:25:04.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.104+0000 7f79db400640 1 -- 172.21.15.38:0/3454156811 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e8004940 con 0x558f240434e0 2024-09-12T12:25:04.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.105+0000 7f79db400640 1 -- 172.21.15.38:0/3454156811 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f79e8004d10 con 0x558f240434e0 2024-09-12T12:25:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.105+0000 7f79fee7d740 10 client.25001 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.105+0000 7f79fee7d740 10 client.25001 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.105+0000 7f79fee7d740 20 client.25001 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.105+0000 7f79fee7d740 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f240c8d20 0x558f240c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.105+0000 7f79fee7d740 4 client.25001 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.105+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "status"}) -- 0x7f79ec036050 con 0x558f240c8d20 2024-09-12T12:25:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.106+0000 7f79f9000640 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f240c8d20 0x558f240c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.109+0000 7f79f9000640 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f240c8d20 0x558f240c7a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=edbc9365b7f351d5 server_cookie=b05fd2680460cc2b in_seq=0 out_seq=0 2024-09-12T12:25:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.110+0000 7f79db400640 10 client.25001 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79db400640 1 -- 172.21.15.38:0/3454156811 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7f79ec036050 con 0x558f240c8d20 2024-09-12T12:25:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79db400640 10 client.25001 handle_command_reply: tid=0 2024-09-12T12:25:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 client.25001 shutdown 2024-09-12T12:25:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 msgr2=0x558f24062d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24062d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009d60 tx=0x7f79e8011e90 comp rx=0 tx=0).stop 2024-09-12T12:25:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 shutdown_connections 2024-09-12T12:25:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x558f240c8d20 0x558f240c7a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558f2404e6c0 0x558f24067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558f24043e00 0x558f240632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 --2- 172.21.15.38:0/3454156811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558f240434e0 0x558f24062d70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 >> 172.21.15.38:0/3454156811 conn(0x558f2403fa70 msgr2=0x558f2404a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79db400640 0 client.25001 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.111+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 shutdown_connections 2024-09-12T12:25:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.112+0000 7f79fee7d740 1 -- 172.21.15.38:0/3454156811 wait complete. 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.112+0000 7f79fee7d740 20 client.25001 trim_cache size 0 max 16384 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 4, 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24502, 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 76.934105177999996, 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 159.04687987599999 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79dc0a2c90 msgr2=0x7f79dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79dc0a2c90 0x7f79dc0a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f79ec02aeb0 tx=0x7f79ec005d80 comp rx=0 tx=0).stop 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f41047e0 msgr2=0x7f79f419a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f41047e0 0x7f79f419a970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f79e000e9f0 tx=0x7f79e000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 shutdown_connections 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f79dc0a2c90 0x7f79dc0a5150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79f4108f60 0x7f79f419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f41047e0 0x7f79f419a970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 --2- 172.21.15.38:0/780639682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f4103e30 0x7f79f419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.114+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 >> 172.21.15.38:0/780639682 conn(0x7f79f40ff8d0 msgr2=0x7f79f4100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.115+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 shutdown_connections 2024-09-12T12:25:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:04.116+0000 7f79fae00640 1 -- 172.21.15.38:0/780639682 wait complete. 2024-09-12T12:25:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:03 smithi038 ceph-mon[30810]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:04.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:03 smithi071 ceph-mon[34859]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:04.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:03 smithi154 ceph-mon[35578]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:04.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T12:25:05.380 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:05.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 -- 172.21.15.38:0/3846337437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4481049a0 msgr2=0x7fc4481089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 --2- 172.21.15.38:0/3846337437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4481049a0 0x7fc4481089f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc430009900 tx=0x7fc43002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 -- 172.21.15.38:0/3846337437 shutdown_connections 2024-09-12T12:25:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 --2- 172.21.15.38:0/3846337437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448109120 0x7fc448110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 --2- 172.21.15.38:0/3846337437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4481049a0 0x7fc4481089f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 --2- 172.21.15.38:0/3846337437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc448103ff0 0x7fc4481043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 -- 172.21.15.38:0/3846337437 >> 172.21.15.38:0/3846337437 conn(0x7fc4480ffa90 msgr2=0x7fc448101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 -- 172.21.15.38:0/3846337437 shutdown_connections 2024-09-12T12:25:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.923+0000 7fc44de00640 1 -- 172.21.15.38:0/3846337437 wait complete. 2024-09-12T12:25:05.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 Processor -- start 2024-09-12T12:25:05.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 -- start start 2024-09-12T12:25:05.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448103ff0 0x7fc44819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4481049a0 0x7fc44819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc448109120 0x7fc44819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc448114190 con 0x7fc448109120 2024-09-12T12:25:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc448114010 con 0x7fc448103ff0 2024-09-12T12:25:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.924+0000 7fc44de00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc448114310 con 0x7fc4481049a0 2024-09-12T12:25:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc447400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc448109120 0x7fc44819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc446a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448103ff0 0x7fc44819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc446a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448103ff0 0x7fc44819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:50474/0 (socket says 172.21.15.38:50474) 2024-09-12T12:25:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc446a00640 1 -- 172.21.15.38:0/666494618 learned_addr learned my addr 172.21.15.38:0/666494618 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc43fe00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4481049a0 0x7fc44819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc447400640 1 -- 172.21.15.38:0/666494618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4481049a0 msgr2=0x7fc44819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc447400640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4481049a0 0x7fc44819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc447400640 1 -- 172.21.15.38:0/666494618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448103ff0 msgr2=0x7fc44819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc447400640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448103ff0 0x7fc44819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.925+0000 7fc447400640 1 -- 172.21.15.38:0/666494618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44819f620 con 0x7fc448109120 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.926+0000 7fc447400640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc448109120 0x7fc44819ef40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc44000da10 tx=0x7fc44000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.926+0000 7fc44ca00640 1 -- 172.21.15.38:0/666494618 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44000bd70 con 0x7fc448109120 2024-09-12T12:25:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.926+0000 7fc44ca00640 1 -- 172.21.15.38:0/666494618 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc440003e50 con 0x7fc448109120 2024-09-12T12:25:05.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.926+0000 7fc44ca00640 1 -- 172.21.15.38:0/666494618 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4400106a0 con 0x7fc448109120 2024-09-12T12:25:05.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.926+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44819f910 con 0x7fc448109120 2024-09-12T12:25:05.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.926+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481a71f0 con 0x7fc448109120 2024-09-12T12:25:05.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.929+0000 7fc44ca00640 1 -- 172.21.15.38:0/666494618 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc440003970 con 0x7fc448109120 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.929+0000 7fc45089a740 1 Processor -- start 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.929+0000 7fc45089a740 1 -- start start 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc45089a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc45089a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcfafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc45089a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddcfd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc45089a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddc560b0 con 0x55b4ddcf0c50 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc45089a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddbfdab0 con 0x55b4ddcf0330 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc45089a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddc52070 con 0x55b4ddcfb510 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc446a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcfafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc446a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcfafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36168/0 (socket says 172.21.15.38:36168) 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc446a00640 1 -- 172.21.15.38:0/4294202534 learned_addr learned my addr 172.21.15.38:0/4294202534 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc43fe00640 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.930+0000 7fc43fe00640 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddcfd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc446a00640 1 -- 172.21.15.38:0/4294202534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 msgr2=0x55b4ddcfd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc446a00640 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddcfd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc446a00640 1 -- 172.21.15.38:0/4294202534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 msgr2=0x55b4ddcf0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc446a00640 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc446a00640 1 -- 172.21.15.38:0/4294202534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4ddc0a4a0 con 0x55b4ddcf0c50 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc44ca00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc42c0a2c00 0x7fc42c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc44ca00640 1 -- 172.21.15.38:0/666494618 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fc4400cf740 con 0x7fc448109120 2024-09-12T12:25:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc43fe00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc42c0a2c00 0x7fc42c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.931+0000 7fc446a00640 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcfafd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc438009e10 tx=0x7fc438011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c34d0664de9e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.932+0000 7fc437e00640 1 -- 172.21.15.38:0/4294202534 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43801e070 con 0x55b4ddcf0c50 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.932+0000 7fc437e00640 1 -- 172.21.15.38:0/4294202534 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc438019b10 con 0x55b4ddcf0c50 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.932+0000 7fc437e00640 1 -- 172.21.15.38:0/4294202534 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43800fb10 con 0x55b4ddcf0c50 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.932+0000 7fc45089a740 1 -- 172.21.15.38:0/4294202534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0c50 msgr2=0x55b4ddcfafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.932+0000 7fc45089a740 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcfafd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc438009e10 tx=0x7fc438011810 comp rx=0 tx=0).stop 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.932+0000 7fc43fe00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc42c0a2c00 0x7fc42c0a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc430000c00 tx=0x7fc430041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.932+0000 7fc45089a740 1 -- 172.21.15.38:0/4294202534 shutdown_connections 2024-09-12T12:25:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddcfd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcfafd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 --2- 172.21.15.38:0/4294202534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 -- 172.21.15.38:0/4294202534 >> 172.21.15.38:0/4294202534 conn(0x55b4ddcec8c0 msgr2=0x55b4ddcecca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 -- 172.21.15.38:0/4294202534 shutdown_connections 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 -- 172.21.15.38:0/4294202534 wait complete. 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 -- start start 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.933+0000 7fc45089a740 1 Processor -- start 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc45089a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc45089a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc45089a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc45089a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddcfe060 con 0x55b4ddcf0330 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc45089a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddbde920 con 0x55b4ddcfb510 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc45089a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddcfe1e0 con 0x55b4ddcf0c50 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc45089a740 10 client.0 _ll_register_callbacks cb 0x55b4ddc028a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc446a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc446a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36180/0 (socket says 172.21.15.38:36180) 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc446a00640 1 -- 172.21.15.38:0/4213662670 learned_addr learned my addr 172.21.15.38:0/4213662670 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc447400640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.934+0000 7fc43fe00640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc446a00640 1 -- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 msgr2=0x55b4ddcf8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc446a00640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc446a00640 1 -- 172.21.15.38:0/4213662670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcfb510 msgr2=0x55b4ddcf90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc446a00640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc446a00640 1 -- 172.21.15.38:0/4213662670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4dd9c72b0 con 0x55b4ddcf0330 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc447400640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc446a00640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf8650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc438011d10 tx=0x7fc438009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcdcba36cb1e7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc434c00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc434c00640 1 -- 172.21.15.38:0/4213662670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43801e050 con 0x55b4ddcf0330 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc434c00640 1 -- 172.21.15.38:0/4213662670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fc438005040 con 0x55b4ddcf0330 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.935+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc438019b10 con 0x55b4ddcf0330 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc434c00640 1 -- 172.21.15.38:0/4213662670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc438033050 con 0x55b4ddcf0330 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 10 client.14997 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b4ddd09f00 con 0x55b4ddcf0330 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc434c00640 1 -- 172.21.15.38:0/4213662670 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc438019b10 con 0x55b4ddcf0330 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc434c00640 1 -- 172.21.15.38:0/4213662670 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc4380046c0 con 0x55b4ddcf0330 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 10 client.14997 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 10 client.14997 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 20 client.14997 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd0c2d0 0x55b4ddd0d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 4 client.14997 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.936+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4ddc63620 con 0x55b4ddd0c2d0 2024-09-12T12:25:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.937+0000 7fc43fe00640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd0c2d0 0x55b4ddd0d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.937+0000 7fc43fe00640 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd0c2d0 0x55b4ddd0d740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=efcb4f045a37ece8 server_cookie=1a81da321c3146f1 in_seq=0 out_seq=0 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.937+0000 7fc434c00640 10 client.14997 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.938+0000 7fc434c00640 1 -- 172.21.15.38:0/4213662670 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4ddc63620 con 0x55b4ddd0c2d0 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.938+0000 7fc434c00640 10 client.14997 handle_command_reply: tid=0 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.938+0000 7fc45089a740 1 client.14997 shutdown 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 msgr2=0x55b4ddcf8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf8650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc438011d10 tx=0x7fc438009b60 comp rx=0 tx=0).stop 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 shutdown_connections 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd0c2d0 0x55b4ddd0d740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 --2- 172.21.15.38:0/4213662670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddcf8650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 >> 172.21.15.38:0/4213662670 conn(0x55b4ddcec8c0 msgr2=0x55b4ddcf25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc434c00640 0 client.14997 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:05.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 shutdown_connections 2024-09-12T12:25:05.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 1 -- 172.21.15.38:0/4213662670 wait complete. 2024-09-12T12:25:05.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.939+0000 7fc45089a740 20 client.14997 trim_cache size 0 max 16384 2024-09-12T12:25:05.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 Processor -- start 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 -- start start 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddd0d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddd06b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddd0ba80 con 0x55b4ddcf0330 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddd0c150 con 0x55b4ddcf0c50 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.958+0000 7fc45089a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddd0c820 con 0x55b4ddcfb510 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddd0d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddd0d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36182/0 (socket says 172.21.15.38:36182) 2024-09-12T12:25:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 -- 172.21.15.38:0/781926040 learned_addr learned my addr 172.21.15.38:0/781926040 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc43fe00640 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc447400640 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddd06b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 -- 172.21.15.38:0/781926040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 msgr2=0x55b4ddd06b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddd06b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 -- 172.21.15.38:0/781926040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0c50 msgr2=0x55b4ddcf8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc446a00640 1 -- 172.21.15.38:0/781926040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4ddcf6ba0 con 0x55b4ddcf0330 2024-09-12T12:25:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.959+0000 7fc43fe00640 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:05.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.960+0000 7fc446a00640 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddd0d070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc438004a90 tx=0x7fc438011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448f5d402e2a016c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.960+0000 7fc437400640 1 -- 172.21.15.38:0/781926040 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43801e040 con 0x55b4ddcf0330 2024-09-12T12:25:05.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.960+0000 7fc437400640 1 -- 172.21.15.38:0/781926040 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43802a070 con 0x55b4ddcf0330 2024-09-12T12:25:05.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.960+0000 7fc437400640 1 -- 172.21.15.38:0/781926040 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43800fc30 con 0x55b4ddcf0330 2024-09-12T12:25:05.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.960+0000 7fc45089a740 1 -- 172.21.15.38:0/781926040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 msgr2=0x55b4ddd0d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.960+0000 7fc45089a740 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddd0d070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc438004a90 tx=0x7fc438011e40 comp rx=0 tx=0).stop 2024-09-12T12:25:05.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 -- 172.21.15.38:0/781926040 shutdown_connections 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcfb510 0x55b4ddd06b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0c50 0x55b4ddcf8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 --2- 172.21.15.38:0/781926040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcf0330 0x55b4ddd0d070 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 -- 172.21.15.38:0/781926040 >> 172.21.15.38:0/781926040 conn(0x55b4ddcec8c0 msgr2=0x55b4ddd06430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 -- 172.21.15.38:0/781926040 shutdown_connections 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 -- 172.21.15.38:0/781926040 wait complete. 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 -- start start 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.961+0000 7fc45089a740 1 Processor -- start 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc45089a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddd15c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc45089a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddd161a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc45089a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc45089a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddd0d5c0 con 0x55b4ddcfb510 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc45089a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddd0cef0 con 0x55b4ddcf0330 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc45089a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4ddd0dc90 con 0x55b4ddcf0c50 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc45089a740 10 client.0 _ll_register_callbacks cb 0x7fc438009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc447400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc446a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddd15c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc43fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddd161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc447400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36190/0 (socket says 172.21.15.38:36190) 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc447400640 1 -- 172.21.15.38:0/3883535058 learned_addr learned my addr 172.21.15.38:0/3883535058 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc446a00640 1 -- 172.21.15.38:0/3883535058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 msgr2=0x55b4ddd161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc446a00640 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddd161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc446a00640 1 -- 172.21.15.38:0/3883535058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcfb510 msgr2=0x55b4ddcf4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc446a00640 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc446a00640 1 -- 172.21.15.38:0/3883535058 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4ddcf57d0 con 0x55b4ddcf0330 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.962+0000 7fc447400640 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc446a00640 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddd15c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc438011850 tx=0x7fc43800f770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bfa17db10819ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc434c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc434c00640 1 -- 172.21.15.38:0/3883535058 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43801e040 con 0x55b4ddcf0330 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc434c00640 1 -- 172.21.15.38:0/3883535058 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fc43800f9b0 con 0x55b4ddcf0330 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc43802a070 con 0x55b4ddcf0330 2024-09-12T12:25:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc434c00640 1 -- 172.21.15.38:0/3883535058 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc438048050 con 0x55b4ddcf0330 2024-09-12T12:25:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc45089a740 10 client.25019 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.963+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b4ddd15540 con 0x55b4ddcf0330 2024-09-12T12:25:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc434c00640 1 -- 172.21.15.38:0/3883535058 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43802a070 con 0x55b4ddcf0330 2024-09-12T12:25:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc434c00640 1 -- 172.21.15.38:0/3883535058 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc438004c80 con 0x55b4ddcf0330 2024-09-12T12:25:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc45089a740 10 client.25019 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc45089a740 10 client.25019 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc45089a740 20 client.25019 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc45089a740 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd7acb0 0x55b4ddd799c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc45089a740 4 client.25019 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.964+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "status"}) -- 0x55b4ddc5db30 con 0x55b4ddd7acb0 2024-09-12T12:25:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.965+0000 7fc43fe00640 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd7acb0 0x55b4ddd799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.965+0000 7fc43fe00640 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd7acb0 0x55b4ddd799c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1b1ab33b7f6f9f27 server_cookie=66cd8a83e54d47da in_seq=0 out_seq=0 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.965+0000 7fc434c00640 10 client.25019 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.965+0000 7fc434c00640 1 -- 172.21.15.38:0/3883535058 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b4ddc5db30 con 0x55b4ddd7acb0 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.965+0000 7fc434c00640 10 client.25019 handle_command_reply: tid=0 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.965+0000 7fc45089a740 1 client.25019 shutdown 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 msgr2=0x55b4ddd15c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddd15c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc438011850 tx=0x7fc43800f770 comp rx=0 tx=0).stop 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 shutdown_connections 2024-09-12T12:25:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x55b4ddd7acb0 0x55b4ddd799c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4ddcfb510 0x55b4ddcf4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4ddcf0c50 0x55b4ddd161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 --2- 172.21.15.38:0/3883535058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b4ddcf0330 0x55b4ddd15c60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 >> 172.21.15.38:0/3883535058 conn(0x55b4ddcec8c0 msgr2=0x55b4ddceba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc434c00640 0 client.25019 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 shutdown_connections 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 1 -- 172.21.15.38:0/3883535058 wait complete. 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.966+0000 7fc45089a740 20 client.25019 trim_cache size 0 max 16384 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:05.973 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 3, 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24508, 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 79.801989539999994, 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 158.277280115 2024-09-12T12:25:05.974 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc42c0a2c00 msgr2=0x7fc42c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc42c0a2c00 0x7fc42c0a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc430000c00 tx=0x7fc430041040 comp rx=0 tx=0).stop 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc448109120 msgr2=0x7fc44819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc448109120 0x7fc44819ef40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc44000da10 tx=0x7fc44000ded0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 shutdown_connections 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc42c0a2c00 0x7fc42c0a50c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc448109120 0x7fc44819ef40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4481049a0 0x7fc44819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 --2- 172.21.15.38:0/666494618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc448103ff0 0x7fc44819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 >> 172.21.15.38:0/666494618 conn(0x7fc4480ffa90 msgr2=0x7fc448100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 shutdown_connections 2024-09-12T12:25:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:05.967+0000 7fc44de00640 1 -- 172.21.15.38:0/666494618 wait complete. 2024-09-12T12:25:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:06 smithi038 ceph-mon[30810]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:06.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:06 smithi038 ceph-mon[30810]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T12:25:06.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:06 smithi071 ceph-mon[34859]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:06.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:06 smithi071 ceph-mon[34859]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T12:25:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:06 smithi154 ceph-mon[35578]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:06.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:06 smithi154 ceph-mon[35578]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T12:25:06.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T12:25:07.139 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:07.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 -- 172.21.15.38:0/1898373558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c112a30 msgr2=0x7f2d7c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 --2- 172.21.15.38:0/1898373558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c112a30 0x7f2d7c114e20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009ca0 tx=0x7f2d7402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 -- 172.21.15.38:0/1898373558 shutdown_connections 2024-09-12T12:25:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 --2- 172.21.15.38:0/1898373558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c112a30 0x7f2d7c114e20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 --2- 172.21.15.38:0/1898373558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c077040 0x7f2d7c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 --2- 172.21.15.38:0/1898373558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d7c076720 0x7f2d7c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 -- 172.21.15.38:0/1898373558 >> 172.21.15.38:0/1898373558 conn(0x7f2d7c0ffa90 msgr2=0x7f2d7c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 -- 172.21.15.38:0/1898373558 shutdown_connections 2024-09-12T12:25:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.682+0000 7f2d83800640 1 -- 172.21.15.38:0/1898373558 wait complete. 2024-09-12T12:25:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 Processor -- start 2024-09-12T12:25:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 -- start start 2024-09-12T12:25:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c076720 0x7f2d7c1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c077040 0x7f2d7c1a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d7c112a30 0x7f2d7c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1185e0 con 0x7f2d7c077040 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c118460 con 0x7f2d7c112a30 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.684+0000 7f2d83800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c118760 con 0x7f2d7c076720 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c076720 0x7f2d7c1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c077040 0x7f2d7c1a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c076720 0x7f2d7c1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:34530/0 (socket says 172.21.15.38:34530) 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 -- 172.21.15.38:0/249650153 learned_addr learned my addr 172.21.15.38:0/249650153 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d81800640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d7c112a30 0x7f2d7c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 -- 172.21.15.38:0/249650153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d7c112a30 msgr2=0x7f2d7c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d7c112a30 0x7f2d7c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 -- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c077040 msgr2=0x7f2d7c1a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c077040 0x7f2d7c1a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 -- 172.21.15.38:0/249650153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c19f040 con 0x7f2d7c076720 2024-09-12T12:25:07.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d7be00640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c077040 0x7f2d7c1a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:07.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.685+0000 7f2d80e00640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c076720 0x7f2d7c1a4750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e9f0 tx=0x7f2d7000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.686+0000 7f2d79600640 1 -- 172.21.15.38:0/249650153 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7000cd80 con 0x7f2d7c076720 2024-09-12T12:25:07.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.686+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c19f330 con 0x7f2d7c076720 2024-09-12T12:25:07.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.686+0000 7f2d79600640 1 -- 172.21.15.38:0/249650153 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d70010910 con 0x7f2d7c076720 2024-09-12T12:25:07.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.686+0000 7f2d79600640 1 -- 172.21.15.38:0/249650153 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d700188f0 con 0x7f2d7c076720 2024-09-12T12:25:07.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.686+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c1ab620 con 0x7f2d7c076720 2024-09-12T12:25:07.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 Processor -- start 2024-09-12T12:25:07.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 -- start start 2024-09-12T12:25:07.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd77710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd81fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 0x564e2bd84900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d79600640 1 -- 172.21.15.38:0/249650153 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2d70010ac0 con 0x7f2d7c076720 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564e2bcdd0b0 con 0x564e2bd77330 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564e2bc84ab0 con 0x564e2bd77c50 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.689+0000 7f2d861c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e2bcd9070 con 0x564e2bd82510 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd77710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 0x564e2bd84900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd77710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36204/0 (socket says 172.21.15.38:36204) 2024-09-12T12:25:07.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 -- 172.21.15.38:0/2041657536 learned_addr learned my addr 172.21.15.38:0/2041657536 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:07.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d80e00640 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd81fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 -- 172.21.15.38:0/2041657536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 msgr2=0x564e2bd84900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 0x564e2bd84900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 -- 172.21.15.38:0/2041657536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 msgr2=0x564e2bd81fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd81fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.690+0000 7f2d81800640 1 -- 172.21.15.38:0/2041657536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e2bc914a0 con 0x564e2bd77330 2024-09-12T12:25:07.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.691+0000 7f2d81800640 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd77710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c07aa10 tx=0x7f2d74005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f934360d40c45a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.691+0000 7f2d6e000640 1 -- 172.21.15.38:0/2041657536 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74031db0 con 0x564e2bd77330 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.691+0000 7f2d6e000640 1 -- 172.21.15.38:0/2041657536 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d74036030 con 0x564e2bd77330 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.691+0000 7f2d6e000640 1 -- 172.21.15.38:0/2041657536 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74004280 con 0x564e2bd77330 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.691+0000 7f2d79600640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d640a2b80 0x7f2d640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.691+0000 7f2d79600640 1 -- 172.21.15.38:0/249650153 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2d700cf850 con 0x7f2d7c076720 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d80e00640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d640a2b80 0x7f2d640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 -- 172.21.15.38:0/2041657536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 msgr2=0x564e2bd77710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd77710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c07aa10 tx=0x7f2d74005f80 comp rx=0 tx=0).stop 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 -- 172.21.15.38:0/2041657536 shutdown_connections 2024-09-12T12:25:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 0x564e2bd84900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd81fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2041657536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd77710 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 -- 172.21.15.38:0/2041657536 >> 172.21.15.38:0/2041657536 conn(0x564e2bd738c0 msgr2=0x564e2bd73ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 -- 172.21.15.38:0/2041657536 shutdown_connections 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d861c0740 1 -- 172.21.15.38:0/2041657536 wait complete. 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.692+0000 7f2d80e00640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d640a2b80 0x7f2d640a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d700981b0 tx=0x7f2d700d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 -- start start 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 Processor -- start 2024-09-12T12:25:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd7f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd7f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 0x564e2bd7fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd85000 con 0x564e2bd77330 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564e2bc65920 con 0x564e2bd77c50 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd85180 con 0x564e2bd82510 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.693+0000 7f2d861c0740 10 client.0 _ll_register_callbacks cb 0x564e2bc898a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd7f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd7f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:50538/0 (socket says 172.21.15.38:50538) 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 -- 172.21.15.38:0/2221317757 learned_addr learned my addr 172.21.15.38:0/2221317757 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d81800640 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd7f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 -- 172.21.15.38:0/2221317757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 msgr2=0x564e2bd7fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 0x564e2bd7fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 -- 172.21.15.38:0/2221317757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 msgr2=0x564e2bd7f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd7f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 -- 172.21.15.38:0/2221317757 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e2ba4e2b0 con 0x564e2bd77c50 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d7be00640 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd7f990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d68012d20 tx=0x7f2d6800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969545b569d46cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.694+0000 7f2d62a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d62a00640 1 -- 172.21.15.38:0/2221317757 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680120d0 con 0x564e2bd77c50 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d62a00640 1 -- 172.21.15.38:0/2221317757 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2d680047a0 con 0x564e2bd77c50 2024-09-12T12:25:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d74036030 con 0x564e2bd77c50 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d62a00640 1 -- 172.21.15.38:0/2221317757 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d68012270 con 0x564e2bd77c50 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d861c0740 10 client.25031 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e2bd90c50 con 0x564e2bd77c50 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d62a00640 1 -- 172.21.15.38:0/2221317757 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d74036030 con 0x564e2bd77c50 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d62a00640 1 -- 172.21.15.38:0/2221317757 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2d68010690 con 0x564e2bd77c50 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.695+0000 7f2d861c0740 10 client.25031 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.696+0000 7f2d861c0740 10 client.25031 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.696+0000 7f2d861c0740 20 client.25031 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.696+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2bd932c0 0x564e2bd94730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.696+0000 7f2d861c0740 4 client.25031 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.696+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e2bcea620 con 0x564e2bd932c0 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.696+0000 7f2d81800640 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2bd932c0 0x564e2bd94730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.697+0000 7f2d81800640 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2bd932c0 0x564e2bd94730 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35d9310fb4e41929 server_cookie=ba746126f35dd6b8 in_seq=0 out_seq=0 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.697+0000 7f2d62a00640 10 client.25031 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.697+0000 7f2d62a00640 1 -- 172.21.15.38:0/2221317757 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e2bcea620 con 0x564e2bd932c0 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.697+0000 7f2d62a00640 10 client.25031 handle_command_reply: tid=0 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.697+0000 7f2d861c0740 1 client.25031 shutdown 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 msgr2=0x564e2bd7f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd7f990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d68012d20 tx=0x7f2d6800f790 comp rx=0 tx=0).stop 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 shutdown_connections 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2bd932c0 0x564e2bd94730 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd82510 0x564e2bd7fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd7f990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2221317757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd77330 0x564e2bd7f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d62a00640 0 client.25031 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 >> 172.21.15.38:0/2221317757 conn(0x564e2bd738c0 msgr2=0x564e2bd795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 shutdown_connections 2024-09-12T12:25:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 1 -- 172.21.15.38:0/2221317757 wait complete. 2024-09-12T12:25:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.698+0000 7f2d861c0740 20 client.25031 trim_cache size 0 max 16384 2024-09-12T12:25:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 Processor -- start 2024-09-12T12:25:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 -- start start 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77330 0x564e2bd7fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77c50 0x564e2bd7c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd7cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd92a70 con 0x564e2bd82510 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd93140 con 0x564e2bd77330 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.717+0000 7f2d861c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd93810 con 0x564e2bd77c50 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77c50 0x564e2bd7c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d81800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77330 0x564e2bd7fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77c50 0x564e2bd7c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:34572/0 (socket says 172.21.15.38:34572) 2024-09-12T12:25:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 -- 172.21.15.38:0/400068202 learned_addr learned my addr 172.21.15.38:0/400068202 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d81800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77330 0x564e2bd7fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:50544/0 (socket says 172.21.15.38:50544) 2024-09-12T12:25:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d81800640 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd7cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 -- 172.21.15.38:0/400068202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77330 msgr2=0x564e2bd7fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77330 0x564e2bd7fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 -- 172.21.15.38:0/400068202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 msgr2=0x564e2bd7cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd7cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 -- 172.21.15.38:0/400068202 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e2bd7d9a0 con 0x564e2bd77c50 2024-09-12T12:25:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.718+0000 7f2d7be00640 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77c50 0x564e2bd7c6b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d68010ca0 tx=0x7f2d68005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52456c344e717faa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d6d600640 1 -- 172.21.15.38:0/400068202 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680120d0 con 0x564e2bd77c50 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d6d600640 1 -- 172.21.15.38:0/400068202 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d68005080 con 0x564e2bd77c50 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d6d600640 1 -- 172.21.15.38:0/400068202 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68003950 con 0x564e2bd77c50 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 -- 172.21.15.38:0/400068202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77c50 msgr2=0x564e2bd7c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77c50 0x564e2bd7c6b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d68010ca0 tx=0x7f2d68005db0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 -- 172.21.15.38:0/400068202 shutdown_connections 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd7cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77c50 0x564e2bd7c6b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 --2- 172.21.15.38:0/400068202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77330 0x564e2bd7fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 -- 172.21.15.38:0/400068202 >> 172.21.15.38:0/400068202 conn(0x564e2bd738c0 msgr2=0x564e2bd7dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 -- 172.21.15.38:0/400068202 shutdown_connections 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.719+0000 7f2d861c0740 1 -- 172.21.15.38:0/400068202 wait complete. 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.720+0000 7f2d861c0740 1 -- start start 2024-09-12T12:25:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.720+0000 7f2d861c0740 1 Processor -- start 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77330 0x564e2bd96840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd96d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d861c0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d861c0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd945b0 con 0x564e2bd82510 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d861c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd93ee0 con 0x564e2bd77c50 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d861c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e2bd94c80 con 0x564e2bd77330 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d861c0740 10 client.0 _ll_register_callbacks cb 0x7f2d68012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d81800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77330 0x564e2bd96840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd96d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d81800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77330 0x564e2bd96840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:34586/0 (socket says 172.21.15.38:34586) 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d81800640 1 -- 172.21.15.38:0/2396901888 learned_addr learned my addr 172.21.15.38:0/2396901888 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd96d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:50550/0 (socket says 172.21.15.38:50550) 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d81800640 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d7be00640 1 -- 172.21.15.38:0/2396901888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77330 msgr2=0x564e2bd96840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d7be00640 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77330 0x564e2bd96840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d7be00640 1 -- 172.21.15.38:0/2396901888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 msgr2=0x564e2bd972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d7be00640 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.721+0000 7f2d7be00640 1 -- 172.21.15.38:0/2396901888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e2bd9b130 con 0x564e2bd77c50 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d7be00640 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd96d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x564e2bd73890 tx=0x7f2d6800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ad8b1e525b8cad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d62a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d62a00640 1 -- 172.21.15.38:0/2396901888 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680120d0 con 0x564e2bd77c50 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d68005080 con 0x564e2bd77c50 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d62a00640 1 -- 172.21.15.38:0/2396901888 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2d680036d0 con 0x564e2bd77c50 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d62a00640 1 -- 172.21.15.38:0/2396901888 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d68003910 con 0x564e2bd77c50 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d861c0740 10 client.25037 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:07.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.722+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e2bdfdda0 con 0x564e2bd77c50 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d62a00640 1 -- 172.21.15.38:0/2396901888 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d68005080 con 0x564e2bd77c50 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d62a00640 1 -- 172.21.15.38:0/2396901888 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2d6801ca40 con 0x564e2bd77c50 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d861c0740 10 client.25037 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d861c0740 10 client.25037 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d861c0740 20 client.25037 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2be027b0 0x564e2be014c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d861c0740 4 client.25037 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.723+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "status"}) -- 0x564e2bce4b30 con 0x564e2be027b0 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.724+0000 7f2d81800640 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2be027b0 0x564e2be014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.724+0000 7f2d81800640 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2be027b0 0x564e2be014c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2fc1dc2401eed1a server_cookie=e08f1878a2e674cf in_seq=0 out_seq=0 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.724+0000 7f2d62a00640 10 client.25037 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.724+0000 7f2d62a00640 1 -- 172.21.15.38:0/2396901888 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564e2bce4b30 con 0x564e2be027b0 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.724+0000 7f2d62a00640 10 client.25037 handle_command_reply: tid=0 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.724+0000 7f2d861c0740 1 client.25037 shutdown 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 msgr2=0x564e2bd96d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd96d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x564e2bd73890 tx=0x7f2d6800f790 comp rx=0 tx=0).stop 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 shutdown_connections 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564e2be027b0 0x564e2be014c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564e2bd82510 0x564e2bd972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e2bd77c50 0x564e2bd96d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 --2- 172.21.15.38:0/2396901888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e2bd77330 0x564e2bd96840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 >> 172.21.15.38:0/2396901888 conn(0x564e2bd738c0 msgr2=0x564e2bd78d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d62a00640 0 client.25037 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 shutdown_connections 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 1 -- 172.21.15.38:0/2396901888 wait complete. 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.725+0000 7f2d861c0740 20 client.25037 trim_cache size 0 max 16384 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:07.732 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 2, 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24515, 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 82.585081674999998, 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 157.424857411 2024-09-12T12:25:07.733 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d640a2b80 msgr2=0x7f2d640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d640a2b80 0x7f2d640a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d700981b0 tx=0x7f2d700d5530 comp rx=0 tx=0).stop 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c076720 msgr2=0x7f2d7c1a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c076720 0x7f2d7c1a4750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e9f0 tx=0x7f2d7000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 shutdown_connections 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2d640a2b80 0x7f2d640a5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d7c112a30 0x7f2d7c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7c077040 0x7f2d7c1a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 --2- 172.21.15.38:0/249650153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d7c076720 0x7f2d7c1a4750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 >> 172.21.15.38:0/249650153 conn(0x7f2d7c0ffa90 msgr2=0x7f2d7c113630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 shutdown_connections 2024-09-12T12:25:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:07.726+0000 7f2d83800640 1 -- 172.21.15.38:0/249650153 wait complete. 2024-09-12T12:25:08.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:08 smithi071 ceph-mon[34859]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:08.322 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:08 smithi038 ceph-mon[30810]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:08 smithi154 ceph-mon[35578]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:08.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:25:08.958 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:09.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 -- 172.21.15.38:0/3867843562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0106f10 msgr2=0x7f88e010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 --2- 172.21.15.38:0/3867843562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0106f10 0x7f88e010ea90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009ca0 tx=0x7f88d802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 -- 172.21.15.38:0/3867843562 shutdown_connections 2024-09-12T12:25:09.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 --2- 172.21.15.38:0/3867843562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0106f10 0x7f88e010ea90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 --2- 172.21.15.38:0/3867843562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88e0102790 0x7f88e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 --2- 172.21.15.38:0/3867843562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e0101de0 0x7f88e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 -- 172.21.15.38:0/3867843562 >> 172.21.15.38:0/3867843562 conn(0x7f88e00fd8c0 msgr2=0x7f88e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.552+0000 7f88e7e00640 1 -- 172.21.15.38:0/3867843562 shutdown_connections 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.553+0000 7f88e7e00640 1 -- 172.21.15.38:0/3867843562 wait complete. 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.553+0000 7f88e7e00640 1 Processor -- start 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e7e00640 1 -- start start 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0101de0 0x7f88e019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e0102790 0x7f88e019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88e0106f10 0x7f88e019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e7e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0111f70 con 0x7f88e0101de0 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e7e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0111df0 con 0x7f88e0106f10 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e7e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88e01120f0 con 0x7f88e0102790 2024-09-12T12:25:09.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e5400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0101de0 0x7f88e019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e5400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0101de0 0x7f88e019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36272/0 (socket says 172.21.15.38:36272) 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e5400640 1 -- 172.21.15.38:0/1236430297 learned_addr learned my addr 172.21.15.38:0/1236430297 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e4a00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e0102790 0x7f88e019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.554+0000 7f88e5e00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88e0106f10 0x7f88e019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88e5400640 1 -- 172.21.15.38:0/1236430297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e0102790 msgr2=0x7f88e019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88e5400640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e0102790 0x7f88e019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88e5400640 1 -- 172.21.15.38:0/1236430297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88e0106f10 msgr2=0x7f88e019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88e5400640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88e0106f10 0x7f88e019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88e5400640 1 -- 172.21.15.38:0/1236430297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e019f620 con 0x7f88e0101de0 2024-09-12T12:25:09.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88e5400640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0101de0 0x7f88e019a670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f88d400e9f0 tx=0x7f88d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88de000640 1 -- 172.21.15.38:0/1236430297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d400cd80 con 0x7f88e0101de0 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88de000640 1 -- 172.21.15.38:0/1236430297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d4005500 con 0x7f88e0101de0 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88de000640 1 -- 172.21.15.38:0/1236430297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4010690 con 0x7f88e0101de0 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.555+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e019f910 con 0x7f88e0101de0 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.556+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e01a71f0 con 0x7f88e0101de0 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.558+0000 7f88ea8a1740 1 Processor -- start 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88ea8a1740 1 -- start start 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88de000640 1 -- 172.21.15.38:0/1236430297 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f88d40046c0 con 0x7f88e0101de0 2024-09-12T12:25:09.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a79710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79c50 0x55ae85a83fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a86900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ae859df0b0 con 0x55ae85a79330 2024-09-12T12:25:09.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae85986ab0 con 0x55ae85a79c50 2024-09-12T12:25:09.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae859db070 con 0x55ae85a84510 2024-09-12T12:25:09.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88e5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a79710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88e5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a79710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36282/0 (socket says 172.21.15.38:36282) 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88e5e00640 1 -- 172.21.15.38:0/2283058275 learned_addr learned my addr 172.21.15.38:0/2283058275 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88e5400640 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79c50 0x55ae85a83fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.559+0000 7f88e4a00640 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a86900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88e5e00640 1 -- 172.21.15.38:0/2283058275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 msgr2=0x55ae85a86900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88e5e00640 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a86900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88e5e00640 1 -- 172.21.15.38:0/2283058275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79c50 msgr2=0x55ae85a83fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88e5e00640 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79c50 0x55ae85a83fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88e5e00640 1 -- 172.21.15.38:0/2283058275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae859934a0 con 0x55ae85a79330 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88e5e00640 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a79710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009ca0 tx=0x7f88d8005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83c5e18059c34b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88de000640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f88c80a2b80 0x7f88c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.560+0000 7f88d2600640 1 -- 172.21.15.38:0/2283058275 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8031db0 con 0x55ae85a79330 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88d2600640 1 -- 172.21.15.38:0/2283058275 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d8036040 con 0x55ae85a79330 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88d2600640 1 -- 172.21.15.38:0/2283058275 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d80042a0 con 0x55ae85a79330 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88de000640 1 -- 172.21.15.38:0/1236430297 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f88d40cf830 con 0x7f88e0101de0 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88e5400640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f88c80a2b80 0x7f88c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88ea8a1740 1 -- 172.21.15.38:0/2283058275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 msgr2=0x55ae85a79710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a79710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009ca0 tx=0x7f88d8005f10 comp rx=0 tx=0).stop 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88e5400640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f88c80a2b80 0x7f88c80a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88d40980e0 tx=0x7f88d40d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88ea8a1740 1 -- 172.21.15.38:0/2283058275 shutdown_connections 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a86900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79c50 0x55ae85a83fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/2283058275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a79710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.561+0000 7f88ea8a1740 1 -- 172.21.15.38:0/2283058275 >> 172.21.15.38:0/2283058275 conn(0x55ae85a758c0 msgr2=0x55ae85a75ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.562+0000 7f88ea8a1740 1 -- 172.21.15.38:0/2283058275 shutdown_connections 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.562+0000 7f88ea8a1740 1 -- 172.21.15.38:0/2283058275 wait complete. 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.562+0000 7f88ea8a1740 1 -- start start 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.562+0000 7f88ea8a1740 1 Processor -- start 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79330 0x55ae85a81450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a81990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85a81ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a87000 con 0x55ae85a79c50 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae85967920 con 0x55ae85a84510 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a87180 con 0x55ae85a79330 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88ea8a1740 10 client.0 _ll_register_callbacks cb 0x55ae8598b8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a81990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a81990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36288/0 (socket says 172.21.15.38:36288) 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 -- 172.21.15.38:0/916050375 learned_addr learned my addr 172.21.15.38:0/916050375 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e5e00640 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79330 0x55ae85a81450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e5e00640 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85a81ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 -- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79330 msgr2=0x55ae85a81450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79330 0x55ae85a81450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 -- 172.21.15.38:0/916050375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 msgr2=0x55ae85a81ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85a81ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.563+0000 7f88e4a00640 1 -- 172.21.15.38:0/916050375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae857502b0 con 0x55ae85a79c50 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88e4a00640 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a81990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f88cc012730 tx=0x7f88cc012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1d30331c1cc36d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88c6a00640 1 -- 172.21.15.38:0/916050375 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00f8c0 con 0x55ae85a79c50 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88d8036040 con 0x55ae85a79c50 2024-09-12T12:25:09.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88c6a00640 1 -- 172.21.15.38:0/916050375 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f88cc00fa60 con 0x55ae85a79c50 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88c6a00640 1 -- 172.21.15.38:0/916050375 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f88cc00fc60 con 0x55ae85a79c50 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88ea8a1740 10 client.15033 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ae85a92c50 con 0x55ae85a79c50 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.564+0000 7f88c6a00640 1 -- 172.21.15.38:0/916050375 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d8036040 con 0x55ae85a79c50 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88c6a00640 1 -- 172.21.15.38:0/916050375 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f88cc010550 con 0x55ae85a79c50 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88ea8a1740 10 client.15033 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88ea8a1740 10 client.15033 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88ea8a1740 20 client.15033 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85a95280 0x55ae85a966f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88ea8a1740 4 client.15033 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae859ec620 con 0x55ae85a95280 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.565+0000 7f88e5e00640 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85a95280 0x55ae85a966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.566+0000 7f88e5e00640 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85a95280 0x55ae85a966f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f8945cb7c6709fa server_cookie=7c5faa48e7ceaad in_seq=0 out_seq=0 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.566+0000 7f88c6a00640 10 client.15033 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88c6a00640 1 -- 172.21.15.38:0/916050375 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae859ec620 con 0x55ae85a95280 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88c6a00640 10 client.15033 handle_command_reply: tid=0 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 client.15033 shutdown 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 msgr2=0x55ae85a81990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a81990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f88cc012730 tx=0x7f88cc012bf0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 shutdown_connections 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85a95280 0x55ae85a966f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85a81ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a81990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/916050375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79330 0x55ae85a81450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 >> 172.21.15.38:0/916050375 conn(0x55ae85a758c0 msgr2=0x55ae85a7b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88c6a00640 0 client.15033 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:09.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 shutdown_connections 2024-09-12T12:25:09.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 1 -- 172.21.15.38:0/916050375 wait complete. 2024-09-12T12:25:09.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.567+0000 7f88ea8a1740 20 client.15033 trim_cache size 0 max 16384 2024-09-12T12:25:09.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 Processor -- start 2024-09-12T12:25:09.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 -- start start 2024-09-12T12:25:09.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79330 0x55ae85a966f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a7fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a80260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a94a30 con 0x55ae85a79c50 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a95100 con 0x55ae85a79330 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a957d0 con 0x55ae85a84510 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88e5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79330 0x55ae85a966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88e4a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a7fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88e5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79330 0x55ae85a966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:50602/0 (socket says 172.21.15.38:50602) 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88e5e00640 1 -- 172.21.15.38:0/1034958370 learned_addr learned my addr 172.21.15.38:0/1034958370 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.587+0000 7f88e5e00640 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a80260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88e5e00640 1 -- 172.21.15.38:0/1034958370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 msgr2=0x55ae85a80260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88e5e00640 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a80260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88e5e00640 1 -- 172.21.15.38:0/1034958370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 msgr2=0x55ae85a7fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88e5e00640 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a7fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88e5e00640 1 -- 172.21.15.38:0/1034958370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae85a79160 con 0x55ae85a79330 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88e4a00640 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a7fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88e5e00640 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79330 0x55ae85a966f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88d8031940 tx=0x7f88d8005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70c39930b029ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88d1c00640 1 -- 172.21.15.38:0/1034958370 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d80315a0 con 0x55ae85a79330 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88d1c00640 1 -- 172.21.15.38:0/1034958370 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d8036070 con 0x55ae85a79330 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.588+0000 7f88d1c00640 1 -- 172.21.15.38:0/1034958370 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8030a80 con 0x55ae85a79330 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 -- 172.21.15.38:0/1034958370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79330 msgr2=0x55ae85a966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79330 0x55ae85a966f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88d8031940 tx=0x7f88d8005f10 comp rx=0 tx=0).stop 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 -- 172.21.15.38:0/1034958370 shutdown_connections 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a84510 0x55ae85a80260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79c50 0x55ae85a7fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/1034958370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a79330 0x55ae85a966f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 -- 172.21.15.38:0/1034958370 >> 172.21.15.38:0/1034958370 conn(0x55ae85a758c0 msgr2=0x55ae85a70640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 -- 172.21.15.38:0/1034958370 shutdown_connections 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 -- 172.21.15.38:0/1034958370 wait complete. 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.589+0000 7f88ea8a1740 1 -- start start 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 1 Processor -- start 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79c50 0x55ae85a983f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85afd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a96570 con 0x55ae85a79330 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a95ea0 con 0x55ae85a84510 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae85a96c40 con 0x55ae85a79c50 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88ea8a1740 10 client.0 _ll_register_callbacks cb 0x7f88cc009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88e4a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79c50 0x55ae85a983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88e4a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79c50 0x55ae85a983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:34646/0 (socket says 172.21.15.38:34646) 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88e4a00640 1 -- 172.21.15.38:0/3059945699 learned_addr learned my addr 172.21.15.38:0/3059945699 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.590+0000 7f88e5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e5e00640 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85afd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e4a00640 1 -- 172.21.15.38:0/3059945699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 msgr2=0x55ae85afd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e4a00640 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85afd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e4a00640 1 -- 172.21.15.38:0/3059945699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 msgr2=0x55ae85a97eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e4a00640 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a97eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e4a00640 1 -- 172.21.15.38:0/3059945699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae85afdec0 con 0x55ae85a79c50 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e5e00640 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85afd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88e4a00640 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79c50 0x55ae85a983f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88cc000c00 tx=0x7f88cc0096b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=934185ff9884dcf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:25:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88c6a00640 1 -- 172.21.15.38:0/3059945699 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc02d070 con 0x55ae85a79c50 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88c6a00640 1 -- 172.21.15.38:0/3059945699 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f88cc018040 con 0x55ae85a79c50 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.591+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88d8036070 con 0x55ae85a79c50 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88c6a00640 1 -- 172.21.15.38:0/3059945699 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f88cc036050 con 0x55ae85a79c50 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 10 client.25042 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ae85aff140 con 0x55ae85a79c50 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88c6a00640 1 -- 172.21.15.38:0/3059945699 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d8036070 con 0x55ae85a79c50 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88c6a00640 1 -- 172.21.15.38:0/3059945699 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f88cc030020 con 0x55ae85a79c50 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 10 client.25042 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 10 client.25042 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 20 client.25042 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85b03da0 0x55ae85b02ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 4 client.25042 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.592+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "status"}) -- 0x55ae859e6b30 con 0x55ae85b03da0 2024-09-12T12:25:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.593+0000 7f88e5e00640 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85b03da0 0x55ae85b02ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.593+0000 7f88e5e00640 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85b03da0 0x55ae85b02ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5aa77eefea60e4f6 server_cookie=2d0af56320bd491e in_seq=0 out_seq=0 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.593+0000 7f88c6a00640 10 client.25042 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88c6a00640 1 -- 172.21.15.38:0/3059945699 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ae859e6b30 con 0x55ae85b03da0 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88c6a00640 10 client.25042 handle_command_reply: tid=0 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 client.25042 shutdown 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79c50 msgr2=0x55ae85a983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79c50 0x55ae85a983f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88cc000c00 tx=0x7f88cc0096b0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 shutdown_connections 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55ae85b03da0 0x55ae85b02ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ae85a84510 0x55ae85afd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae85a79c50 0x55ae85a983f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 --2- 172.21.15.38:0/3059945699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae85a79330 0x55ae85a97eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88c6a00640 0 client.25042 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 >> 172.21.15.38:0/3059945699 conn(0x55ae85a758c0 msgr2=0x55ae85a7f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 shutdown_connections 2024-09-12T12:25:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 1 -- 172.21.15.38:0/3059945699 wait complete. 2024-09-12T12:25:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.594+0000 7f88ea8a1740 20 client.25042 trim_cache size 0 max 16384 2024-09-12T12:25:09.604 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:09.604 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:09.604 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 1, 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24529, 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 85.463838847999995, 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 156.557394754 2024-09-12T12:25:09.605 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:09.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f88c80a2b80 msgr2=0x7f88c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f88c80a2b80 0x7f88c80a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88d40980e0 tx=0x7f88d40d5530 comp rx=0 tx=0).stop 2024-09-12T12:25:09.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0101de0 msgr2=0x7f88e019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0101de0 0x7f88e019a670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f88d400e9f0 tx=0x7f88d400edf0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 shutdown_connections 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f88c80a2b80 0x7f88c80a5040 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88e0106f10 0x7f88e019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e0102790 0x7f88e019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 --2- 172.21.15.38:0/1236430297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88e0101de0 0x7f88e019a670 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 >> 172.21.15.38:0/1236430297 conn(0x7f88e00fd8c0 msgr2=0x7f88e00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 shutdown_connections 2024-09-12T12:25:09.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:09.595+0000 7f88e7e00640 1 -- 172.21.15.38:0/1236430297 wait complete. 2024-09-12T12:25:10.344 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:10 smithi038 ceph-mon[30810]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-12T12:25:10.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T12:25:10.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:10 smithi154 ceph-mon[35578]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-12T12:25:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:10 smithi071 ceph-mon[34859]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-12T12:25:10.758 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:11.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 -- 172.21.15.38:0/4175994199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0108f60 msgr2=0x7fcfb0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4175994199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0108f60 0x7fcfb0110ae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009ca0 tx=0x7fcfac02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 -- 172.21.15.38:0/4175994199 shutdown_connections 2024-09-12T12:25:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4175994199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0108f60 0x7fcfb0110ae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4175994199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb01047e0 0x7fcfb0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4175994199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfb0103e30 0x7fcfb0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 -- 172.21.15.38:0/4175994199 >> 172.21.15.38:0/4175994199 conn(0x7fcfb00ff910 msgr2=0x7fcfb0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 -- 172.21.15.38:0/4175994199 shutdown_connections 2024-09-12T12:25:11.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.355+0000 7fcfb7200640 1 -- 172.21.15.38:0/4175994199 wait complete. 2024-09-12T12:25:11.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 Processor -- start 2024-09-12T12:25:11.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 -- start start 2024-09-12T12:25:11.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0103e30 0x7fcfb019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb01047e0 0x7fcfb019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfb0108f60 0x7fcfb019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0113fc0 con 0x7fcfb0103e30 2024-09-12T12:25:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0113e40 con 0x7fcfb0108f60 2024-09-12T12:25:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.356+0000 7fcfb7200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0114140 con 0x7fcfb01047e0 2024-09-12T12:25:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0103e30 0x7fcfb019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0103e30 0x7fcfb019a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36330/0 (socket says 172.21.15.38:36330) 2024-09-12T12:25:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4194397934 learned_addr learned my addr 172.21.15.38:0/4194397934 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb6800640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfb0108f60 0x7fcfb019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5400640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb01047e0 0x7fcfb019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4194397934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb01047e0 msgr2=0x7fcfb019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb01047e0 0x7fcfb019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4194397934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfb0108f60 msgr2=0x7fcfb019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfb0108f60 0x7fcfb019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4194397934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb019f370 con 0x7fcfb0103e30 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.357+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0103e30 0x7fcfb019a3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e9f0 tx=0x7fcfa400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.358+0000 7fcfaaa00640 1 -- 172.21.15.38:0/4194397934 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400cd80 con 0x7fcfb0103e30 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.358+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb019f660 con 0x7fcfb0103e30 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.358+0000 7fcfaaa00640 1 -- 172.21.15.38:0/4194397934 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfa4010910 con 0x7fcfb0103e30 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.358+0000 7fcfaaa00640 1 -- 172.21.15.38:0/4194397934 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4018990 con 0x7fcfb0103e30 2024-09-12T12:25:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.358+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb01a6f40 con 0x7fcfb0103e30 2024-09-12T12:25:11.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.361+0000 7fcfaaa00640 1 -- 172.21.15.38:0/4194397934 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcfa4010ac0 con 0x7fcfb0103e30 2024-09-12T12:25:11.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.361+0000 7fcfbb409740 1 Processor -- start 2024-09-12T12:25:11.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.361+0000 7fcfbb409740 1 -- start start 2024-09-12T12:25:11.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b2cf0 0x55ef976b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976bd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfbb409740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ef976100b0 con 0x55ef976b3610 2024-09-12T12:25:11.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfbb409740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef975b7ab0 con 0x55ef976bded0 2024-09-12T12:25:11.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfbb409740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ef9760c070 con 0x55ef976b2cf0 2024-09-12T12:25:11.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976bd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36346/0 (socket says 172.21.15.38:36346) 2024-09-12T12:25:11.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfb5e00640 1 -- 172.21.15.38:0/626064597 learned_addr learned my addr 172.21.15.38:0/626064597 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:11.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfb6800640 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b2cf0 0x55ef976b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.362+0000 7fcfb5400640 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfb5e00640 1 -- 172.21.15.38:0/626064597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b2cf0 msgr2=0x55ef976b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b2cf0 0x55ef976b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfb5e00640 1 -- 172.21.15.38:0/626064597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 msgr2=0x55ef976c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfb5e00640 1 -- 172.21.15.38:0/626064597 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef975c44a0 con 0x55ef976b3610 2024-09-12T12:25:11.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfaaa00640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcf980a2b80 0x7fcf980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976bd990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40d5c20 tx=0x7fcfa40d7670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a0f6c7ded0681f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfaaa00640 1 -- 172.21.15.38:0/4194397934 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fcfa40cf810 con 0x7fcfb0103e30 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcf9f000640 1 -- 172.21.15.38:0/626064597 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4097f00 con 0x55ef976b3610 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcf9f000640 1 -- 172.21.15.38:0/626064597 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfa40b1070 con 0x55ef976b3610 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcfb6800640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcf980a2b80 0x7fcf980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.363+0000 7fcf9f000640 1 -- 172.21.15.38:0/626064597 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa409b5c0 con 0x55ef976b3610 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 -- 172.21.15.38:0/626064597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 msgr2=0x55ef976bd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976bd990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40d5c20 tx=0x7fcfa40d7670 comp rx=0 tx=0).stop 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 -- 172.21.15.38:0/626064597 shutdown_connections 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976bd990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 --2- 172.21.15.38:0/626064597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b2cf0 0x55ef976b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 -- 172.21.15.38:0/626064597 >> 172.21.15.38:0/626064597 conn(0x55ef976af280 msgr2=0x55ef976af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfb6800640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcf980a2b80 0x7fcf980a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcfac004af0 tx=0x7fcfac004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 -- 172.21.15.38:0/626064597 shutdown_connections 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.364+0000 7fcfbb409740 1 -- 172.21.15.38:0/626064597 wait complete. 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.365+0000 7fcfbb409740 1 -- start start 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.365+0000 7fcfbb409740 1 Processor -- start 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.365+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b2cf0 0x55ef976bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.365+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b3610 0x55ef976bb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.365+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976bb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfbb409740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ef976c0b40 con 0x55ef976b2cf0 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfbb409740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef97598920 con 0x55ef976bded0 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfbb409740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ef976c0cc0 con 0x55ef976b3610 2024-09-12T12:25:11.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfbb409740 10 client.0 _ll_register_callbacks cb 0x55ef975bc8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b2cf0 0x55ef976bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b2cf0 0x55ef976bad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36350/0 (socket says 172.21.15.38:36350) 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb5e00640 1 -- 172.21.15.38:0/3812821386 learned_addr learned my addr 172.21.15.38:0/3812821386 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb6800640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976bb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb5400640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b3610 0x55ef976bb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb6800640 1 -- 172.21.15.38:0/3812821386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b3610 msgr2=0x55ef976bb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb6800640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b3610 0x55ef976bb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb6800640 1 -- 172.21.15.38:0/3812821386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b2cf0 msgr2=0x55ef976bad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb6800640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b2cf0 0x55ef976bad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb6800640 1 -- 172.21.15.38:0/3812821386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef973812b0 con 0x55ef976bded0 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b2cf0 0x55ef976bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.366+0000 7fcfb5400640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b3610 0x55ef976bb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:11.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcfb6800640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976bb810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009bf0 tx=0x7fcfac02a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787cc8df2ede32f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcf93400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcf93400640 1 -- 172.21.15.38:0/3812821386 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac004250 con 0x55ef976bded0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa40b1070 con 0x55ef976bded0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcf93400640 1 -- 172.21.15.38:0/3812821386 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fcfac0043f0 con 0x55ef976bded0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcf93400640 1 -- 172.21.15.38:0/3812821386 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcfac05c050 con 0x55ef976bded0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcfbb409740 10 client.25064 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.367+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ef976cc810 con 0x55ef976bded0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcf93400640 1 -- 172.21.15.38:0/3812821386 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfa40b1070 con 0x55ef976bded0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcf93400640 1 -- 172.21.15.38:0/3812821386 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcfac0305c0 con 0x55ef976bded0 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcfbb409740 10 client.25064 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcfbb409740 10 client.25064 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcfbb409740 20 client.25064 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:11.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef976cee90 0x55ef976d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcfbb409740 4 client.25064 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:11.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef9761d620 con 0x55ef976cee90 2024-09-12T12:25:11.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.368+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef976cee90 0x55ef976d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.369+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef976cee90 0x55ef976d0300 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85c0c3904dcfdb4 server_cookie=1be5937b0ad4f0d2 in_seq=0 out_seq=0 2024-09-12T12:25:11.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.369+0000 7fcf93400640 10 client.25064 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:11.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcf93400640 1 -- 172.21.15.38:0/3812821386 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef9761d620 con 0x55ef976cee90 2024-09-12T12:25:11.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcf93400640 10 client.25064 handle_command_reply: tid=0 2024-09-12T12:25:11.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 client.25064 shutdown 2024-09-12T12:25:11.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 msgr2=0x55ef976bb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976bb810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009bf0 tx=0x7fcfac02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 shutdown_connections 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef976cee90 0x55ef976d0300 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976bded0 0x55ef976bb810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976b3610 0x55ef976bb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcf93400640 0 client.25064 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3812821386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b2cf0 0x55ef976bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 >> 172.21.15.38:0/3812821386 conn(0x55ef976af280 msgr2=0x55ef976a5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 shutdown_connections 2024-09-12T12:25:11.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 1 -- 172.21.15.38:0/3812821386 wait complete. 2024-09-12T12:25:11.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.370+0000 7fcfbb409740 20 client.25064 trim_cache size 0 max 16384 2024-09-12T12:25:11.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 Processor -- start 2024-09-12T12:25:11.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 -- start start 2024-09-12T12:25:11.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976b9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ef976ce640 con 0x55ef976b3610 2024-09-12T12:25:11.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef976ced10 con 0x55ef976b2cf0 2024-09-12T12:25:11.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.392+0000 7fcfbb409740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ef976cf3e0 con 0x55ef976bded0 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976b9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:50648/0 (socket says 172.21.15.38:50648) 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 -- 172.21.15.38:0/3283469444 learned_addr learned my addr 172.21.15.38:0/3283469444 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5400640 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb6800640 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 -- 172.21.15.38:0/3283469444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 msgr2=0x55ef976b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 -- 172.21.15.38:0/3283469444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 msgr2=0x55ef976b9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976b9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 -- 172.21.15.38:0/3283469444 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef976c0620 con 0x55ef976b2cf0 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb6800640 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.393+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976b9660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009380 tx=0x7fcfa4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff80192b67ec614a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcf9e600640 1 -- 172.21.15.38:0/3283469444 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40b4e60 con 0x55ef976b2cf0 2024-09-12T12:25:11.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcf9e600640 1 -- 172.21.15.38:0/3283469444 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfa40b1070 con 0x55ef976b2cf0 2024-09-12T12:25:11.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcf9e600640 1 -- 172.21.15.38:0/3283469444 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa409b7a0 con 0x55ef976b2cf0 2024-09-12T12:25:11.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcfbb409740 1 -- 172.21.15.38:0/3283469444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 msgr2=0x55ef976b9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976b9660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009380 tx=0x7fcfa4009310 comp rx=0 tx=0).stop 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcfbb409740 1 -- 172.21.15.38:0/3283469444 shutdown_connections 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976b9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcfbb409740 1 --2- 172.21.15.38:0/3283469444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976b9660 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.394+0000 7fcfbb409740 1 -- 172.21.15.38:0/3283469444 >> 172.21.15.38:0/3283469444 conn(0x55ef976af280 msgr2=0x55ef976b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.395+0000 7fcfbb409740 1 -- 172.21.15.38:0/3283469444 shutdown_connections 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.395+0000 7fcfbb409740 1 -- 172.21.15.38:0/3283469444 wait complete. 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.395+0000 7fcfbb409740 1 -- start start 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.395+0000 7fcfbb409740 1 Processor -- start 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976d8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976d8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfbb409740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfbb409740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ef976d0180 con 0x55ef976b3610 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfbb409740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef976cfab0 con 0x55ef976b2cf0 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfbb409740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ef976d0850 con 0x55ef976bded0 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfbb409740 10 client.0 _ll_register_callbacks cb 0x7fcfac003a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976d8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976d8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976d8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:50652/0 (socket says 172.21.15.38:50652) 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976d8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36372/0 (socket says 172.21.15.38:36372) 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4046612196 learned_addr learned my addr 172.21.15.38:0/4046612196 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb6800640 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4046612196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 msgr2=0x55ef976d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4046612196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 msgr2=0x55ef976d8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976d8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.396+0000 7fcfb5e00640 1 -- 172.21.15.38:0/4046612196 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef976d2350 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcfb5e00640 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976d8810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40d7b70 tx=0x7fcfa40d7ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc9f1c7ab1949f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcf93400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcf93400640 1 -- 172.21.15.38:0/4046612196 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40b4e60 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa40b1070 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcf93400640 1 -- 172.21.15.38:0/4046612196 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fcfa40cd010 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcf93400640 1 -- 172.21.15.38:0/4046612196 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcfa409ba30 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcfbb409740 10 client.25070 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.397+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ef976d6da0 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcf93400640 1 -- 172.21.15.38:0/4046612196 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfa40b1070 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcf93400640 1 -- 172.21.15.38:0/4046612196 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcfa40d5300 con 0x55ef976b2cf0 2024-09-12T12:25:11.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcfbb409740 10 client.25070 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcfbb409740 10 client.25070 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:25:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcfbb409740 20 client.25070 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcfbb409740 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef9773d4f0 0x55ef9773c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcfbb409740 4 client.25070 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "status"}) -- 0x55ef97617b30 con 0x55ef9773d4f0 2024-09-12T12:25:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.398+0000 7fcfb5400640 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef9773d4f0 0x55ef9773c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfb5400640 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef9773d4f0 0x55ef9773c200 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb182152ee09e818 server_cookie=370db42f6d2b2000 in_seq=0 out_seq=0 2024-09-12T12:25:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcf93400640 10 client.25070 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcf93400640 1 -- 172.21.15.38:0/4046612196 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ef97617b30 con 0x55ef9773d4f0 2024-09-12T12:25:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcf93400640 10 client.25070 handle_command_reply: tid=0 2024-09-12T12:25:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 client.25070 shutdown 2024-09-12T12:25:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 msgr2=0x55ef976d8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976d8810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40d7b70 tx=0x7fcfa40d7ec0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 shutdown_connections 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef9773d4f0 0x55ef9773c200 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef976bded0 0x55ef976d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef976b3610 0x55ef976d8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 --2- 172.21.15.38:0/4046612196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef976b2cf0 0x55ef976d8810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcf93400640 0 client.25070 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.399+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 >> 172.21.15.38:0/4046612196 conn(0x55ef976af280 msgr2=0x55ef976c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 shutdown_connections 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfbb409740 1 -- 172.21.15.38:0/4046612196 wait complete. 2024-09-12T12:25:11.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfbb409740 20 client.25070 trim_cache size 0 max 16384 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24557, 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 135.09637617600001, 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:11.405 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 148.35023592900001 2024-09-12T12:25:11.406 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:11.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcf980a2b80 msgr2=0x7fcf980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcf980a2b80 0x7fcf980a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcfac004af0 tx=0x7fcfac004a80 comp rx=0 tx=0).stop 2024-09-12T12:25:11.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0103e30 msgr2=0x7fcfb019a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0103e30 0x7fcfb019a3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e9f0 tx=0x7fcfa400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 shutdown_connections 2024-09-12T12:25:11.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcf980a2b80 0x7fcf980a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfb0108f60 0x7fcfb019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb01047e0 0x7fcfb019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 --2- 172.21.15.38:0/4194397934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfb0103e30 0x7fcfb019a3c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.400+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 >> 172.21.15.38:0/4194397934 conn(0x7fcfb00ff910 msgr2=0x7fcfb0100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.401+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 shutdown_connections 2024-09-12T12:25:11.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:11.401+0000 7fcfb7200640 1 -- 172.21.15.38:0/4194397934 wait complete. 2024-09-12T12:25:12.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:12 smithi038 ceph-mon[30810]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T12:25:12.260 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T12:25:12.260 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T12:25:12.269 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-12T12:25:12.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T12:25:12.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:12 smithi154 ceph-mon[35578]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T12:25:12.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:12 smithi071 ceph-mon[34859]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T12:25:12.644 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:13.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 -- 172.21.15.38:0/3764179826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4103e00 msgr2=0x7ff1d4104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 --2- 172.21.15.38:0/3764179826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4103e00 0x7ff1d4104200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009900 tx=0x7ff1c402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 -- 172.21.15.38:0/3764179826 shutdown_connections 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 --2- 172.21.15.38:0/3764179826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d4105920 0x7ff1d410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 --2- 172.21.15.38:0/3764179826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4104f60 0x7ff1d41053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 --2- 172.21.15.38:0/3764179826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4103e00 0x7ff1d4104200 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 -- 172.21.15.38:0/3764179826 >> 172.21.15.38:0/3764179826 conn(0x7ff1d40ff5b0 msgr2=0x7ff1d41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 -- 172.21.15.38:0/3764179826 shutdown_connections 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.208+0000 7ff1da600640 1 -- 172.21.15.38:0/3764179826 wait complete. 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 Processor -- start 2024-09-12T12:25:13.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 -- start start 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4103e00 0x7ff1d419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4104f60 0x7ff1d419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d4105920 0x7ff1d41a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d410fb00 con 0x7ff1d4104f60 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d410f980 con 0x7ff1d4103e00 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.209+0000 7ff1da600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d410fc80 con 0x7ff1d4105920 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4104f60 0x7ff1d419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4104f60 0x7ff1d419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36378/0 (socket says 172.21.15.38:36378) 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 -- 172.21.15.38:0/338250676 learned_addr learned my addr 172.21.15.38:0/338250676 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1d3400640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4103e00 0x7ff1d419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1d3e00640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d4105920 0x7ff1d41a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 -- 172.21.15.38:0/338250676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d4105920 msgr2=0x7ff1d41a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d4105920 0x7ff1d41a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 -- 172.21.15.38:0/338250676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4103e00 msgr2=0x7ff1d419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4103e00 0x7ff1d419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 -- 172.21.15.38:0/338250676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d41a1cf0 con 0x7ff1d4104f60 2024-09-12T12:25:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1d3400640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4103e00 0x7ff1d419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.210+0000 7ff1cbe00640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4104f60 0x7ff1d419a600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00e9c0 tx=0x7ff1bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.211+0000 7ff1d0c00640 1 -- 172.21.15.38:0/338250676 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00cd80 con 0x7ff1d4104f60 2024-09-12T12:25:13.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.211+0000 7ff1d0c00640 1 -- 172.21.15.38:0/338250676 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1bc0035f0 con 0x7ff1d4104f60 2024-09-12T12:25:13.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.211+0000 7ff1d0c00640 1 -- 172.21.15.38:0/338250676 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc010690 con 0x7ff1d4104f60 2024-09-12T12:25:13.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.211+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d41a1fe0 con 0x7ff1d4104f60 2024-09-12T12:25:13.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.211+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d41a24e0 con 0x7ff1d4104f60 2024-09-12T12:25:13.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.212+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d410b1a0 con 0x7ff1d4104f60 2024-09-12T12:25:13.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.214+0000 7ff1d0c00640 1 -- 172.21.15.38:0/338250676 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff1bc0037a0 con 0x7ff1d4104f60 2024-09-12T12:25:13.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.215+0000 7ff1d0c00640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1b80a2c30 0x7ff1b80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.215+0000 7ff1d0c00640 1 -- 172.21.15.38:0/338250676 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff1bc0cf750 con 0x7ff1d4104f60 2024-09-12T12:25:13.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.215+0000 7ff1d3400640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1b80a2c30 0x7ff1b80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.216+0000 7ff1d3400640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1b80a2c30 0x7ff1b80a50f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4031440 tx=0x7ff1c40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.220+0000 7ff1d0c00640 1 -- 172.21.15.38:0/338250676 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1bc09c2a0 con 0x7ff1d4104f60 2024-09-12T12:25:13.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.420+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff1d4062630 con 0x7ff1b80a2c30 2024-09-12T12:25:13.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.421+0000 7ff1d0c00640 1 -- 172.21.15.38:0/338250676 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff1d4062630 con 0x7ff1b80a2c30 2024-09-12T12:25:13.421 INFO:teuthology.orchestra.run.smithi038.stdout:Backend: cephadm 2024-09-12T12:25:13.422 INFO:teuthology.orchestra.run.smithi038.stdout:Available: Yes 2024-09-12T12:25:13.422 INFO:teuthology.orchestra.run.smithi038.stdout:Paused: No 2024-09-12T12:25:13.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1b80a2c30 msgr2=0x7ff1b80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1b80a2c30 0x7ff1b80a50f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4031440 tx=0x7ff1c40315b0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4104f60 msgr2=0x7ff1d419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4104f60 0x7ff1d419a600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00e9c0 tx=0x7ff1bc00ee80 comp rx=0 tx=0).stop 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 shutdown_connections 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1b80a2c30 0x7ff1b80a50f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d4105920 0x7ff1d41a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4104f60 0x7ff1d419a600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 --2- 172.21.15.38:0/338250676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d4103e00 0x7ff1d419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 >> 172.21.15.38:0/338250676 conn(0x7ff1d40ff5b0 msgr2=0x7ff1d4108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.424+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 shutdown_connections 2024-09-12T12:25:13.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:13.425+0000 7ff1da600640 1 -- 172.21.15.38:0/338250676 wait complete. 2024-09-12T12:25:14.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T12:25:14.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:14 smithi154 ceph-mon[35578]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T12:25:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:14 smithi038 ceph-mon[30810]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T12:25:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:14 smithi071 ceph-mon[34859]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T12:25:14.547 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:15.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.126+0000 7f8c9b200640 1 -- 172.21.15.38:0/3971403970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 msgr2=0x7f8c9c104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.126+0000 7f8c9b200640 1 --2- 172.21.15.38:0/3971403970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c104050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009900 tx=0x7f8c8c02a410 comp rx=0 tx=0).stop 2024-09-12T12:25:15.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.126+0000 7f8c9b200640 1 -- 172.21.15.38:0/3971403970 shutdown_connections 2024-09-12T12:25:15.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.126+0000 7f8c9b200640 1 --2- 172.21.15.38:0/3971403970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c105810 0x7f8c9c10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.126+0000 7f8c9b200640 1 --2- 172.21.15.38:0/3971403970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c9c104e50 0x7f8c9c1052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.126+0000 7f8c9b200640 1 --2- 172.21.15.38:0/3971403970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c104050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.126+0000 7f8c9b200640 1 -- 172.21.15.38:0/3971403970 >> 172.21.15.38:0/3971403970 conn(0x7f8c9c0ff3e0 msgr2=0x7f8c9c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.127+0000 7f8c9b200640 1 -- 172.21.15.38:0/3971403970 shutdown_connections 2024-09-12T12:25:15.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.127+0000 7f8c9b200640 1 -- 172.21.15.38:0/3971403970 wait complete. 2024-09-12T12:25:15.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 Processor -- start 2024-09-12T12:25:15.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 -- start start 2024-09-12T12:25:15.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c104e50 0x7f8c9c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c9c105810 0x7f8c9c1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c10f900 con 0x7f8c9c103c50 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c10f780 con 0x7f8c9c105810 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9b200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c10fa80 con 0x7f8c9c104e50 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c99e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c99e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36396/0 (socket says 172.21.15.38:36396) 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c99e00640 1 -- 172.21.15.38:0/2113992014 learned_addr learned my addr 172.21.15.38:0/2113992014 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.128+0000 7f8c9a800640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c9c105810 0x7f8c9c1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.129+0000 7f8c99400640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c104e50 0x7f8c9c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.129+0000 7f8c99e00640 1 -- 172.21.15.38:0/2113992014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c104e50 msgr2=0x7f8c9c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.129+0000 7f8c99e00640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c104e50 0x7f8c9c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.129+0000 7f8c99e00640 1 -- 172.21.15.38:0/2113992014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c9c105810 msgr2=0x7f8c9c1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.129+0000 7f8c99e00640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c9c105810 0x7f8c9c1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.129+0000 7f8c99e00640 1 -- 172.21.15.38:0/2113992014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9c1a1b20 con 0x7f8c9c103c50 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.129+0000 7f8c99e00640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c199ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c031440 tx=0x7f8c8c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.130+0000 7f8c92a00640 1 -- 172.21.15.38:0/2113992014 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c03f030 con 0x7f8c9c103c50 2024-09-12T12:25:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.130+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9c1a1db0 con 0x7f8c9c103c50 2024-09-12T12:25:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.130+0000 7f8c92a00640 1 -- 172.21.15.38:0/2113992014 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c8c003ce0 con 0x7f8c9c103c50 2024-09-12T12:25:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.130+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9c1a2200 con 0x7f8c9c103c50 2024-09-12T12:25:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.130+0000 7f8c92a00640 1 -- 172.21.15.38:0/2113992014 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c049060 con 0x7f8c9c103c50 2024-09-12T12:25:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.131+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9c10afa0 con 0x7f8c9c103c50 2024-09-12T12:25:15.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.133+0000 7f8c92a00640 1 -- 172.21.15.38:0/2113992014 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8c8c042030 con 0x7f8c9c103c50 2024-09-12T12:25:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.134+0000 7f8c92a00640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8c800a2bb0 0x7f8c800a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.134+0000 7f8c92a00640 1 -- 172.21.15.38:0/2113992014 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f8c8c0efc10 con 0x7f8c9c103c50 2024-09-12T12:25:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.134+0000 7f8c99400640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8c800a2bb0 0x7f8c800a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.135+0000 7f8c99400640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8c800a2bb0 0x7f8c800a5070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c19b410 tx=0x7f8c88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.138+0000 7f8c92a00640 1 -- 172.21.15.38:0/2113992014 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c8c0bc170 con 0x7f8c9c103c50 2024-09-12T12:25:15.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.330+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8c9c062630 con 0x7f8c800a2bb0 2024-09-12T12:25:15.331 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:15 smithi038 ceph-mon[30810]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:15.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.343+0000 7f8c92a00640 1 -- 172.21.15.38:0/2113992014 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f8c9c062630 con 0x7f8c800a2bb0 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.a smithi038 running (2m) 16s ago 2m 16.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 6f950a63d341 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.b smithi071 running (2m) 18s ago 2m 29.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 dee456579696 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.c smithi154 running (2m) 18s ago 2m 21.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 b87446bf4776 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.d smithi038 running (2m) 16s ago 2m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 970ee6ccd4e6 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.e smithi071 running (2m) 18s ago 2m 18.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 d0c09cffebc9 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.f smithi154 running (2m) 18s ago 2m 20.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 3d8d71f6c610 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.g smithi038 running (2m) 16s ago 2m 16.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 f73c55f9588c 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.h smithi071 running (2m) 18s ago 2m 18.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 9eea637ebef1 2024-09-12T12:25:15.344 INFO:teuthology.orchestra.run.smithi038.stdout:mds.i smithi154 running (2m) 18s ago 2m 18.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 f0976629c838 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mds.j smithi038 running (3m) 16s ago 2m 13.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 138e3e55a3fe 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mds.k smithi071 running (3m) 18s ago 3m 17.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 4e02d3284e69 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mds.l smithi154 running (3m) 18s ago 3m 19.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 441e1918bc5b 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.x smithi038 *:9283,8765 running (10m) 16s ago 10m 512M - 19.1.1-298-gb53b6d3e 54467abc55f8 ee7af3f1505d 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.y smithi071 *:8443,8765 running (8m) 18s ago 8m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 7e7c795f14dc 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.z smithi154 *:8443,8765 running (8m) 18s ago 8m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 3fda7892dadd 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mon.a smithi038 running (10m) 16s ago 10m 50.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 5a06de85b7ac 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mon.b smithi071 running (8m) 18s ago 8m 42.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 21bd368039d0 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:mon.c smithi154 running (9m) 18s ago 9m 42.6M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 a61bbc94c05e 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (8m) 16s ago 8m 45.1M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 d112e42ec302 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi071 running (7m) 18s ago 7m 47.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 6100ed415377 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi154 running (7m) 18s ago 7m 59.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 0fac5331d5f5 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi038 running (6m) 16s ago 6m 44.1M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 539f9572bae0 2024-09-12T12:25:15.345 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi071 running (6m) 18s ago 6m 52.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 046fdf677f01 2024-09-12T12:25:15.346 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi154 running (6m) 18s ago 6m 56.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7d8d38db6626 2024-09-12T12:25:15.346 INFO:teuthology.orchestra.run.smithi038.stdout:osd.6 smithi038 running (5m) 16s ago 5m 48.3M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 8e32b4c47c5d 2024-09-12T12:25:15.346 INFO:teuthology.orchestra.run.smithi038.stdout:osd.7 smithi071 running (5m) 18s ago 5m 54.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 57c49d82d9ba 2024-09-12T12:25:15.346 INFO:teuthology.orchestra.run.smithi038.stdout:osd.8 smithi154 running (4m) 18s ago 4m 46.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 03ade64f43df 2024-09-12T12:25:15.346 INFO:teuthology.orchestra.run.smithi038.stdout:osd.9 smithi038 running (4m) 16s ago 4m 49.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 971b6fa42a4f 2024-09-12T12:25:15.346 INFO:teuthology.orchestra.run.smithi038.stdout:osd.10 smithi071 running (3m) 18s ago 3m 45.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ff97ec30e8b6 2024-09-12T12:25:15.346 INFO:teuthology.orchestra.run.smithi038.stdout:osd.11 smithi154 running (3m) 18s ago 3m 53.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 2cab9bfbcd74 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8c800a2bb0 msgr2=0x7f8c800a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8c800a2bb0 0x7f8c800a5070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c19b410 tx=0x7f8c88005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 msgr2=0x7f8c9c199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c199ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c031440 tx=0x7f8c8c032ce0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 shutdown_connections 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8c800a2bb0 0x7f8c800a5070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c9c105810 0x7f8c9c1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c104e50 0x7f8c9c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.345+0000 7f8c9b200640 1 --2- 172.21.15.38:0/2113992014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9c103c50 0x7f8c9c199ef0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.346+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 >> 172.21.15.38:0/2113992014 conn(0x7f8c9c0ff3e0 msgr2=0x7f8c9c108170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.346+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 shutdown_connections 2024-09-12T12:25:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:15.346+0000 7f8c9b200640 1 -- 172.21.15.38:0/2113992014 wait complete. 2024-09-12T12:25:15.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:15 smithi154 ceph-mon[35578]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:15.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:15 smithi071 ceph-mon[34859]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:16.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T12:25:16.318 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:16 smithi154 ceph-mon[35578]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T12:25:16.466 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:16.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:16 smithi038 ceph-mon[30810]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T12:25:16.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:16 smithi071 ceph-mon[34859]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T12:25:17.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 -- 172.21.15.38:0/1736528726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4102e00 msgr2=0x7f45c4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 --2- 172.21.15.38:0/1736528726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4102e00 0x7f45c4103280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009900 tx=0x7f45b002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 -- 172.21.15.38:0/1736528726 shutdown_connections 2024-09-12T12:25:17.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 --2- 172.21.15.38:0/1736528726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45c41037c0 0x7f45c410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 --2- 172.21.15.38:0/1736528726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4102e00 0x7f45c4103280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 --2- 172.21.15.38:0/1736528726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45c4101c00 0x7f45c4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 -- 172.21.15.38:0/1736528726 >> 172.21.15.38:0/1736528726 conn(0x7f45c40fd390 msgr2=0x7f45c40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:17.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 -- 172.21.15.38:0/1736528726 shutdown_connections 2024-09-12T12:25:17.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.087+0000 7f45cb600640 1 -- 172.21.15.38:0/1736528726 wait complete. 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 Processor -- start 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 -- start start 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4101c00 0x7f45c419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45c4102e00 0x7f45c419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45c41037c0 0x7f45c41a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410d860 con 0x7f45c4102e00 2024-09-12T12:25:17.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410d6e0 con 0x7f45c4101c00 2024-09-12T12:25:17.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.088+0000 7f45cb600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410d9e0 con 0x7f45c41037c0 2024-09-12T12:25:17.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4101c00 0x7f45c419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45c4102e00 0x7f45c419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4101c00 0x7f45c419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:44374/0 (socket says 172.21.15.38:44374) 2024-09-12T12:25:17.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c8c00640 1 -- 172.21.15.38:0/2048929950 learned_addr learned my addr 172.21.15.38:0/2048929950 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:17.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c9600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45c41037c0 0x7f45c41a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c3e00640 1 -- 172.21.15.38:0/2048929950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45c41037c0 msgr2=0x7f45c41a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c3e00640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45c41037c0 0x7f45c41a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c3e00640 1 -- 172.21.15.38:0/2048929950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4101c00 msgr2=0x7f45c419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c3e00640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4101c00 0x7f45c419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c3e00640 1 -- 172.21.15.38:0/2048929950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c41a1d40 con 0x7f45c4102e00 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.089+0000 7f45c8c00640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4101c00 0x7f45c419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.090+0000 7f45c3e00640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45c4102e00 0x7f45c419a650 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f45b0031440 tx=0x7f45b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.090+0000 7f45c1600640 1 -- 172.21.15.38:0/2048929950 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b003f070 con 0x7f45c4102e00 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.090+0000 7f45c1600640 1 -- 172.21.15.38:0/2048929950 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b0003cd0 con 0x7f45c4102e00 2024-09-12T12:25:17.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.090+0000 7f45c1600640 1 -- 172.21.15.38:0/2048929950 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0035070 con 0x7f45c4102e00 2024-09-12T12:25:17.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.090+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c41a1fd0 con 0x7f45c4102e00 2024-09-12T12:25:17.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.090+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c41a2420 con 0x7f45c4102e00 2024-09-12T12:25:17.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.091+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c41a2710 con 0x7f45c4102e00 2024-09-12T12:25:17.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.093+0000 7f45c1600640 1 -- 172.21.15.38:0/2048929950 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f45b003b4f0 con 0x7f45c4102e00 2024-09-12T12:25:17.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.094+0000 7f45c1600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45ac0a2bb0 0x7f45ac0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.095+0000 7f45c1600640 1 -- 172.21.15.38:0/2048929950 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f45b00efcb0 con 0x7f45c4102e00 2024-09-12T12:25:17.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.095+0000 7f45c8c00640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45ac0a2bb0 0x7f45ac0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.095+0000 7f45c8c00640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45ac0a2bb0 0x7f45ac0a5070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f45b800f7b0 tx=0x7f45b8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:17.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.097+0000 7f45c1600640 1 -- 172.21.15.38:0/2048929950 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45b00bc1b0 con 0x7f45c4102e00 2024-09-12T12:25:17.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.290+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f45c4109cf0 con 0x7f45ac0a2bb0 2024-09-12T12:25:17.291 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:17 smithi038 ceph-mon[30810]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:17.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.296+0000 7f45c1600640 1 -- 172.21.15.38:0/2048929950 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f45c4109cf0 con 0x7f45ac0a2bb0 2024-09-12T12:25:17.297 INFO:teuthology.orchestra.run.smithi038.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T12:25:17.298 INFO:teuthology.orchestra.run.smithi038.stdout:mds.all 12/12 20s ago 3m smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi071=b;smithi071=e;smithi071=h;smithi071=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-12T12:25:17.298 INFO:teuthology.orchestra.run.smithi038.stdout:mgr 3/3 20s ago 8m smithi038=x;smithi071=y;smithi154=z;count:3 2024-09-12T12:25:17.298 INFO:teuthology.orchestra.run.smithi038.stdout:mon 3/3 20s ago 9m smithi038:172.21.15.38=a;smithi071:172.21.15.71=b;smithi154:172.21.15.154=c;count:3 2024-09-12T12:25:17.298 INFO:teuthology.orchestra.run.smithi038.stdout:osd 12 20s ago - 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45ac0a2bb0 msgr2=0x7f45ac0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45ac0a2bb0 0x7f45ac0a5070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f45b800f7b0 tx=0x7f45b8009500 comp rx=0 tx=0).stop 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45c4102e00 msgr2=0x7f45c419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45c4102e00 0x7f45c419a650 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f45b0031440 tx=0x7f45b0004270 comp rx=0 tx=0).stop 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 shutdown_connections 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f45ac0a2bb0 0x7f45ac0a5070 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45c41037c0 0x7f45c41a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45c4102e00 0x7f45c419a650 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 --2- 172.21.15.38:0/2048929950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c4101c00 0x7f45c419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 >> 172.21.15.38:0/2048929950 conn(0x7f45c40fd390 msgr2=0x7f45c41085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 shutdown_connections 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:17.299+0000 7f45cb600640 1 -- 172.21.15.38:0/2048929950 wait complete. 2024-09-12T12:25:17.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:17 smithi154 ceph-mon[35578]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:17.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:17 smithi071 ceph-mon[34859]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:18.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T12:25:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:18 smithi154 ceph-mon[35578]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T12:25:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:18.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:18 smithi038 ceph-mon[30810]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T12:25:18.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:18 smithi071 ceph-mon[34859]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T12:25:19.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 -- 172.21.15.38:0/4114514853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 msgr2=0x7fe9341053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:19.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 --2- 172.21.15.38:0/4114514853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe9341053e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe920009900 tx=0x7fe92002a410 comp rx=0 tx=0).stop 2024-09-12T12:25:19.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 -- 172.21.15.38:0/4114514853 shutdown_connections 2024-09-12T12:25:19.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 --2- 172.21.15.38:0/4114514853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934105920 0x7fe93410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 --2- 172.21.15.38:0/4114514853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe9341053e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 --2- 172.21.15.38:0/4114514853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934103e00 0x7fe934104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 -- 172.21.15.38:0/4114514853 >> 172.21.15.38:0/4114514853 conn(0x7fe9340ff5b0 msgr2=0x7fe9341019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:19.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 -- 172.21.15.38:0/4114514853 shutdown_connections 2024-09-12T12:25:19.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.029+0000 7fe93c000640 1 -- 172.21.15.38:0/4114514853 wait complete. 2024-09-12T12:25:19.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.030+0000 7fe93c000640 1 Processor -- start 2024-09-12T12:25:19.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.030+0000 7fe93c000640 1 -- start start 2024-09-12T12:25:19.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe93c000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934103e00 0x7fe93419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:19.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe93c000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe93419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:19.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe93c000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934105920 0x7fe9341a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:19.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe93c000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe93410fb00 con 0x7fe934104f60 2024-09-12T12:25:19.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe93c000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe93410f980 con 0x7fe934105920 2024-09-12T12:25:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe93c000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe93410fc80 con 0x7fe934103e00 2024-09-12T12:25:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe938c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe93419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe938c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe93419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38916/0 (socket says 172.21.15.38:38916) 2024-09-12T12:25:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe938c00640 1 -- 172.21.15.38:0/2431965531 learned_addr learned my addr 172.21.15.38:0/2431965531 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe939600640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934103e00 0x7fe93419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.031+0000 7fe93a000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934105920 0x7fe9341a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe938c00640 1 -- 172.21.15.38:0/2431965531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934103e00 msgr2=0x7fe93419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe938c00640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934103e00 0x7fe93419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe938c00640 1 -- 172.21.15.38:0/2431965531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934105920 msgr2=0x7fe9341a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe938c00640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934105920 0x7fe9341a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe938c00640 1 -- 172.21.15.38:0/2431965531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9341a1d30 con 0x7fe934104f60 2024-09-12T12:25:19.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe938c00640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe93419a640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe920031440 tx=0x7fe920032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:19.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe932000640 1 -- 172.21.15.38:0/2431965531 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92003f030 con 0x7fe934104f60 2024-09-12T12:25:19.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe932000640 1 -- 172.21.15.38:0/2431965531 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe920003ce0 con 0x7fe934104f60 2024-09-12T12:25:19.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9341a1fc0 con 0x7fe934104f60 2024-09-12T12:25:19.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe932000640 1 -- 172.21.15.38:0/2431965531 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920035070 con 0x7fe934104f60 2024-09-12T12:25:19.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.032+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9341a23b0 con 0x7fe934104f60 2024-09-12T12:25:19.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.033+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93410b120 con 0x7fe934104f60 2024-09-12T12:25:19.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.035+0000 7fe932000640 1 -- 172.21.15.38:0/2431965531 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe920042030 con 0x7fe934104f60 2024-09-12T12:25:19.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.037+0000 7fe932000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe91c0a2bb0 0x7fe91c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.037+0000 7fe932000640 1 -- 172.21.15.38:0/2431965531 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fe9200ef7f0 con 0x7fe934104f60 2024-09-12T12:25:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.038+0000 7fe939600640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe91c0a2bb0 0x7fe91c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.038+0000 7fe939600640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe91c0a2bb0 0x7fe91c0a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe928009bd0 tx=0x7fe928005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.040+0000 7fe932000640 1 -- 172.21.15.38:0/2431965531 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9200bbd50 con 0x7fe934104f60 2024-09-12T12:25:19.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:19 smithi038 ceph-mon[30810]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:19.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.235+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fe934062630 con 0x7fe91c0a2bb0 2024-09-12T12:25:19.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.236+0000 7fe932000640 1 -- 172.21.15.38:0/2431965531 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fe934062630 con 0x7fe91c0a2bb0 2024-09-12T12:25:19.236 INFO:teuthology.orchestra.run.smithi038.stdout:HOST ADDR LABELS STATUS 2024-09-12T12:25:19.237 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 172.21.15.38 2024-09-12T12:25:19.237 INFO:teuthology.orchestra.run.smithi038.stdout:smithi071 172.21.15.71 2024-09-12T12:25:19.237 INFO:teuthology.orchestra.run.smithi038.stdout:smithi154 172.21.15.154 2024-09-12T12:25:19.237 INFO:teuthology.orchestra.run.smithi038.stdout:3 hosts in cluster 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.238+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe91c0a2bb0 msgr2=0x7fe91c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.238+0000 7fe93c000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe91c0a2bb0 0x7fe91c0a5070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe928009bd0 tx=0x7fe928005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.238+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 msgr2=0x7fe93419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.238+0000 7fe93c000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe93419a640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe920031440 tx=0x7fe920032ce0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 shutdown_connections 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe91c0a2bb0 0x7fe91c0a5070 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934105920 0x7fe9341a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe934104f60 0x7fe93419a640 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 --2- 172.21.15.38:0/2431965531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934103e00 0x7fe93419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 >> 172.21.15.38:0/2431965531 conn(0x7fe9340ff5b0 msgr2=0x7fe9341082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:19.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 shutdown_connections 2024-09-12T12:25:19.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:19.239+0000 7fe93c000640 1 -- 172.21.15.38:0/2431965531 wait complete. 2024-09-12T12:25:19.415 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:19 smithi071 ceph-mon[34859]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:19.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:19 smithi154 ceph-mon[35578]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:20.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T12:25:20.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:20 smithi154 ceph-mon[35578]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-12T12:25:20.419 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:20.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:20 smithi038 ceph-mon[30810]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-12T12:25:20.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:20 smithi071 ceph-mon[34859]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 -- 172.21.15.38:0/126476405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 msgr2=0x7fdf78104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 --2- 172.21.15.38:0/126476405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf78104200 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009900 tx=0x7fdf6802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 -- 172.21.15.38:0/126476405 shutdown_connections 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 --2- 172.21.15.38:0/126476405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf78105920 0x7fdf7810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 --2- 172.21.15.38:0/126476405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78104f60 0x7fdf781053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 --2- 172.21.15.38:0/126476405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf78104200 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 -- 172.21.15.38:0/126476405 >> 172.21.15.38:0/126476405 conn(0x7fdf780ff5b0 msgr2=0x7fdf781019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 -- 172.21.15.38:0/126476405 shutdown_connections 2024-09-12T12:25:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.972+0000 7fdf7e400640 1 -- 172.21.15.38:0/126476405 wait complete. 2024-09-12T12:25:20.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.973+0000 7fdf7e400640 1 Processor -- start 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.973+0000 7fdf7e400640 1 -- start start 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf7e400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf7819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf7e400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf78104f60 0x7fdf7819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf7e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78105920 0x7fdf781a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf7e400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7810fa90 con 0x7fdf78103e00 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf7e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7810f910 con 0x7fdf78105920 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf7e400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7810fc10 con 0x7fdf78104f60 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf7819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf7819a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38938/0 (socket says 172.21.15.38:38938) 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77400640 1 -- 172.21.15.38:0/464849848 learned_addr learned my addr 172.21.15.38:0/464849848 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:20.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77e00640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78105920 0x7fdf781a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:20.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf6fe00640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf78104f60 0x7fdf7819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:20.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77400640 1 -- 172.21.15.38:0/464849848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf78104f60 msgr2=0x7fdf7819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:20.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf78104f60 0x7fdf7819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:20.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77400640 1 -- 172.21.15.38:0/464849848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78105920 msgr2=0x7fdf781a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:20.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.974+0000 7fdf77400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78105920 0x7fdf781a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:20.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.975+0000 7fdf77400640 1 -- 172.21.15.38:0/464849848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf781a1ce0 con 0x7fdf78103e00 2024-09-12T12:25:20.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.975+0000 7fdf77400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf7819a0b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009230 tx=0x7fdf680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:20.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.975+0000 7fdf74c00640 1 -- 172.21.15.38:0/464849848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6803f030 con 0x7fdf78103e00 2024-09-12T12:25:20.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.975+0000 7fdf74c00640 1 -- 172.21.15.38:0/464849848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf68003ce0 con 0x7fdf78103e00 2024-09-12T12:25:20.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.975+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf781a1f70 con 0x7fdf78103e00 2024-09-12T12:25:20.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.975+0000 7fdf74c00640 1 -- 172.21.15.38:0/464849848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68035070 con 0x7fdf78103e00 2024-09-12T12:25:20.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.975+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf781a2370 con 0x7fdf78103e00 2024-09-12T12:25:20.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.976+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7810b1c0 con 0x7fdf78103e00 2024-09-12T12:25:20.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.978+0000 7fdf74c00640 1 -- 172.21.15.38:0/464849848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdf68042030 con 0x7fdf78103e00 2024-09-12T12:25:20.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.979+0000 7fdf74c00640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdf5c0a2bb0 0x7fdf5c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:20.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.980+0000 7fdf74c00640 1 -- 172.21.15.38:0/464849848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fdf680ef890 con 0x7fdf78103e00 2024-09-12T12:25:20.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.980+0000 7fdf6fe00640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdf5c0a2bb0 0x7fdf5c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:20.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.981+0000 7fdf6fe00640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdf5c0a2bb0 0x7fdf5c0a5070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf7819b5d0 tx=0x7fdf60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:20.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:20.984+0000 7fdf74c00640 1 -- 172.21.15.38:0/464849848 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf680bbd90 con 0x7fdf78103e00 2024-09-12T12:25:21.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.182+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fdf78062630 con 0x7fdf5c0a2bb0 2024-09-12T12:25:21.183 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:21 smithi038 ceph-mon[30810]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:21.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.184+0000 7fdf74c00640 1 -- 172.21.15.38:0/464849848 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fdf78062630 con 0x7fdf5c0a2bb0 2024-09-12T12:25:21.185 INFO:teuthology.orchestra.run.smithi038.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T12:25:21.185 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN 3726G No 4m ago Has a FileSystem, LVM detected 2024-09-12T12:25:21.185 INFO:teuthology.orchestra.run.smithi038.stdout:smithi071 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040172400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T12:25:21.185 INFO:teuthology.orchestra.run.smithi038.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T12:25:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdf5c0a2bb0 msgr2=0x7fdf5c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdf5c0a2bb0 0x7fdf5c0a5070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf7819b5d0 tx=0x7fdf60005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 msgr2=0x7fdf7819a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf7819a0b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009230 tx=0x7fdf680042f0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 shutdown_connections 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdf5c0a2bb0 0x7fdf5c0a5070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78105920 0x7fdf781a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf78104f60 0x7fdf7819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 --2- 172.21.15.38:0/464849848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf78103e00 0x7fdf7819a0b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 >> 172.21.15.38:0/464849848 conn(0x7fdf780ff5b0 msgr2=0x7fdf78108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 shutdown_connections 2024-09-12T12:25:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:21.187+0000 7fdf7e400640 1 -- 172.21.15.38:0/464849848 wait complete. 2024-09-12T12:25:21.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:21 smithi154 ceph-mon[35578]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:21.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:21 smithi071 ceph-mon[34859]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:21.933 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T12:25:21.942 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-12T12:25:21.942 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T12:25:22.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:22 smithi038 ceph-mon[30810]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:22.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:22 smithi038 ceph-mon[30810]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:22.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:22 smithi154 ceph-mon[35578]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:22.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:22 smithi154 ceph-mon[35578]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:22.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:22 smithi071 ceph-mon[34859]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:22.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:22 smithi071 ceph-mon[34859]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:22.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 -- 172.21.15.38:0/3578629085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4076ba0 msgr2=0x7f4db4076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3578629085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4076ba0 0x7f4db4076fa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009900 tx=0x7f4da402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 -- 172.21.15.38:0/3578629085 shutdown_connections 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3578629085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4db4078790 0x7f4db4079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3578629085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db4077df0 0x7f4db4078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3578629085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4076ba0 0x7f4db4076fa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 -- 172.21.15.38:0/3578629085 >> 172.21.15.38:0/3578629085 conn(0x7f4db40ff5b0 msgr2=0x7f4db41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.898+0000 7f4dbb000640 1 -- 172.21.15.38:0/3578629085 shutdown_connections 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.899+0000 7f4dbb000640 1 -- 172.21.15.38:0/3578629085 wait complete. 2024-09-12T12:25:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.899+0000 7f4dbb000640 1 Processor -- start 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dbb000640 1 -- start start 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dbb000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4db4076ba0 0x7f4db419e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dbb000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4077df0 0x7f4db419e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dbb000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db4078790 0x7f4db41a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dbb000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4113e60 con 0x7f4db4077df0 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dbb000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4113ce0 con 0x7f4db4076ba0 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dbb000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4113fe0 con 0x7f4db4078790 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dabe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4077df0 0x7f4db419e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dabe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4077df0 0x7f4db419e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38952/0 (socket says 172.21.15.38:38952) 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4dabe00640 1 -- 172.21.15.38:0/3122145131 learned_addr learned my addr 172.21.15.38:0/3122145131 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4db3e00640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4db4076ba0 0x7f4db419e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.900+0000 7f4db9000640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db4078790 0x7f4db41a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dabe00640 1 -- 172.21.15.38:0/3122145131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db4078790 msgr2=0x7f4db41a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dabe00640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db4078790 0x7f4db41a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dabe00640 1 -- 172.21.15.38:0/3122145131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4db4076ba0 msgr2=0x7f4db419e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dabe00640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4db4076ba0 0x7f4db419e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dabe00640 1 -- 172.21.15.38:0/3122145131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db41a60e0 con 0x7f4db4077df0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dabe00640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4077df0 0x7f4db419e9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d950 tx=0x7f4d9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4db1600640 1 -- 172.21.15.38:0/3122145131 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c017030 con 0x7f4db4077df0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4db1600640 1 -- 172.21.15.38:0/3122145131 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d9c004020 con 0x7f4db4077df0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db41a63d0 con 0x7f4db4077df0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4db1600640 1 -- 172.21.15.38:0/3122145131 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0047a0 con 0x7f4db4077df0 2024-09-12T12:25:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.901+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db41a6960 con 0x7f4db4077df0 2024-09-12T12:25:22.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.902+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db4110780 con 0x7f4db4077df0 2024-09-12T12:25:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.904+0000 7f4db1600640 1 -- 172.21.15.38:0/3122145131 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4d9c0041d0 con 0x7f4db4077df0 2024-09-12T12:25:22.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.906+0000 7f4db1600640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4d980a2c30 0x7f4d980a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:22.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.906+0000 7f4db1600640 1 -- 172.21.15.38:0/3122145131 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f4d9c0ced50 con 0x7f4db4077df0 2024-09-12T12:25:22.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.906+0000 7f4db3e00640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4d980a2c30 0x7f4d980a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:22.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.907+0000 7f4db3e00640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4d980a2c30 0x7f4d980a50f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4da40314e0 tx=0x7f4da4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:22.910+0000 7f4db1600640 1 -- 172.21.15.38:0/3122145131 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d9c09b8a0 con 0x7f4db4077df0 2024-09-12T12:25:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.131+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4db402d7c0 con 0x7f4db4077df0 2024-09-12T12:25:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.131+0000 7f4db1600640 1 -- 172.21.15.38:0/3122145131 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3126 (secure 0 0 0) 0x7f4d9c09b1a0 con 0x7f4db4077df0 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:e29 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:btime 2024-09-12T12:23:49:190760+0000 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-12T12:25:23.132 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 29 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-12T12:22:55.298669+0000 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-12T12:23:48.221685+0000 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 300 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 0 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:25:23.133 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 5 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1,2,3,4 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=24557,1=24529,2=24515,3=24508,4=24502} 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3,4] 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 0 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:qdb_cluster leader: 24557 members: 24502,24515,24508,24529,24557 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b{0:24557} state up:active seq 5 addr [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.134 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.e{0:24488} state up:standby-replay seq 1 addr [v2:172.21.15.71:6834/2977480232,v1:172.21.15.71:6835/2977480232] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.i{1:24529} state up:active seq 19 addr [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.l{1:24457} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/632951998,v1:172.21.15.154:6833/632951998] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.h{2:24515} state up:active seq 20 addr [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.k{2:24452} state up:standby-replay seq 1 addr [v2:172.21.15.71:6832/3768607144,v1:172.21.15.71:6833/3768607144] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c{3:24508} state up:active seq 21 addr [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a{3:14538} state up:standby-replay seq 1 addr [v2:172.21.15.38:6840/1563078137,v1:172.21.15.38:6841/1563078137] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.f{4:24502} state up:active seq 22 addr [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.g{4:14526} state up:standby-replay seq 1 addr [v2:172.21.15.38:6838/4044590502,v1:172.21.15.38:6839/4044590502] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:Standby daemons: 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.j{-1:14472} state up:standby seq 1 addr [v2:172.21.15.38:6834/675820097,v1:172.21.15.38:6835/675820097] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.135 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.d{-1:14484} state up:standby seq 1 addr [v2:172.21.15.38:6836/3190889999,v1:172.21.15.38:6837/3190889999] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-12T12:25:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.133+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4d980a2c30 msgr2=0x7f4d980a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.133+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4d980a2c30 0x7f4d980a50f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4da40314e0 tx=0x7f4da4000bc0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.133+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4077df0 msgr2=0x7f4db419e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.133+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4077df0 0x7f4db419e9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d950 tx=0x7f4d9c00de10 comp rx=0 tx=0).stop 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 shutdown_connections 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f4d980a2c30 0x7f4d980a50f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db4078790 0x7f4db41a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4077df0 0x7f4db419e9f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 --2- 172.21.15.38:0/3122145131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4db4076ba0 0x7f4db419e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 >> 172.21.15.38:0/3122145131 conn(0x7f4db40ff5b0 msgr2=0x7f4db4101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 shutdown_connections 2024-09-12T12:25:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:23.134+0000 7f4dbb000640 1 -- 172.21.15.38:0/3122145131 wait complete. 2024-09-12T12:25:23.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:23 smithi154 ceph-mon[35578]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:23.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:23 smithi038 ceph-mon[30810]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:23.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:23 smithi071 ceph-mon[34859]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:23.956 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T12:25:24.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:24 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3122145131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:25:24.336 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:24.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:24 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3122145131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:25:24.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:24 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3122145131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 -- 172.21.15.38:0/1125578303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 msgr2=0x7f6b50104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 --2- 172.21.15.38:0/1125578303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50104050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009900 tx=0x7f6b4002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 -- 172.21.15.38:0/1125578303 shutdown_connections 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 --2- 172.21.15.38:0/1125578303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50105810 0x7f6b5010c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 --2- 172.21.15.38:0/1125578303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b50104e50 0x7f6b501052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 --2- 172.21.15.38:0/1125578303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50104050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 -- 172.21.15.38:0/1125578303 >> 172.21.15.38:0/1125578303 conn(0x7f6b500ff3e0 msgr2=0x7f6b50101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 -- 172.21.15.38:0/1125578303 shutdown_connections 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.923+0000 7f6b4f200640 1 -- 172.21.15.38:0/1125578303 wait complete. 2024-09-12T12:25:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.924+0000 7f6b4f200640 1 Processor -- start 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.924+0000 7f6b4f200640 1 -- start start 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.924+0000 7f6b4f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.924+0000 7f6b4f200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104e50 0x7f6b5019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.924+0000 7f6b4f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b50105810 0x7f6b501a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4f200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5010f930 con 0x7f6b50103c50 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5010f7b0 con 0x7f6b50105810 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4f200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5010fab0 con 0x7f6b50104e50 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38960/0 (socket says 172.21.15.38:38960) 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 -- 172.21.15.38:0/2686538300 learned_addr learned my addr 172.21.15.38:0/2686538300 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4d400640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104e50 0x7f6b5019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4e800640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b50105810 0x7f6b501a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 -- 172.21.15.38:0/2686538300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104e50 msgr2=0x7f6b5019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104e50 0x7f6b5019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 -- 172.21.15.38:0/2686538300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b50105810 msgr2=0x7f6b501a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b50105810 0x7f6b501a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 -- 172.21.15.38:0/2686538300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b501a1b30 con 0x7f6b50103c50 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.925+0000 7f6b4de00640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50199f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6b40031440 tx=0x7f6b40032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.926+0000 7f6b46a00640 1 -- 172.21.15.38:0/2686538300 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4003f030 con 0x7f6b50103c50 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.926+0000 7f6b46a00640 1 -- 172.21.15.38:0/2686538300 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b40003ce0 con 0x7f6b50103c50 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.926+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b501a1dc0 con 0x7f6b50103c50 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.926+0000 7f6b46a00640 1 -- 172.21.15.38:0/2686538300 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40035070 con 0x7f6b50103c50 2024-09-12T12:25:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.926+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a21e0 con 0x7f6b50103c50 2024-09-12T12:25:24.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.927+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5010b050 con 0x7f6b50103c50 2024-09-12T12:25:24.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.929+0000 7f6b46a00640 1 -- 172.21.15.38:0/2686538300 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6b40042030 con 0x7f6b50103c50 2024-09-12T12:25:24.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.930+0000 7f6b46a00640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b340a2bb0 0x7f6b340a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.930+0000 7f6b46a00640 1 -- 172.21.15.38:0/2686538300 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f6b400ef850 con 0x7f6b50103c50 2024-09-12T12:25:24.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.931+0000 7f6b4d400640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b340a2bb0 0x7f6b340a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.931+0000 7f6b4d400640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b340a2bb0 0x7f6b340a5070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b5019b420 tx=0x7f6b3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:24.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:24.934+0000 7f6b46a00640 1 -- 172.21.15.38:0/2686538300 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b400bbd50 con 0x7f6b50103c50 2024-09-12T12:25:25.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.121+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f6b50062df0 con 0x7f6b50103c50 2024-09-12T12:25:25.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.122+0000 7f6b46a00640 1 -- 172.21.15.38:0/2686538300 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) ==== 56+0+5669 (secure 0 0 0) 0x7f6b400c0050 con 0x7f6b50103c50 2024-09-12T12:25:25.123 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 93 2024-09-12T12:25:25.123 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:25:25.123 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-12T12:14:39.915105+0000 2024-09-12T12:25:25.123 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-12T12:24:35.829591+0000 2024-09-12T12:25:25.123 INFO:teuthology.orchestra.run.smithi038.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T12:25:25.123 INFO:teuthology.orchestra.run.smithi038.stdout:crush_version 27 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:full_ratio 0.95 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:backfillfull_ratio 0.9 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:nearfull_ratio 0.85 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:require_min_compat_client luminous 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:min_compat_client luminous 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:require_osd_release squid 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:stretch_mode_enabled false 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:max_osd 12 2024-09-12T12:25:25.124 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 up in weight 1 up_from 8 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6802/4152176718,v1:172.21.15.38:6803/4152176718] [v2:172.21.15.38:6804/4152176718,v1:172.21.15.38:6805/4152176718] exists,up e9e11e86-b488-441c-a706-882110e30bc3 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 up in weight 1 up_from 13 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/1674049999,v1:172.21.15.71:6801/1674049999] [v2:172.21.15.71:6802/1674049999,v1:172.21.15.71:6803/1674049999] exists,up 6df2c3be-ea85-414e-b78a-93ea2e8a6594 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/1873540027,v1:172.21.15.154:6801/1873540027] [v2:172.21.15.154:6802/1873540027,v1:172.21.15.154:6803/1873540027] exists,up 4b506f93-8b23-4b61-91ef-853f291ff271 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 up in weight 1 up_from 25 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6810/1122631258,v1:172.21.15.38:6811/1122631258] [v2:172.21.15.38:6812/1122631258,v1:172.21.15.38:6813/1122631258] exists,up cff00379-25cc-49a9-affe-2a92479e3a6b 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 up in weight 1 up_from 32 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6808/1646041821,v1:172.21.15.71:6809/1646041821] [v2:172.21.15.71:6810/1646041821,v1:172.21.15.71:6811/1646041821] exists,up 908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 up in weight 1 up_from 36 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/908205841,v1:172.21.15.154:6809/908205841] [v2:172.21.15.154:6810/908205841,v1:172.21.15.154:6811/908205841] exists,up edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.6 up in weight 1 up_from 44 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6818/3228938954,v1:172.21.15.38:6819/3228938954] [v2:172.21.15.38:6820/3228938954,v1:172.21.15.38:6821/3228938954] exists,up 61f54b73-d6fd-452a-b38f-0968bd646803 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.7 up in weight 1 up_from 49 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6816/3734483310,v1:172.21.15.71:6817/3734483310] [v2:172.21.15.71:6818/3734483310,v1:172.21.15.71:6819/3734483310] exists,up 3b272e86-3a25-40df-b8f4-1f41cb6a4bf7 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.8 up in weight 1 up_from 57 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/1762082405,v1:172.21.15.154:6817/1762082405] [v2:172.21.15.154:6818/1762082405,v1:172.21.15.154:6819/1762082405] exists,up 7556a43c-35d1-4404-8ff1-3e12d177d45b 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.9 up in weight 1 up_from 64 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6826/3838798942,v1:172.21.15.38:6827/3838798942] [v2:172.21.15.38:6828/3838798942,v1:172.21.15.38:6829/3838798942] exists,up 193a9b75-c4f8-4a7f-b8a3-9b1566e43f00 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.10 up in weight 1 up_from 69 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/1853359859,v1:172.21.15.71:6825/1853359859] [v2:172.21.15.71:6826/1853359859,v1:172.21.15.71:6827/1853359859] exists,up 62aedf15-9d2c-46b9-bf26-83fe7c52ded1 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:osd.11 up in weight 1 up_from 76 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/1742402788,v1:172.21.15.154:6825/1742402788] [v2:172.21.15.154:6826/1742402788,v1:172.21.15.154:6827/1742402788] exists,up dee8442e-7be2-4078-869a-33a7f6b13a9a 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 2.5 [8,11] 2024-09-12T12:25:25.125 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 2.a [2,11] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 2.1d [2,4] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.0 [5,9] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.6 [3,7] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.10 [5,9] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.14 [4,6] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.23 [4,8] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.3c [4,9] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 4.6 [9,11] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 4.7 [5,8] 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 4.c [9,10] 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 4.10 [9,8] 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6801/2462218902 expires 2024-09-13T12:15:33.976954+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6800/2462218902 expires 2024-09-13T12:15:33.976954+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/780591637 expires 2024-09-13T12:15:33.976954+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/2321943199 expires 2024-09-13T12:15:33.976954+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/271793937 expires 2024-09-13T12:15:33.976954+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/2979922122 expires 2024-09-13T12:15:04.820922+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/746177485 expires 2024-09-13T12:15:04.820922+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/3674823086 expires 2024-09-13T12:15:04.820922+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6801/3803178885 expires 2024-09-13T12:15:04.820922+0000 2024-09-12T12:25:25.127 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6800/3803178885 expires 2024-09-13T12:15:04.820922+0000 2024-09-12T12:25:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b340a2bb0 msgr2=0x7f6b340a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b340a2bb0 0x7f6b340a5070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b5019b420 tx=0x7f6b3c005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 msgr2=0x7f6b50199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50199f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6b40031440 tx=0x7f6b40032ce0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 shutdown_connections 2024-09-12T12:25:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b340a2bb0 0x7f6b340a5070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b50105810 0x7f6b501a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50104e50 0x7f6b5019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 --2- 172.21.15.38:0/2686538300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b50103c50 0x7f6b50199f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 >> 172.21.15.38:0/2686538300 conn(0x7f6b500ff3e0 msgr2=0x7f6b50108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:25.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 shutdown_connections 2024-09-12T12:25:25.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:25.125+0000 7f6b4f200640 1 -- 172.21.15.38:0/2686538300 wait complete. 2024-09-12T12:25:25.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:25 smithi154 ceph-mon[35578]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:25.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:25 smithi038 ceph-mon[30810]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:25.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:25 smithi071 ceph-mon[34859]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:26.055 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T12:25:26.067 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:26.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:26 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2686538300' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:25:26.450 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:26.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:26 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2686538300' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:25:26.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:26 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2686538300' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:25:27.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.029+0000 7feb16c00640 1 -- 172.21.15.38:0/1170574951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10109120 msgr2=0x7feb10110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.029+0000 7feb16c00640 1 --2- 172.21.15.38:0/1170574951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10109120 0x7feb10110ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feb08009ca0 tx=0x7feb0802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.030+0000 7feb16c00640 1 -- 172.21.15.38:0/1170574951 shutdown_connections 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.030+0000 7feb16c00640 1 --2- 172.21.15.38:0/1170574951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10109120 0x7feb10110ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.030+0000 7feb16c00640 1 --2- 172.21.15.38:0/1170574951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb101049a0 0x7feb101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.030+0000 7feb16c00640 1 --2- 172.21.15.38:0/1170574951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb10103ff0 0x7feb101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.030+0000 7feb16c00640 1 -- 172.21.15.38:0/1170574951 >> 172.21.15.38:0/1170574951 conn(0x7feb100ffa90 msgr2=0x7feb10101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.030+0000 7feb16c00640 1 -- 172.21.15.38:0/1170574951 shutdown_connections 2024-09-12T12:25:27.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.030+0000 7feb16c00640 1 -- 172.21.15.38:0/1170574951 wait complete. 2024-09-12T12:25:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 Processor -- start 2024-09-12T12:25:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 -- start start 2024-09-12T12:25:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10103ff0 0x7feb1019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb101049a0 0x7feb1019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb10109120 0x7feb1019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feb10114150 con 0x7feb10103ff0 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feb10113fd0 con 0x7feb101049a0 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.031+0000 7feb16c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb101142d0 con 0x7feb10109120 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10103ff0 0x7feb1019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10103ff0 0x7feb1019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57778/0 (socket says 172.21.15.38:57778) 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 -- 172.21.15.38:0/1057806625 learned_addr learned my addr 172.21.15.38:0/1057806625 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb14c00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb10109120 0x7feb1019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb07e00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb101049a0 0x7feb1019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 -- 172.21.15.38:0/1057806625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb10109120 msgr2=0x7feb1019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb10109120 0x7feb1019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 -- 172.21.15.38:0/1057806625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb101049a0 msgr2=0x7feb1019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb101049a0 0x7feb1019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 -- 172.21.15.38:0/1057806625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1019f560 con 0x7feb10103ff0 2024-09-12T12:25:27.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb07e00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb101049a0 0x7feb1019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:27.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.032+0000 7feb0fe00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10103ff0 0x7feb1019a5b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feb0000e9f0 tx=0x7feb0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:27.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.033+0000 7feb0d600640 1 -- 172.21.15.38:0/1057806625 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0000cd80 con 0x7feb10103ff0 2024-09-12T12:25:27.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.033+0000 7feb0d600640 1 -- 172.21.15.38:0/1057806625 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb00005500 con 0x7feb10103ff0 2024-09-12T12:25:27.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.033+0000 7feb0d600640 1 -- 172.21.15.38:0/1057806625 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00010690 con 0x7feb10103ff0 2024-09-12T12:25:27.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.033+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1019f850 con 0x7feb10103ff0 2024-09-12T12:25:27.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.033+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb101a7130 con 0x7feb10103ff0 2024-09-12T12:25:27.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.034+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb101043d0 con 0x7feb10103ff0 2024-09-12T12:25:27.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.036+0000 7feb0d600640 1 -- 172.21.15.38:0/1057806625 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feb000046c0 con 0x7feb10103ff0 2024-09-12T12:25:27.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.037+0000 7feb0d600640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feaf40a2c00 0x7feaf40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:27.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.037+0000 7feb0d600640 1 -- 172.21.15.38:0/1057806625 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7feb000cf7d0 con 0x7feb10103ff0 2024-09-12T12:25:27.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.037+0000 7feb07e00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feaf40a2c00 0x7feaf40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:27.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.038+0000 7feb07e00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feaf40a2c00 0x7feaf40a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb1010aa90 tx=0x7feaf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:27.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.041+0000 7feb0d600640 1 -- 172.21.15.38:0/1057806625 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb0009c320 con 0x7feb10103ff0 2024-09-12T12:25:27.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:27 smithi038 ceph-mon[30810]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:27.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.266+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb1019b910 con 0x7feb10103ff0 2024-09-12T12:25:27.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.267+0000 7feb0d600640 1 -- 172.21.15.38:0/1057806625 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11968 (secure 0 0 0) 0x7feb00086020 con 0x7feb10103ff0 2024-09-12T12:25:27.267 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:27.267 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"btime":"2024-09-12T12:23:49:190760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:48.221685+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24502,24515,24508,24529,24557]},"id":1}]} 2024-09-12T12:25:27.268 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-12T12:25:27.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feaf40a2c00 msgr2=0x7feaf40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:27.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feaf40a2c00 0x7feaf40a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb1010aa90 tx=0x7feaf8005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:27.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10103ff0 msgr2=0x7feb1019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:27.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10103ff0 0x7feb1019a5b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feb0000e9f0 tx=0x7feb0000edf0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 shutdown_connections 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7feaf40a2c00 0x7feaf40a50c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb10109120 0x7feb1019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb101049a0 0x7feb1019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 --2- 172.21.15.38:0/1057806625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb10103ff0 0x7feb1019a5b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 >> 172.21.15.38:0/1057806625 conn(0x7feb100ffa90 msgr2=0x7feb10101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 shutdown_connections 2024-09-12T12:25:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:27.269+0000 7feb16c00640 1 -- 172.21.15.38:0/1057806625 wait complete. 2024-09-12T12:25:27.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:27 smithi154 ceph-mon[35578]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:27.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:27 smithi071 ceph-mon[34859]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:28.098 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:28.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:28 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1057806625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:28.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:28 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1057806625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:28.476 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:28.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:28 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1057806625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 -- 172.21.15.38:0/1147083816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa281047e0 msgr2=0x7faa28108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 --2- 172.21.15.38:0/1147083816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa281047e0 0x7faa28108830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faa10009900 tx=0x7faa1002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 -- 172.21.15.38:0/1147083816 shutdown_connections 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 --2- 172.21.15.38:0/1147083816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa28108f60 0x7faa28110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 --2- 172.21.15.38:0/1147083816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa281047e0 0x7faa28108830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 --2- 172.21.15.38:0/1147083816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa28103e30 0x7faa28104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 -- 172.21.15.38:0/1147083816 >> 172.21.15.38:0/1147083816 conn(0x7faa280ff8d0 msgr2=0x7faa28101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 -- 172.21.15.38:0/1147083816 shutdown_connections 2024-09-12T12:25:29.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.027+0000 7faa2d200640 1 -- 172.21.15.38:0/1147083816 wait complete. 2024-09-12T12:25:29.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.028+0000 7faa2d200640 1 Processor -- start 2024-09-12T12:25:29.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.028+0000 7faa2d200640 1 -- start start 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.028+0000 7faa2d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa28103e30 0x7faa2819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.028+0000 7faa2d200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa281047e0 0x7faa2819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.028+0000 7faa2d200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa28108f60 0x7faa2819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa2d200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faa28114010 con 0x7faa28108f60 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa2d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa28113e90 con 0x7faa28103e30 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa2d200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa28114190 con 0x7faa281047e0 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa28108f60 0x7faa2819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa1fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa281047e0 0x7faa2819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa28103e30 0x7faa2819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa28108f60 0x7faa2819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57798/0 (socket says 172.21.15.38:57798) 2024-09-12T12:25:29.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 -- 172.21.15.38:0/2231897756 learned_addr learned my addr 172.21.15.38:0/2231897756 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 -- 172.21.15.38:0/2231897756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa281047e0 msgr2=0x7faa2819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa281047e0 0x7faa2819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 -- 172.21.15.38:0/2231897756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa28103e30 msgr2=0x7faa2819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa28103e30 0x7faa2819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.029+0000 7faa27e00640 1 -- 172.21.15.38:0/2231897756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2819f480 con 0x7faa28108f60 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.030+0000 7faa27e00640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa28108f60 0x7faa2819eda0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa20009fd0 tx=0x7faa2000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.030+0000 7faa24c00640 1 -- 172.21.15.38:0/2231897756 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20017070 con 0x7faa28108f60 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.030+0000 7faa24c00640 1 -- 172.21.15.38:0/2231897756 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa20003e50 con 0x7faa28108f60 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.030+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2819f770 con 0x7faa28108f60 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.030+0000 7faa24c00640 1 -- 172.21.15.38:0/2231897756 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa200106c0 con 0x7faa28108f60 2024-09-12T12:25:29.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.030+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa281a7050 con 0x7faa28108f60 2024-09-12T12:25:29.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.031+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa28104210 con 0x7faa28108f60 2024-09-12T12:25:29.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.033+0000 7faa24c00640 1 -- 172.21.15.38:0/2231897756 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faa20003970 con 0x7faa28108f60 2024-09-12T12:25:29.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.034+0000 7faa24c00640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faa0c0a2b80 0x7faa0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:29.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.035+0000 7faa24c00640 1 -- 172.21.15.38:0/2231897756 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faa200cf110 con 0x7faa28108f60 2024-09-12T12:25:29.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.035+0000 7faa27400640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faa0c0a2b80 0x7faa0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:29.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.035+0000 7faa27400640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faa0c0a2b80 0x7faa0c0a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa18005fd0 tx=0x7faa1800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:29.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.038+0000 7faa24c00640 1 -- 172.21.15.38:0/2231897756 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa2009b610 con 0x7faa28108f60 2024-09-12T12:25:29.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:29 smithi038 ceph-mon[30810]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T12:25:29.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.259+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa2810c140 con 0x7faa28108f60 2024-09-12T12:25:29.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.260+0000 7faa24c00640 1 -- 172.21.15.38:0/2231897756 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11968 (secure 0 0 0) 0x7faa2009f910 con 0x7faa28108f60 2024-09-12T12:25:29.261 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:29.261 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"btime":"2024-09-12T12:23:49:190760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:23:48.221685+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24502,24515,24508,24529,24557]},"id":1}]} 2024-09-12T12:25:29.262 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-12T12:25:29.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.262+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faa0c0a2b80 msgr2=0x7faa0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:29.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.262+0000 7faa2d200640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faa0c0a2b80 0x7faa0c0a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa18005fd0 tx=0x7faa1800b390 comp rx=0 tx=0).stop 2024-09-12T12:25:29.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.262+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa28108f60 msgr2=0x7faa2819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:29.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.262+0000 7faa2d200640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa28108f60 0x7faa2819eda0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa20009fd0 tx=0x7faa2000b260 comp rx=0 tx=0).stop 2024-09-12T12:25:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 shutdown_connections 2024-09-12T12:25:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faa0c0a2b80 0x7faa0c0a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa28108f60 0x7faa2819eda0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa281047e0 0x7faa2819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 --2- 172.21.15.38:0/2231897756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa28103e30 0x7faa2819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 >> 172.21.15.38:0/2231897756 conn(0x7faa280ff8d0 msgr2=0x7faa28100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 shutdown_connections 2024-09-12T12:25:29.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:29.263+0000 7faa2d200640 1 -- 172.21.15.38:0/2231897756 wait complete. 2024-09-12T12:25:29.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:29 smithi154 ceph-mon[35578]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T12:25:29.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:29 smithi071 ceph-mon[34859]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T12:25:30.062 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:25:30.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:30 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2231897756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:30.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:30 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2231897756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:30.465 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:30.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:30 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2231897756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 -- 172.21.15.38:0/1567741298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 msgr2=0x7f9874108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 --2- 172.21.15.38:0/1567741298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f9874108830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9860009900 tx=0x7f986002a410 comp rx=0 tx=0).stop 2024-09-12T12:25:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 -- 172.21.15.38:0/1567741298 shutdown_connections 2024-09-12T12:25:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 --2- 172.21.15.38:0/1567741298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9874108f60 0x7f9874110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 --2- 172.21.15.38:0/1567741298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f9874108830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 --2- 172.21.15.38:0/1567741298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9874103e30 0x7f9874104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 -- 172.21.15.38:0/1567741298 >> 172.21.15.38:0/1567741298 conn(0x7f98740ff910 msgr2=0x7f9874101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 -- 172.21.15.38:0/1567741298 shutdown_connections 2024-09-12T12:25:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.062+0000 7f9879c00640 1 -- 172.21.15.38:0/1567741298 wait complete. 2024-09-12T12:25:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.063+0000 7f9879c00640 1 Processor -- start 2024-09-12T12:25:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.063+0000 7f9879c00640 1 -- start start 2024-09-12T12:25:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9879c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9874103e30 0x7f987419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9879c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f987419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9879c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9874108f60 0x7f987419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9879c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9874113fc0 con 0x7f98741047e0 2024-09-12T12:25:31.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9879c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9874113e40 con 0x7f9874108f60 2024-09-12T12:25:31.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9879c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9874114140 con 0x7f9874103e30 2024-09-12T12:25:31.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9873400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f987419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9873400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f987419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57806/0 (socket says 172.21.15.38:57806) 2024-09-12T12:25:31.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9873400640 1 -- 172.21.15.38:0/2917781778 learned_addr learned my addr 172.21.15.38:0/2917781778 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:31.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9873e00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9874103e30 0x7f987419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.064+0000 7f9879200640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9874108f60 0x7f987419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9873400640 1 -- 172.21.15.38:0/2917781778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9874103e30 msgr2=0x7f987419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9873400640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9874103e30 0x7f987419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9873400640 1 -- 172.21.15.38:0/2917781778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9874108f60 msgr2=0x7f987419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9873400640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9874108f60 0x7f987419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9873400640 1 -- 172.21.15.38:0/2917781778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987419f470 con 0x7f98741047e0 2024-09-12T12:25:31.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9873400640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f987419aa00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9860006010 tx=0x7f98600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:31.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9870c00640 1 -- 172.21.15.38:0/2917781778 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986003f030 con 0x7f98741047e0 2024-09-12T12:25:31.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987419f700 con 0x7f98741047e0 2024-09-12T12:25:31.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9870c00640 1 -- 172.21.15.38:0/2917781778 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9860003ce0 con 0x7f98741047e0 2024-09-12T12:25:31.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.065+0000 7f9870c00640 1 -- 172.21.15.38:0/2917781778 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860035070 con 0x7f98741047e0 2024-09-12T12:25:31.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.066+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98741a7040 con 0x7f98741047e0 2024-09-12T12:25:31.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.067+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9874105310 con 0x7f98741047e0 2024-09-12T12:25:31.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.068+0000 7f9870c00640 1 -- 172.21.15.38:0/2917781778 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9860042030 con 0x7f98741047e0 2024-09-12T12:25:31.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.070+0000 7f9870c00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98580a2b80 0x7f98580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.070+0000 7f9870c00640 1 -- 172.21.15.38:0/2917781778 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f98600efa60 con 0x7f98741047e0 2024-09-12T12:25:31.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.070+0000 7f9873e00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98580a2b80 0x7f98580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.071+0000 7f9873e00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98580a2b80 0x7f98580a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f986400bbe0 tx=0x7f986400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:31.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.074+0000 7f9870c00640 1 -- 172.21.15.38:0/2917781778 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98600bc020 con 0x7f98741047e0 2024-09-12T12:25:31.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:31 smithi038 ceph-mon[30810]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T12:25:31.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.264+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f987410c1a0 con 0x7f98741047e0 2024-09-12T12:25:31.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.266+0000 7f9870c00640 1 -- 172.21.15.38:0/2917781778 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24865 (secure 0 0 0) 0x7f98600c0320 con 0x7f98741047e0 2024-09-12T12:25:31.267 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:31.267 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:24:35.829591+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:31.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98580a2b80 msgr2=0x7f98580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98580a2b80 0x7f98580a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f986400bbe0 tx=0x7f986400b390 comp rx=0 tx=0).stop 2024-09-12T12:25:31.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 msgr2=0x7f987419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f987419aa00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9860006010 tx=0x7f98600042f0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 shutdown_connections 2024-09-12T12:25:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f98580a2b80 0x7f98580a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9874108f60 0x7f987419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98741047e0 0x7f987419aa00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 --2- 172.21.15.38:0/2917781778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9874103e30 0x7f987419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 >> 172.21.15.38:0/2917781778 conn(0x7f98740ff910 msgr2=0x7f9874100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 shutdown_connections 2024-09-12T12:25:31.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:31.269+0000 7f9879c00640 1 -- 172.21.15.38:0/2917781778 wait complete. 2024-09-12T12:25:31.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:31 smithi154 ceph-mon[35578]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T12:25:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:31 smithi071 ceph-mon[34859]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T12:25:32.018 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:22:55.298669+0000', 'modified': '2024-09-12T12:23:48.221685+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24557, 'mds_1': 24529, 'mds_2': 24515, 'mds_3': 24508, 'mds_4': 24502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14526': {'gid': 14526, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6839/4044590502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6838', 'nonce': 4044590502}, {'type': 'v1', 'addr': '172.21.15.38:6839', 'nonce': 4044590502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14538': {'gid': 14538, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6841/1563078137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6840', 'nonce': 1563078137}, {'type': 'v1', 'addr': '172.21.15.38:6841', 'nonce': 1563078137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6833/3768607144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 3768607144}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 3768607144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/632951998', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 632951998}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 632951998}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/2977480232', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 2977480232}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 2977480232}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.154:6835/3632627850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3632627850}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3632627850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.154:6837/973401105', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 973401105}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 973401105}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.71:6837/293615032', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 293615032}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 293615032}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.154:6839/2253548650', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 2253548650}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 2253548650}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24557': {'gid': 24557, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.71:6839/3960727102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3960727102}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3960727102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24557, 'qdb_cluster': [24502, 24515, 24508, 24529, 24557]} 2024-09-12T12:25:32.018 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T12:25:32.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T12:25:32.401 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:32.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:32 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2917781778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:32.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:32 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2917781778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:32.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:32 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2917781778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:32.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 -- 172.21.15.38:0/4075914619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 msgr2=0x7f6e1c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 --2- 172.21.15.38:0/4075914619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 0x7f6e1c114e20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009ca0 tx=0x7f6e1402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 -- 172.21.15.38:0/4075914619 shutdown_connections 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 --2- 172.21.15.38:0/4075914619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 0x7f6e1c114e20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 --2- 172.21.15.38:0/4075914619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e1c077040 0x7f6e1c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 --2- 172.21.15.38:0/4075914619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 0x7f6e1c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 -- 172.21.15.38:0/4075914619 >> 172.21.15.38:0/4075914619 conn(0x7f6e1c0ffa90 msgr2=0x7f6e1c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 -- 172.21.15.38:0/4075914619 shutdown_connections 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.972+0000 7f6e22200640 1 -- 172.21.15.38:0/4075914619 wait complete. 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.973+0000 7f6e22200640 1 Processor -- start 2024-09-12T12:25:32.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.973+0000 7f6e22200640 1 -- start start 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e22200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 0x7f6e1c1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e22200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e1c077040 0x7f6e1c1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e22200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 0x7f6e1c19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e22200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c118590 con 0x7f6e1c112a30 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e22200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c118410 con 0x7f6e1c076720 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e22200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c118710 con 0x7f6e1c077040 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e1be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 0x7f6e1c19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 0x7f6e1c1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e1aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e1c077040 0x7f6e1c1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 0x7f6e1c1a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:42914/0 (socket says 172.21.15.38:42914) 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e1be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 0x7f6e1c19e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57822/0 (socket says 172.21.15.38:57822) 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.974+0000 7f6e1b400640 1 -- 172.21.15.38:0/3473087856 learned_addr learned my addr 172.21.15.38:0/3473087856 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e1b400640 1 -- 172.21.15.38:0/3473087856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e1c077040 msgr2=0x7f6e1c1a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e1b400640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e1c077040 0x7f6e1c1a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e1b400640 1 -- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 msgr2=0x7f6e1c19e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e1b400640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 0x7f6e1c19e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e1b400640 1 -- 172.21.15.38:0/3473087856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c19efb0 con 0x7f6e1c076720 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e1b400640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 0x7f6e1c1a46c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00ea60 tx=0x7f6e0c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e13e00640 1 -- 172.21.15.38:0/3473087856 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00cde0 con 0x7f6e1c076720 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c19f2a0 con 0x7f6e1c076720 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e13e00640 1 -- 172.21.15.38:0/3473087856 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e0c0035f0 con 0x7f6e1c076720 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.975+0000 7f6e13e00640 1 -- 172.21.15.38:0/3473087856 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c010670 con 0x7f6e1c076720 2024-09-12T12:25:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.976+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c1ab590 con 0x7f6e1c076720 2024-09-12T12:25:32.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.979+0000 7f6e13e00640 1 -- 172.21.15.38:0/3473087856 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e0c0037a0 con 0x7f6e1c076720 2024-09-12T12:25:32.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.980+0000 7f6e24e6b740 1 Processor -- start 2024-09-12T12:25:32.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.980+0000 7f6e24e6b740 1 -- start start 2024-09-12T12:25:32.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.980+0000 7f6e13e00640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e000a2c00 0x7f6e000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.980+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e13e00640 1 -- 172.21.15.38:0/3473087856 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f6e0c0cf680 con 0x7f6e1c076720 2024-09-12T12:25:32.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b96142a0b0 con 0x55b9614c4330 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b9613d1ab0 con 0x55b9614cf510 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b961426070 con 0x55b9614c4c50 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e1be00640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e000a2c00 0x7f6e000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e1be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e1be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:42924/0 (socket says 172.21.15.38:42924) 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e1be00640 1 -- 172.21.15.38:0/1348228844 learned_addr learned my addr 172.21.15.38:0/1348228844 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:32.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.981+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e1b400640 1 -- 172.21.15.38:0/1348228844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 msgr2=0x55b9614cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:32.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e1b400640 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e1b400640 1 -- 172.21.15.38:0/1348228844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 msgr2=0x55b9614d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e1b400640 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e1b400640 1 -- 172.21.15.38:0/1348228844 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9613de4a0 con 0x55b9614c4330 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e1be00640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e000a2c00 0x7f6e000a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e1402f540 tx=0x7f6e1402f430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e1b400640 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614c4710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ccd70 tx=0x7f6e0c097e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00b62ec96ed55d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e07e00640 1 -- 172.21.15.38:0/1348228844 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c09bad0 con 0x55b9614c4330 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e07e00640 1 -- 172.21.15.38:0/1348228844 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e0c09fe80 con 0x55b9614c4330 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.982+0000 7f6e07e00640 1 -- 172.21.15.38:0/1348228844 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c098140 con 0x55b9614c4330 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1348228844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 msgr2=0x55b9614c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614c4710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ccd70 tx=0x7f6e0c097e80 comp rx=0 tx=0).stop 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1348228844 shutdown_connections 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1348228844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614c4710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1348228844 >> 172.21.15.38:0/1348228844 conn(0x55b9614c08c0 msgr2=0x55b9614c0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:32.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1348228844 shutdown_connections 2024-09-12T12:25:32.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.983+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1348228844 wait complete. 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.984+0000 7f6e24e6b740 1 -- start start 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.984+0000 7f6e24e6b740 1 Processor -- start 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b9614d2060 con 0x55b9614c4330 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b9613b2920 con 0x55b9614cf510 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b9614d21e0 con 0x55b9614c4c50 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e24e6b740 10 client.0 _ll_register_callbacks cb 0x55b9613d68a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57840/0 (socket says 172.21.15.38:57840) 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 -- 172.21.15.38:0/1185510933 learned_addr learned my addr 172.21.15.38:0/1185510933 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:32.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1be00640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 -- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 msgr2=0x55b9614cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 -- 172.21.15.38:0/1185510933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 msgr2=0x55b9614ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1b400640 1 -- 172.21.15.38:0/1185510933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96119b2b0 con 0x55b9614c4330 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.985+0000 7f6e1be00640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e1b400640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614cc4d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0977b0 tx=0x7f6e0c099fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e1de2c27fc7de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e04c00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e04c00640 1 -- 172.21.15.38:0/1185510933 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c099b70 con 0x55b9614c4330 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e04c00640 1 -- 172.21.15.38:0/1185510933 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f6e0c0cf340 con 0x55b9614c4330 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e0c09fe80 con 0x55b9614c4330 2024-09-12T12:25:32.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e04c00640 1 -- 172.21.15.38:0/1185510933 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6e0c003c30 con 0x55b9614c4330 2024-09-12T12:25:32.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e24e6b740 10 client.15129 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:32.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.986+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b9614dddc0 con 0x55b9614c4330 2024-09-12T12:25:32.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e04c00640 1 -- 172.21.15.38:0/1185510933 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e0c09fe80 con 0x55b9614c4330 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e04c00640 1 -- 172.21.15.38:0/1185510933 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6e0c09af20 con 0x55b9614c4330 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e24e6b740 10 client.15129 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e24e6b740 10 client.15129 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e24e6b740 20 client.15129 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b9614dff30 0x55b9614e13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e24e6b740 4 client.15129 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b961437620 con 0x55b9614dff30 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.987+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b9614dff30 0x55b9614e13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.988+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b9614dff30 0x55b9614e13a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9c706875bdf5001f server_cookie=23f9998e1fbab53f in_seq=0 out_seq=0 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.988+0000 7f6e04c00640 10 client.15129 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.989+0000 7f6e04c00640 1 -- 172.21.15.38:0/1185510933 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b961437620 con 0x55b9614dff30 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.989+0000 7f6e04c00640 10 client.15129 handle_command_reply: tid=0 2024-09-12T12:25:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.989+0000 7f6e24e6b740 1 client.15129 shutdown 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.989+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 msgr2=0x55b9614cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.989+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614cc4d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0977b0 tx=0x7f6e0c099fe0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 shutdown_connections 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b9614dff30 0x55b9614e13a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614cf510 0x55b9614ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614c4c50 0x55b9614cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/1185510933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614cc4d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e04c00640 0 client.15129 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 >> 172.21.15.38:0/1185510933 conn(0x55b9614c08c0 msgr2=0x55b9614c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 shutdown_connections 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 1 -- 172.21.15.38:0/1185510933 wait complete. 2024-09-12T12:25:32.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:32.990+0000 7f6e24e6b740 20 client.15129 trim_cache size 0 max 16384 2024-09-12T12:25:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 Processor -- start 2024-09-12T12:25:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 -- start start 2024-09-12T12:25:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b9614df6e0 con 0x55b9614c4330 2024-09-12T12:25:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b9614dfdb0 con 0x55b9614c4c50 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b9614e0480 con 0x55b9614cf510 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57852/0 (socket says 172.21.15.38:57852) 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e1b400640 1 -- 172.21.15.38:0/2637933444 learned_addr learned my addr 172.21.15.38:0/2637933444 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.010+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1be00640 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1b400640 1 -- 172.21.15.38:0/2637933444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 msgr2=0x55b9614c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1b400640 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1b400640 1 -- 172.21.15.38:0/2637933444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 msgr2=0x55b9614c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1b400640 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1b400640 1 -- 172.21.15.38:0/2637933444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9614d1b30 con 0x55b9614c4330 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1be00640 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e1b400640 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614ccda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c09ba60 tx=0x7f6e0c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48fe5fb144b5614 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:33.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e07400640 1 -- 172.21.15.38:0/2637933444 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c099b70 con 0x55b9614c4330 2024-09-12T12:25:33.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e07400640 1 -- 172.21.15.38:0/2637933444 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e0c097b70 con 0x55b9614c4330 2024-09-12T12:25:33.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.011+0000 7f6e07400640 1 -- 172.21.15.38:0/2637933444 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c098140 con 0x55b9614c4330 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 -- 172.21.15.38:0/2637933444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 msgr2=0x55b9614ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614ccda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c09ba60 tx=0x7f6e0c003f30 comp rx=0 tx=0).stop 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 -- 172.21.15.38:0/2637933444 shutdown_connections 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/2637933444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614ccda0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 -- 172.21.15.38:0/2637933444 >> 172.21.15.38:0/2637933444 conn(0x55b9614c08c0 msgr2=0x55b9614cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 -- 172.21.15.38:0/2637933444 shutdown_connections 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.012+0000 7f6e24e6b740 1 -- 172.21.15.38:0/2637933444 wait complete. 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 -- start start 2024-09-12T12:25:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 Processor -- start 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614e43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b9614e1220 con 0x55b9614c4330 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b9614e0b50 con 0x55b9614c4c50 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b9614e18f0 con 0x55b9614cf510 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.013+0000 7f6e24e6b740 10 client.0 _ll_register_callbacks cb 0x7f6e0c09b8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614e48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:42958/0 (socket says 172.21.15.38:42958) 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 -- 172.21.15.38:0/3470027941 learned_addr learned my addr 172.21.15.38:0/3470027941 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614e43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1be00640 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 -- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 msgr2=0x55b9614e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 -- 172.21.15.38:0/3470027941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 msgr2=0x55b9614e43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614e43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 -- 172.21.15.38:0/3470027941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9614e9670 con 0x55b9614c4c50 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1b400640 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614e43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e1aa00640 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614e48e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55b9614c1720 tx=0x7f6e08010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b5d1f32efea5e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.014+0000 7f6e04c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.015+0000 7f6e04c00640 1 -- 172.21.15.38:0/3470027941 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e08004460 con 0x55b9614c4c50 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.015+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e0c097b70 con 0x55b9614c4c50 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.015+0000 7f6e04c00640 1 -- 172.21.15.38:0/3470027941 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f6e080035f0 con 0x55b9614c4c50 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.015+0000 7f6e04c00640 1 -- 172.21.15.38:0/3470027941 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6e0802f050 con 0x55b9614c4c50 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.015+0000 7f6e24e6b740 10 client.25145 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.015+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b96154ac90 con 0x55b9614c4c50 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e04c00640 1 -- 172.21.15.38:0/3470027941 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e0c097b70 con 0x55b9614c4c50 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e04c00640 1 -- 172.21.15.38:0/3470027941 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6e08025030 con 0x55b9614c4c50 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e24e6b740 10 client.25145 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e24e6b740 10 client.25145 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e24e6b740 20 client.25145 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b96154f880 0x55b96154e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e24e6b740 4 client.25145 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "status"}) -- 0x55b961431b30 con 0x55b96154f880 2024-09-12T12:25:33.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.016+0000 7f6e1b400640 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b96154f880 0x55b96154e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e1b400640 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b96154f880 0x55b96154e590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2cd28c5f32b1e1bc server_cookie=a50ec64d45c16fc1 in_seq=0 out_seq=0 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e04c00640 10 client.25145 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e04c00640 1 -- 172.21.15.38:0/3470027941 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b961431b30 con 0x55b96154f880 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e04c00640 10 client.25145 handle_command_reply: tid=0 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 client.25145 shutdown 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 msgr2=0x55b9614e48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614e48e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55b9614c1720 tx=0x7f6e08010800 comp rx=0 tx=0).stop 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 shutdown_connections 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55b96154f880 0x55b96154e590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b9614cf510 0x55b9614e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9614c4c50 0x55b9614e48e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e24e6b740 1 --2- 172.21.15.38:0/3470027941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b9614c4330 0x55b9614e43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.017+0000 7f6e04c00640 0 client.25145 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.018+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 >> 172.21.15.38:0/3470027941 conn(0x55b9614c08c0 msgr2=0x55b9614da460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.018+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 shutdown_connections 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.018+0000 7f6e24e6b740 1 -- 172.21.15.38:0/3470027941 wait complete. 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.018+0000 7f6e24e6b740 20 client.25145 trim_cache size 0 max 16384 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 4, 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24502, 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:33.023 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:33.024 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 105.841272934, 2024-09-12T12:25:33.024 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:33.024 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:33.024 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:33.024 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 187.95404736200001 2024-09-12T12:25:33.024 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e000a2c00 msgr2=0x7f6e000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e000a2c00 0x7f6e000a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e1402f540 tx=0x7f6e1402f430 comp rx=0 tx=0).stop 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 msgr2=0x7f6e1c1a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 0x7f6e1c1a46c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00ea60 tx=0x7f6e0c00ef20 comp rx=0 tx=0).stop 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 shutdown_connections 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6e000a2c00 0x7f6e000a50c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e1c112a30 0x7f6e1c19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e1c077040 0x7f6e1c1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 --2- 172.21.15.38:0/3473087856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1c076720 0x7f6e1c1a46c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 >> 172.21.15.38:0/3473087856 conn(0x7f6e1c0ffa90 msgr2=0x7f6e1c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:33.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 shutdown_connections 2024-09-12T12:25:33.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:33.019+0000 7f6e22200640 1 -- 172.21.15.38:0/3473087856 wait complete. 2024-09-12T12:25:33.424 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:33 smithi038 ceph-mon[30810]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-12T12:25:33.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:33 smithi071 ceph-mon[34859]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-12T12:25:33.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:33 smithi154 ceph-mon[35578]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-12T12:25:33.904 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T12:25:34.283 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 -- 172.21.15.38:0/1635348089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 msgr2=0x7f5c8410e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 --2- 172.21.15.38:0/1635348089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8410e440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009ca0 tx=0x7f5c7c02a950 comp rx=0 tx=0).stop 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 -- 172.21.15.38:0/1635348089 shutdown_connections 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 --2- 172.21.15.38:0/1635348089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8410e440 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 --2- 172.21.15.38:0/1635348089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c84103490 0x7f5c8410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 --2- 172.21.15.38:0/1635348089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 0x7f5c84102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 -- 172.21.15.38:0/1635348089 >> 172.21.15.38:0/1635348089 conn(0x7f5c840fc5d0 msgr2=0x7f5c840fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 -- 172.21.15.38:0/1635348089 shutdown_connections 2024-09-12T12:25:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.808+0000 7f5c89000640 1 -- 172.21.15.38:0/1635348089 wait complete. 2024-09-12T12:25:34.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.809+0000 7f5c89000640 1 Processor -- start 2024-09-12T12:25:34.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.809+0000 7f5c89000640 1 -- start start 2024-09-12T12:25:34.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c89000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 0x7f5c8419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c89000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c84103490 0x7f5c8419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c89000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c89000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84111de0 con 0x7f5c8410bfa0 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c89000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84111c60 con 0x7f5c84102b70 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c89000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84111f60 con 0x7f5c84103490 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c83e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c82a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c84103490 0x7f5c8419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c83400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 0x7f5c8419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c83400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 0x7f5c8419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:42982/0 (socket says 172.21.15.38:42982) 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c83e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8419ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57864/0 (socket says 172.21.15.38:57864) 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c83400640 1 -- 172.21.15.38:0/383682819 learned_addr learned my addr 172.21.15.38:0/383682819 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.810+0000 7f5c82a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c84103490 0x7f5c8419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58368/0 (socket says 172.21.15.38:58368) 2024-09-12T12:25:34.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c83400640 1 -- 172.21.15.38:0/383682819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c84103490 msgr2=0x7f5c8419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c83400640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c84103490 0x7f5c8419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c83400640 1 -- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 msgr2=0x7f5c8419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c83400640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c83400640 1 -- 172.21.15.38:0/383682819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8419f410 con 0x7f5c84102b70 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c83e00640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c83400640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 0x7f5c8419a460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400e9f0 tx=0x7f5c7400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c7be00640 1 -- 172.21.15.38:0/383682819 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400cd80 con 0x7f5c84102b70 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8419f700 con 0x7f5c84102b70 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.811+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c841a6fe0 con 0x7f5c84102b70 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.812+0000 7f5c7be00640 1 -- 172.21.15.38:0/383682819 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c74010910 con 0x7f5c84102b70 2024-09-12T12:25:34.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.812+0000 7f5c7be00640 1 -- 172.21.15.38:0/383682819 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74026060 con 0x7f5c84102b70 2024-09-12T12:25:34.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 Processor -- start 2024-09-12T12:25:34.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 -- start start 2024-09-12T12:25:34.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c7be00640 1 -- 172.21.15.38:0/383682819 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5c74010ac0 con 0x7f5c84102b70 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c28f6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28f66c0 0x5590c28f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5590c28510b0 con 0x5590c28ebe00 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5590c27f8ab0 con 0x5590c28eb4e0 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590c284d070 con 0x5590c28f66c0 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c83400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c28f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c83400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c28f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57872/0 (socket says 172.21.15.38:57872) 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c83400640 1 -- 172.21.15.38:0/3611400892 learned_addr learned my addr 172.21.15.38:0/3611400892 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.815+0000 7f5c82a00640 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28f66c0 0x5590c28f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c83e00640 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c82a00640 1 -- 172.21.15.38:0/3611400892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 msgr2=0x5590c28eb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c82a00640 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28eb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c82a00640 1 -- 172.21.15.38:0/3611400892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 msgr2=0x5590c28f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c82a00640 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c28f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c82a00640 1 -- 172.21.15.38:0/3611400892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c28054a0 con 0x5590c28f66c0 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c83400640 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c28f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.816+0000 7f5c82a00640 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28f66c0 0x5590c28f8ab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009bc0 tx=0x7f5c70011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7815d37de18a5fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c78c00640 1 -- 172.21.15.38:0/3611400892 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70004050 con 0x5590c28f66c0 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c78c00640 1 -- 172.21.15.38:0/3611400892 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c70005500 con 0x5590c28f66c0 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c78c00640 1 -- 172.21.15.38:0/3611400892 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70004e10 con 0x5590c28f66c0 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c7be00640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5c680a2c00 0x7f5c680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c7be00640 1 -- 172.21.15.38:0/383682819 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f5c740cf750 con 0x7f5c84102b70 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c83e00640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5c680a2c00 0x7f5c680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/3611400892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28f66c0 msgr2=0x5590c28f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.817+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28f66c0 0x5590c28f8ab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009bc0 tx=0x7f5c70011810 comp rx=0 tx=0).stop 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/3611400892 shutdown_connections 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28f66c0 0x5590c28f8ab0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c28f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/3611400892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28eb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/3611400892 >> 172.21.15.38:0/3611400892 conn(0x5590c28e7a70 msgr2=0x5590c28e7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/3611400892 shutdown_connections 2024-09-12T12:25:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/3611400892 wait complete. 2024-09-12T12:25:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c83e00640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5c680a2c00 0x7f5c680a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006010 tx=0x7f5c7c005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.818+0000 7f5c8d0b6740 1 -- start start 2024-09-12T12:25:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 1 Processor -- start 2024-09-12T12:25:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28ebe00 0x5590c28f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5590c28f9330 con 0x5590c28f66c0 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5590c27d9920 con 0x5590c28ebe00 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590c28f94b0 con 0x5590c28eb4e0 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c8d0b6740 10 client.0 _ll_register_callbacks cb 0x5590c27fd8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c83400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c83e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c83400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58384/0 (socket says 172.21.15.38:58384) 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c82a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28ebe00 0x5590c28f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c83e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57880/0 (socket says 172.21.15.38:57880) 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.819+0000 7f5c83400640 1 -- 172.21.15.38:0/1090549171 learned_addr learned my addr 172.21.15.38:0/1090549171 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c83400640 1 -- 172.21.15.38:0/1090549171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28ebe00 msgr2=0x5590c28f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c83400640 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28ebe00 0x5590c28f3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c83400640 1 -- 172.21.15.38:0/1090549171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 msgr2=0x5590c28f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c83400640 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c83400640 1 -- 172.21.15.38:0/1090549171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c25c22b0 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c83e00640 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c83400640 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f34c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c74000c00 tx=0x7f5c74097fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86490ea1b39d3478 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c6d600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c6d600640 1 -- 172.21.15.38:0/1090549171 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74010db0 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c70005500 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.820+0000 7f5c6d600640 1 -- 172.21.15.38:0/1090549171 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f5c740cf400 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c6d600640 1 -- 172.21.15.38:0/1090549171 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5c7409bc50 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 10 client.25147 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590c2905040 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c6d600640 1 -- 172.21.15.38:0/1090549171 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c70005500 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c6d600640 1 -- 172.21.15.38:0/1090549171 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5c7409b0a0 con 0x5590c28eb4e0 2024-09-12T12:25:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 10 client.25147 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 10 client.25147 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 20 client.25147 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2907630 0x5590c2908aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 4 client.25147 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.821+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590c285e620 con 0x5590c2907630 2024-09-12T12:25:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.822+0000 7f5c82a00640 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2907630 0x5590c2908aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.822+0000 7f5c82a00640 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2907630 0x5590c2908aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c476dde89ded78b8 server_cookie=811ff6922e6c4c32 in_seq=0 out_seq=0 2024-09-12T12:25:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.822+0000 7f5c6d600640 10 client.25147 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.823+0000 7f5c6d600640 1 -- 172.21.15.38:0/1090549171 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590c285e620 con 0x5590c2907630 2024-09-12T12:25:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.823+0000 7f5c6d600640 10 client.25147 handle_command_reply: tid=0 2024-09-12T12:25:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.823+0000 7f5c8d0b6740 1 client.25147 shutdown 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 msgr2=0x5590c28f34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f34c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c74000c00 tx=0x7f5c74097fe0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 shutdown_connections 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2907630 0x5590c2908aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28ebe00 0x5590c28f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1090549171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f34c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 >> 172.21.15.38:0/1090549171 conn(0x5590c28e7a70 msgr2=0x5590c28ed7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c6d600640 0 client.25147 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 shutdown_connections 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1090549171 wait complete. 2024-09-12T12:25:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.824+0000 7f5c8d0b6740 20 client.25147 trim_cache size 0 max 16384 2024-09-12T12:25:34.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 Processor -- start 2024-09-12T12:25:34.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 -- start start 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c2901ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28f66c0 0x5590c28f0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5590c2906de0 con 0x5590c28ebe00 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5590c29074b0 con 0x5590c28f66c0 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.843+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590c2907b80 con 0x5590c28eb4e0 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c2901ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c2901ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57882/0 (socket says 172.21.15.38:57882) 2024-09-12T12:25:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 -- 172.21.15.38:0/2554108503 learned_addr learned my addr 172.21.15.38:0/2554108503 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c83e00640 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28f66c0 0x5590c28f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c83400640 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 -- 172.21.15.38:0/2554108503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 msgr2=0x5590c28f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 -- 172.21.15.38:0/2554108503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28f66c0 msgr2=0x5590c28f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28f66c0 0x5590c28f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 -- 172.21.15.38:0/2554108503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c28e7510 con 0x5590c28ebe00 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c83400640 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.844+0000 7f5c82a00640 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c2901ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009bc0 tx=0x7f5c70009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af90743bab3eccf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c6fe00640 1 -- 172.21.15.38:0/2554108503 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70004050 con 0x5590c28ebe00 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c6fe00640 1 -- 172.21.15.38:0/2554108503 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c700035f0 con 0x5590c28ebe00 2024-09-12T12:25:34.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c6fe00640 1 -- 172.21.15.38:0/2554108503 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7002d6a0 con 0x5590c28ebe00 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/2554108503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 msgr2=0x5590c2901ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c2901ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009bc0 tx=0x7f5c70009900 comp rx=0 tx=0).stop 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/2554108503 shutdown_connections 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28f66c0 0x5590c28f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28ebe00 0x5590c2901ea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/2554108503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28eb4e0 0x5590c28f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/2554108503 >> 172.21.15.38:0/2554108503 conn(0x5590c28e7a70 msgr2=0x5590c2901790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/2554108503 shutdown_connections 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.845+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/2554108503 wait complete. 2024-09-12T12:25:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 -- start start 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 Processor -- start 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28ebe00 0x5590c28f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5590c2908920 con 0x5590c28f66c0 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5590c2908250 con 0x5590c28eb4e0 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.846+0000 7f5c8d0b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590c2908ff0 con 0x5590c28ebe00 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c8d0b6740 10 client.0 _ll_register_callbacks cb 0x7f5c740ccd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28ebe00 0x5590c28f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c83400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28ebe00 0x5590c28f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:58408/0 (socket says 172.21.15.38:58408) 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c83e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 -- 172.21.15.38:0/1759172107 learned_addr learned my addr 172.21.15.38:0/1759172107 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 -- 172.21.15.38:0/1759172107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 msgr2=0x5590c28f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 -- 172.21.15.38:0/1759172107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 msgr2=0x5590c28f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.847+0000 7f5c82a00640 1 -- 172.21.15.38:0/1759172107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c290ffd0 con 0x5590c28ebe00 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.848+0000 7f5c82a00640 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28ebe00 0x5590c28f70a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c70005c20 tx=0x7f5c70009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef285db049a02df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.848+0000 7f5c6d600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.848+0000 7f5c6d600640 1 -- 172.21.15.38:0/1759172107 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70004460 con 0x5590c28ebe00 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.848+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c700035f0 con 0x5590c28ebe00 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.848+0000 7f5c6d600640 1 -- 172.21.15.38:0/1759172107 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f5c700037a0 con 0x5590c28ebe00 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.848+0000 7f5c6d600640 1 -- 172.21.15.38:0/1759172107 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5c70046050 con 0x5590c28ebe00 2024-09-12T12:25:34.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 10 client.25153 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590c29112d0 con 0x5590c28ebe00 2024-09-12T12:25:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c6d600640 1 -- 172.21.15.38:0/1759172107 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c700035f0 con 0x5590c28ebe00 2024-09-12T12:25:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c6d600640 1 -- 172.21.15.38:0/1759172107 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5c7002d9d0 con 0x5590c28ebe00 2024-09-12T12:25:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 10 client.25153 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 10 client.25153 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 20 client.25153 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2975890 0x5590c29745a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 4 client.25153 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.849+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "status"}) -- 0x5590c2858b30 con 0x5590c2975890 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.850+0000 7f5c83400640 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2975890 0x5590c29745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.850+0000 7f5c83400640 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2975890 0x5590c29745a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=60d11f0bff57c906 server_cookie=643439b7b0a34492 in_seq=0 out_seq=0 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.850+0000 7f5c6d600640 10 client.25153 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c6d600640 1 -- 172.21.15.38:0/1759172107 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5590c2858b30 con 0x5590c2975890 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c6d600640 10 client.25153 handle_command_reply: tid=0 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 client.25153 shutdown 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28ebe00 msgr2=0x5590c28f70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28ebe00 0x5590c28f70a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c70005c20 tx=0x7f5c70009800 comp rx=0 tx=0).stop 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 shutdown_connections 2024-09-12T12:25:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5590c2975890 0x5590c29745a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590c28f66c0 0x5590c28f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590c28ebe00 0x5590c28f70a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c6d600640 0 client.25153 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 --2- 172.21.15.38:0/1759172107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c28eb4e0 0x5590c28f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 >> 172.21.15.38:0/1759172107 conn(0x5590c28e7a70 msgr2=0x5590c2901fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 shutdown_connections 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 1 -- 172.21.15.38:0/1759172107 wait complete. 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.851+0000 7f5c8d0b6740 20 client.25153 trim_cache size 0 max 16384 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:34.854 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 3, 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24508, 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 108.687259688, 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 187.16254926100001 2024-09-12T12:25:34.855 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5c680a2c00 msgr2=0x7f5c680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5c680a2c00 0x7f5c680a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006010 tx=0x7f5c7c005d80 comp rx=0 tx=0).stop 2024-09-12T12:25:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 msgr2=0x7f5c8419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 0x7f5c8419a460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400e9f0 tx=0x7f5c7400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 shutdown_connections 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f5c680a2c00 0x7f5c680a50c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c8410bfa0 0x7f5c8419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c84103490 0x7f5c8419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 --2- 172.21.15.38:0/383682819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c84102b70 0x7f5c8419a460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 >> 172.21.15.38:0/383682819 conn(0x7f5c840fc5d0 msgr2=0x7f5c84101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.852+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 shutdown_connections 2024-09-12T12:25:34.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:34.853+0000 7f5c89000640 1 -- 172.21.15.38:0/383682819 wait complete. 2024-09-12T12:25:35.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:35 smithi038 ceph-mon[30810]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s 2024-09-12T12:25:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:35 smithi071 ceph-mon[34859]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s 2024-09-12T12:25:35.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:35 smithi154 ceph-mon[35578]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s 2024-09-12T12:25:35.859 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T12:25:36.238 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:36.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 -- 172.21.15.38:0/1347521391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584076720 msgr2=0x7f6584076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 --2- 172.21.15.38:0/1347521391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584076720 0x7f6584076b00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6574009ca0 tx=0x7f657402a8b0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 -- 172.21.15.38:0/1347521391 shutdown_connections 2024-09-12T12:25:36.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 --2- 172.21.15.38:0/1347521391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6584112a30 0x7f6584114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 --2- 172.21.15.38:0/1347521391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6584077040 0x7f65841124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 --2- 172.21.15.38:0/1347521391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584076720 0x7f6584076b00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 -- 172.21.15.38:0/1347521391 >> 172.21.15.38:0/1347521391 conn(0x7f65840ffa90 msgr2=0x7f6584101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 -- 172.21.15.38:0/1347521391 shutdown_connections 2024-09-12T12:25:36.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.752+0000 7f6589e00640 1 -- 172.21.15.38:0/1347521391 wait complete. 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 Processor -- start 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 -- start start 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6584076720 0x7f65841a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6584077040 0x7f65841a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584112a30 0x7f658419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f65841185f0 con 0x7f6584112a30 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6584118470 con 0x7f6584076720 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6589e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6584118770 con 0x7f6584077040 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6583400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584112a30 0x7f658419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.753+0000 7f6582a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6584076720 0x7f65841a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6582000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6584077040 0x7f65841a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584112a30 0x7f658419e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36294/0 (socket says 172.21.15.38:36294) 2024-09-12T12:25:36.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 -- 172.21.15.38:0/1374969549 learned_addr learned my addr 172.21.15.38:0/1374969549 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:36.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6582a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6584076720 0x7f65841a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:45926/0 (socket says 172.21.15.38:45926) 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 -- 172.21.15.38:0/1374969549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6584077040 msgr2=0x7f65841a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6584077040 0x7f65841a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 -- 172.21.15.38:0/1374969549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6584076720 msgr2=0x7f65841a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6584076720 0x7f65841a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 -- 172.21.15.38:0/1374969549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658419eff0 con 0x7f6584112a30 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6582000640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6584077040 0x7f65841a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.754+0000 7f6583400640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584112a30 0x7f658419e8c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f657c00d6a0 tx=0x7f657c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.755+0000 7f6588a00640 1 -- 172.21.15.38:0/1374969549 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c017070 con 0x7f6584112a30 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.755+0000 7f6588a00640 1 -- 172.21.15.38:0/1374969549 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f657c009820 con 0x7f6584112a30 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.755+0000 7f6588a00640 1 -- 172.21.15.38:0/1374969549 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c004ce0 con 0x7f6584112a30 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.755+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658419f2e0 con 0x7f6584112a30 2024-09-12T12:25:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.755+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65841ab5d0 con 0x7f6584112a30 2024-09-12T12:25:36.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.758+0000 7f658c7cc740 1 Processor -- start 2024-09-12T12:25:36.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.758+0000 7f6588a00640 1 -- 172.21.15.38:0/1374969549 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f657c0099d0 con 0x7f6584112a30 2024-09-12T12:25:36.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.758+0000 7f658c7cc740 1 -- start start 2024-09-12T12:25:36.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e18710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e22fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e23510 0x564a22e25900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f658c7cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564a22d7e0b0 con 0x564a22e18c50 2024-09-12T12:25:36.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f658c7cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a22d25ab0 con 0x564a22e23510 2024-09-12T12:25:36.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f658c7cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a22d7a070 con 0x564a22e18330 2024-09-12T12:25:36.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e22fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e22fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36310/0 (socket says 172.21.15.38:36310) 2024-09-12T12:25:36.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e18710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 -- 172.21.15.38:0/310971788 learned_addr learned my addr 172.21.15.38:0/310971788 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582000640 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e23510 0x564a22e25900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 -- 172.21.15.38:0/310971788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 msgr2=0x564a22e18710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e18710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 -- 172.21.15.38:0/310971788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e23510 msgr2=0x564a22e25900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e23510 0x564a22e25900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.759+0000 7f6582a00640 1 -- 172.21.15.38:0/310971788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a22d324a0 con 0x564a22e18c50 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.760+0000 7f6588a00640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65680a2c00 0x7f65680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.760+0000 7f6582a00640 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e22fd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6574009890 tx=0x7f65740304e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2ccdfa525c8187 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.760+0000 7f6588a00640 1 -- 172.21.15.38:0/1374969549 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f657c0cec50 con 0x7f6584112a30 2024-09-12T12:25:36.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.760+0000 7f6582000640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65680a2c00 0x7f65680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.760+0000 7f656fe00640 1 -- 172.21.15.38:0/310971788 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574003970 con 0x564a22e18c50 2024-09-12T12:25:36.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.760+0000 7f656fe00640 1 -- 172.21.15.38:0/310971788 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6574036030 con 0x564a22e18c50 2024-09-12T12:25:36.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.760+0000 7f656fe00640 1 -- 172.21.15.38:0/310971788 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740043c0 con 0x564a22e18c50 2024-09-12T12:25:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 -- 172.21.15.38:0/310971788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 msgr2=0x564a22e22fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e22fd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6574009890 tx=0x7f65740304e0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f6582000640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65680a2c00 0x7f65680a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x564a22e15c40 tx=0x7f657000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 -- 172.21.15.38:0/310971788 shutdown_connections 2024-09-12T12:25:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e23510 0x564a22e25900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e22fd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 --2- 172.21.15.38:0/310971788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e18710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 -- 172.21.15.38:0/310971788 >> 172.21.15.38:0/310971788 conn(0x564a22e148c0 msgr2=0x564a22e14ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 -- 172.21.15.38:0/310971788 shutdown_connections 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.761+0000 7f658c7cc740 1 -- 172.21.15.38:0/310971788 wait complete. 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.762+0000 7f658c7cc740 1 -- start start 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.762+0000 7f658c7cc740 1 Processor -- start 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18c50 0x564a22e20a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e23510 0x564a22e20f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f658c7cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564a22e26060 con 0x564a22e23510 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f658c7cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a22d06920 con 0x564a22e18c50 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f658c7cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a22e261e0 con 0x564a22e18330 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f658c7cc740 10 client.0 _ll_register_callbacks cb 0x564a22d2a8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:36.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6583400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e23510 0x564a22e20f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e204f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:45086/0 (socket says 172.21.15.38:45086) 2024-09-12T12:25:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 -- 172.21.15.38:0/1189909797 learned_addr learned my addr 172.21.15.38:0/1189909797 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582000640 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18c50 0x564a22e20a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 -- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18c50 msgr2=0x564a22e20a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18c50 0x564a22e20a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 -- 172.21.15.38:0/1189909797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e23510 msgr2=0x564a22e20f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e23510 0x564a22e20f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6582a00640 1 -- 172.21.15.38:0/1189909797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a22aef2b0 con 0x564a22e18330 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.763+0000 7f6583400640 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e23510 0x564a22e20f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.764+0000 7f6582a00640 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e204f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6574000f80 tx=0x7f6574030b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d4f9241b0da79fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.764+0000 7f656cc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.764+0000 7f656cc00640 1 -- 172.21.15.38:0/1189909797 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574003e10 con 0x564a22e18330 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.764+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6574036030 con 0x564a22e18330 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.764+0000 7f656cc00640 1 -- 172.21.15.38:0/1189909797 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f657404a040 con 0x564a22e18330 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f656cc00640 1 -- 172.21.15.38:0/1189909797 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f657405c050 con 0x564a22e18330 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 10 client.25165 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a22e26060 con 0x564a22e18330 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f656cc00640 1 -- 172.21.15.38:0/1189909797 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6574036030 con 0x564a22e18330 2024-09-12T12:25:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f656cc00640 1 -- 172.21.15.38:0/1189909797 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f657404e070 con 0x564a22e18330 2024-09-12T12:25:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 10 client.25165 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 10 client.25165 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:25:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 20 client.25165 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22e33f60 0x564a22e353d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 4 client.25165 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.765+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a22d8b620 con 0x564a22e33f60 2024-09-12T12:25:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.766+0000 7f6582000640 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22e33f60 0x564a22e353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.766+0000 7f6582000640 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22e33f60 0x564a22e353d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de545c0def813a97 server_cookie=297ff8fe7b68e2ef in_seq=0 out_seq=0 2024-09-12T12:25:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.766+0000 7f656cc00640 10 client.25165 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.767+0000 7f656cc00640 1 -- 172.21.15.38:0/1189909797 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a22d8b620 con 0x564a22e33f60 2024-09-12T12:25:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.767+0000 7f656cc00640 10 client.25165 handle_command_reply: tid=0 2024-09-12T12:25:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.767+0000 7f658c7cc740 1 client.25165 shutdown 2024-09-12T12:25:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 msgr2=0x564a22e204f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e204f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6574000f80 tx=0x7f6574030b60 comp rx=0 tx=0).stop 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 shutdown_connections 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22e33f60 0x564a22e353d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e23510 0x564a22e20f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18c50 0x564a22e20a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 --2- 172.21.15.38:0/1189909797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e18330 0x564a22e204f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 >> 172.21.15.38:0/1189909797 conn(0x564a22e148c0 msgr2=0x564a22e1a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f656cc00640 0 client.25165 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 shutdown_connections 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 1 -- 172.21.15.38:0/1189909797 wait complete. 2024-09-12T12:25:36.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.768+0000 7f658c7cc740 20 client.25165 trim_cache size 0 max 16384 2024-09-12T12:25:36.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 Processor -- start 2024-09-12T12:25:36.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 -- start start 2024-09-12T12:25:36.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18330 0x564a22e32f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e20dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e2eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564a22e33710 con 0x564a22e18c50 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a22e33de0 con 0x564a22e18330 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f658c7cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a22e344b0 con 0x564a22e23510 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f6582000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e20dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f6582000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e20dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36322/0 (socket says 172.21.15.38:36322) 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.787+0000 7f6582000640 1 -- 172.21.15.38:0/3128723635 learned_addr learned my addr 172.21.15.38:0/3128723635 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6582a00640 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18330 0x564a22e32f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6583400640 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e2eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6582000640 1 -- 172.21.15.38:0/3128723635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 msgr2=0x564a22e2eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6582000640 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e2eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6582000640 1 -- 172.21.15.38:0/3128723635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18330 msgr2=0x564a22e32f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6582000640 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18330 0x564a22e32f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6582000640 1 -- 172.21.15.38:0/3128723635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a22e15a50 con 0x564a22e18c50 2024-09-12T12:25:36.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6583400640 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e2eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:36.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f6582000640 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e20dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f65841a00b0 tx=0x7f6570004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757078f08067c7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f656f400640 1 -- 172.21.15.38:0/3128723635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570010970 con 0x564a22e18c50 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f656f400640 1 -- 172.21.15.38:0/3128723635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570005020 con 0x564a22e18c50 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.788+0000 7f656f400640 1 -- 172.21.15.38:0/3128723635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570004a30 con 0x564a22e18c50 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 -- 172.21.15.38:0/3128723635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 msgr2=0x564a22e20dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e20dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f65841a00b0 tx=0x7f6570004730 comp rx=0 tx=0).stop 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 -- 172.21.15.38:0/3128723635 shutdown_connections 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e2eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18c50 0x564a22e20dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 --2- 172.21.15.38:0/3128723635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e18330 0x564a22e32f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 -- 172.21.15.38:0/3128723635 >> 172.21.15.38:0/3128723635 conn(0x564a22e148c0 msgr2=0x564a22e2e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 -- 172.21.15.38:0/3128723635 shutdown_connections 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.789+0000 7f658c7cc740 1 -- 172.21.15.38:0/3128723635 wait complete. 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 -- start start 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 Processor -- start 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18330 0x564a22e37400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e37940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e37e80 0x564a22e3bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564a22e35250 con 0x564a22e18330 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a22e34b80 con 0x564a22e37e80 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a22e35920 con 0x564a22e23510 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f658c7cc740 10 client.0 _ll_register_callbacks cb 0x7f6574030430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.790+0000 7f6582a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18330 0x564a22e37400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18330 0x564a22e37400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36324/0 (socket says 172.21.15.38:36324) 2024-09-12T12:25:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 -- 172.21.15.38:0/2086778579 learned_addr learned my addr 172.21.15.38:0/2086778579 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582000640 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e37940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6583400640 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e37e80 0x564a22e3bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 -- 172.21.15.38:0/2086778579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 msgr2=0x564a22e37940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e37940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 -- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e37e80 msgr2=0x564a22e3bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e37e80 0x564a22e3bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 -- 172.21.15.38:0/2086778579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a22e3c070 con 0x564a22e18330 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f6582a00640 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18330 0x564a22e37400 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6574009ca0 tx=0x7f6574030770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e558756891c19a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.791+0000 7f656cc00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f656cc00640 1 -- 172.21.15.38:0/2086778579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574045a30 con 0x564a22e18330 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6570005020 con 0x564a22e18330 2024-09-12T12:25:36.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f656cc00640 1 -- 172.21.15.38:0/2086778579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f6574054040 con 0x564a22e18330 2024-09-12T12:25:36.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f656cc00640 1 -- 172.21.15.38:0/2086778579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6574045bd0 con 0x564a22e18330 2024-09-12T12:25:36.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 10 client.15171 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:36.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a22e9ec80 con 0x564a22e18330 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f656cc00640 1 -- 172.21.15.38:0/2086778579 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570005020 con 0x564a22e18330 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f656cc00640 1 -- 172.21.15.38:0/2086778579 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6574043070 con 0x564a22e18330 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 10 client.15171 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 10 client.15171 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 20 client.15171 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22ea35c0 0x564a22ea22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 4 client.15171 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.792+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "status"}) -- 0x564a22d85b30 con 0x564a22ea35c0 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.793+0000 7f6582000640 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22ea35c0 0x564a22ea22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.793+0000 7f6582000640 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22ea35c0 0x564a22ea22d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5cf141be5262e280 server_cookie=d6c5c24cc79afe0d in_seq=0 out_seq=0 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.793+0000 7f656cc00640 10 client.15171 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f656cc00640 1 -- 172.21.15.38:0/2086778579 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x564a22d85b30 con 0x564a22ea35c0 2024-09-12T12:25:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f656cc00640 10 client.15171 handle_command_reply: tid=0 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 client.15171 shutdown 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18330 msgr2=0x564a22e37400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18330 0x564a22e37400 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6574009ca0 tx=0x7f6574030770 comp rx=0 tx=0).stop 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 shutdown_connections 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x564a22ea35c0 0x564a22ea22d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a22e37e80 0x564a22e3bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a22e23510 0x564a22e37940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 --2- 172.21.15.38:0/2086778579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564a22e18330 0x564a22e37400 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 >> 172.21.15.38:0/2086778579 conn(0x564a22e148c0 msgr2=0x564a22e2ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f656cc00640 0 client.15171 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 shutdown_connections 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 1 -- 172.21.15.38:0/2086778579 wait complete. 2024-09-12T12:25:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.794+0000 7f658c7cc740 20 client.15171 trim_cache size 0 max 16384 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 2, 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24515, 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 111.654342782, 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:36.799 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:36.800 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:36.800 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 186.49411859 2024-09-12T12:25:36.800 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65680a2c00 msgr2=0x7f65680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65680a2c00 0x7f65680a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x564a22e15c40 tx=0x7f657000b390 comp rx=0 tx=0).stop 2024-09-12T12:25:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584112a30 msgr2=0x7f658419e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584112a30 0x7f658419e8c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f657c00d6a0 tx=0x7f657c00db60 comp rx=0 tx=0).stop 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 shutdown_connections 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f65680a2c00 0x7f65680a50c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6584112a30 0x7f658419e8c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6584077040 0x7f65841a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 --2- 172.21.15.38:0/1374969549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6584076720 0x7f65841a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 >> 172.21.15.38:0/1374969549 conn(0x7f65840ffa90 msgr2=0x7f6584101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 shutdown_connections 2024-09-12T12:25:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:36.795+0000 7f6589e00640 1 -- 172.21.15.38:0/1374969549 wait complete. 2024-09-12T12:25:37.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:37 smithi038 ceph-mon[30810]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T12:25:37.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:37 smithi071 ceph-mon[34859]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T12:25:37.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:25:37.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:37 smithi154 ceph-mon[35578]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-12T12:25:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 -- 172.21.15.38:0/4024070426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 msgr2=0x7f7b44110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 --2- 172.21.15.38:0/4024070426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 0x7f7b44110810 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009ca0 tx=0x7f7b3c02a950 comp rx=0 tx=0).stop 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 -- 172.21.15.38:0/4024070426 shutdown_connections 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 --2- 172.21.15.38:0/4024070426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 0x7f7b44110810 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 --2- 172.21.15.38:0/4024070426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074f40 0x7f7b4410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 --2- 172.21.15.38:0/4024070426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b44074620 0x7f7b44074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 -- 172.21.15.38:0/4024070426 >> 172.21.15.38:0/4024070426 conn(0x7f7b440fd8c0 msgr2=0x7f7b440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 -- 172.21.15.38:0/4024070426 shutdown_connections 2024-09-12T12:25:38.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.530+0000 7f7b4c600640 1 -- 172.21.15.38:0/4024070426 wait complete. 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.531+0000 7f7b4c600640 1 Processor -- start 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.531+0000 7f7b4c600640 1 -- start start 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.531+0000 7f7b4c600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074620 0x7f7b4419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.531+0000 7f7b4c600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b44074f40 0x7f7b4419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.531+0000 7f7b4c600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 0x7f7b4419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b4c600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441141b0 con 0x7f7b4410e3c0 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b4c600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44114030 con 0x7f7b44074620 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b4c600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44114330 con 0x7f7b44074f40 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074620 0x7f7b4419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074620 0x7f7b4419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:45996/0 (socket says 172.21.15.38:45996) 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 -- 172.21.15.38:0/1467911291 learned_addr learned my addr 172.21.15.38:0/1467911291 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b4a600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 0x7f7b4419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49200640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b44074f40 0x7f7b4419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 -- 172.21.15.38:0/1467911291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b44074f40 msgr2=0x7f7b4419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b44074f40 0x7f7b4419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 -- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 msgr2=0x7f7b4419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 0x7f7b4419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.532+0000 7f7b49c00640 1 -- 172.21.15.38:0/1467911291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4419f5e0 con 0x7f7b44074620 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.533+0000 7f7b49c00640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074620 0x7f7b4419a630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e9f0 tx=0x7f7b3800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.533+0000 7f7b42000640 1 -- 172.21.15.38:0/1467911291 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800cd80 con 0x7f7b44074620 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.533+0000 7f7b42000640 1 -- 172.21.15.38:0/1467911291 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b38005500 con 0x7f7b44074620 2024-09-12T12:25:38.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.533+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4419f8d0 con 0x7f7b44074620 2024-09-12T12:25:38.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.533+0000 7f7b42000640 1 -- 172.21.15.38:0/1467911291 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38010690 con 0x7f7b44074620 2024-09-12T12:25:38.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.533+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b441a71b0 con 0x7f7b44074620 2024-09-12T12:25:38.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.536+0000 7f7b4ed22740 1 Processor -- start 2024-09-12T12:25:38.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.536+0000 7f7b4ed22740 1 -- start start 2024-09-12T12:25:38.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.536+0000 7f7b42000640 1 -- 172.21.15.38:0/1467911291 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7b380046c0 con 0x7f7b44074620 2024-09-12T12:25:38.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.536+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1330 0x562a815f1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.536+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a815fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a815fe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562a815570b0 con 0x562a815fc510 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a814feab0 con 0x562a815f1c50 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a81553070 con 0x562a815f1330 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a815fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b4a600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1330 0x562a815f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a815fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a815fe900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36344/0 (socket says 172.21.15.38:36344) 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b4a600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1330 0x562a815f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:45120/0 (socket says 172.21.15.38:45120) 2024-09-12T12:25:38.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 -- 172.21.15.38:0/3209754421 learned_addr learned my addr 172.21.15.38:0/3209754421 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:38.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 -- 172.21.15.38:0/3209754421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1330 msgr2=0x562a815f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1330 0x562a815f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 -- 172.21.15.38:0/3209754421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 msgr2=0x562a815fbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a815fbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49200640 1 -- 172.21.15.38:0/3209754421 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a8150b4a0 con 0x562a815fc510 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.537+0000 7f7b49c00640 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a815fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.538+0000 7f7b49200640 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a815fe900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009c10 tx=0x7f7b30011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a533e0634cd43c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.538+0000 7f7b42000640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7b2c0a2c00 0x7f7b2c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.538+0000 7f7b42000640 1 -- 172.21.15.38:0/1467911291 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7b380cf7d0 con 0x7f7b44074620 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.538+0000 7f7b36a00640 1 -- 172.21.15.38:0/3209754421 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30004230 con 0x562a815fc510 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.538+0000 7f7b36a00640 1 -- 172.21.15.38:0/3209754421 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b300043d0 con 0x562a815fc510 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.538+0000 7f7b36a00640 1 -- 172.21.15.38:0/3209754421 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30004e00 con 0x562a815fc510 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.538+0000 7f7b4a600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7b2c0a2c00 0x7f7b2c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3209754421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 msgr2=0x562a815fe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a815fe900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009c10 tx=0x7f7b30011810 comp rx=0 tx=0).stop 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4a600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7b2c0a2c00 0x7f7b2c0a50c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c006010 tx=0x7f7b3c005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3209754421 shutdown_connections 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a815fe900 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a815fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3209754421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1330 0x562a815f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3209754421 >> 172.21.15.38:0/3209754421 conn(0x562a815ed8c0 msgr2=0x562a815edca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3209754421 shutdown_connections 2024-09-12T12:25:38.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.539+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3209754421 wait complete. 2024-09-12T12:25:38.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 -- start start 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 Processor -- start 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a815f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815fc510 0x562a815f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562a815ff060 con 0x562a815f1330 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a814df920 con 0x562a815fc510 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.540+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a815ff1e0 con 0x562a815f1c50 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b4ed22740 10 client.0 _ll_register_callbacks cb 0x562a815038a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36352/0 (socket says 172.21.15.38:36352) 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 -- 172.21.15.38:0/2533647088 learned_addr learned my addr 172.21.15.38:0/2533647088 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b4a600640 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815fc510 0x562a815f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49200640 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a815f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 -- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 msgr2=0x562a815f9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a815f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 -- 172.21.15.38:0/2533647088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815fc510 msgr2=0x562a815f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815fc510 0x562a815f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 -- 172.21.15.38:0/2533647088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a812c82b0 con 0x562a815f1330 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b49c00640 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f9540 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b3809bbb0 tx=0x7f7b38097f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6567179b10e2d410 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.541+0000 7f7b2b400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b2b400640 1 -- 172.21.15.38:0/2533647088 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380a4600 con 0x562a815f1330 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b2b400640 1 -- 172.21.15.38:0/2533647088 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7b380cfbc0 con 0x562a815f1330 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b300043d0 con 0x562a815f1330 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b2b400640 1 -- 172.21.15.38:0/2533647088 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b3809c320 con 0x562a815f1330 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b4ed22740 10 client.15183 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a8160ae70 con 0x562a815f1330 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b2b400640 1 -- 172.21.15.38:0/2533647088 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b300043d0 con 0x562a815f1330 2024-09-12T12:25:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.542+0000 7f7b2b400640 1 -- 172.21.15.38:0/2533647088 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7b3809b070 con 0x562a815f1330 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.543+0000 7f7b4ed22740 10 client.15183 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.543+0000 7f7b4ed22740 10 client.15183 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.543+0000 7f7b4ed22740 20 client.15183 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.543+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8160dcd0 0x562a8160e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.543+0000 7f7b4ed22740 4 client.15183 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.543+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a81564620 con 0x562a8160dcd0 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.543+0000 7f7b49200640 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8160dcd0 0x562a8160e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.544+0000 7f7b49200640 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8160dcd0 0x562a8160e9a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa3362d87e7217db server_cookie=17ae0c4c689b0d8e in_seq=0 out_seq=0 2024-09-12T12:25:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.544+0000 7f7b2b400640 10 client.15183 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.544+0000 7f7b2b400640 1 -- 172.21.15.38:0/2533647088 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a81564620 con 0x562a8160dcd0 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.544+0000 7f7b2b400640 10 client.15183 handle_command_reply: tid=0 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 client.15183 shutdown 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 msgr2=0x562a815f9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f9540 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b3809bbb0 tx=0x7f7b38097f80 comp rx=0 tx=0).stop 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 shutdown_connections 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8160dcd0 0x562a8160e9a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815fc510 0x562a815f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a815f9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/2533647088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f9540 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 >> 172.21.15.38:0/2533647088 conn(0x562a815ed8c0 msgr2=0x562a815f35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b2b400640 0 client.15183 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 shutdown_connections 2024-09-12T12:25:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 1 -- 172.21.15.38:0/2533647088 wait complete. 2024-09-12T12:25:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.545+0000 7f7b4ed22740 20 client.15183 trim_cache size 0 max 16384 2024-09-12T12:25:38.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 Processor -- start 2024-09-12T12:25:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 -- start start 2024-09-12T12:25:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a8160ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815fc510 0x562a815f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562a8160d210 con 0x562a815f1330 2024-09-12T12:25:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a8160d8e0 con 0x562a815f1c50 2024-09-12T12:25:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.564+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a8160db50 con 0x562a815fc510 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36360/0 (socket says 172.21.15.38:36360) 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 -- 172.21.15.38:0/3604064250 learned_addr learned my addr 172.21.15.38:0/3604064250 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b4a600640 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815fc510 0x562a815f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49200640 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a8160ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 -- 172.21.15.38:0/3604064250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815fc510 msgr2=0x562a815f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815fc510 0x562a815f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 -- 172.21.15.38:0/3604064250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 msgr2=0x562a8160ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a8160ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 -- 172.21.15.38:0/3604064250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a815f10b0 con 0x562a815f1330 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.565+0000 7f7b49c00640 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f8e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e9c0 tx=0x7f7b3800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d82df778064f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b36000640 1 -- 172.21.15.38:0/3604064250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3809ffd0 con 0x562a815f1330 2024-09-12T12:25:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b36000640 1 -- 172.21.15.38:0/3604064250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b380a4890 con 0x562a815f1330 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b36000640 1 -- 172.21.15.38:0/3604064250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380a4660 con 0x562a815f1330 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3604064250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 msgr2=0x562a815f8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f8e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e9c0 tx=0x7f7b3800cf20 comp rx=0 tx=0).stop 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3604064250 shutdown_connections 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815fc510 0x562a815f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a815f1c50 0x562a8160ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/3604064250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815f1330 0x562a815f8e00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3604064250 >> 172.21.15.38:0/3604064250 conn(0x562a815ed8c0 msgr2=0x562a8160c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3604064250 shutdown_connections 2024-09-12T12:25:38.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.566+0000 7f7b4ed22740 1 -- 172.21.15.38:0/3604064250 wait complete. 2024-09-12T12:25:38.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.567+0000 7f7b4ed22740 1 -- start start 2024-09-12T12:25:38.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.567+0000 7f7b4ed22740 1 Processor -- start 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a81617000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a81617540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4ed22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a81611d10 0x562a81612190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562a8160e820 con 0x562a815fc510 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a8160e150 con 0x562a81611d10 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4ed22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a8160eef0 con 0x562a815f1c50 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4ed22740 10 client.0 _ll_register_callbacks cb 0x7f7b38009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b49200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a81617540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a81611d10 0x562a81612190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a81611d10 0x562a81612190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:46030/0 (socket says 172.21.15.38:46030) 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 -- 172.21.15.38:0/1644085396 learned_addr learned my addr 172.21.15.38:0/1644085396 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b49c00640 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a81617000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 -- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 msgr2=0x562a81617000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a81617000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 -- 172.21.15.38:0/1644085396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 msgr2=0x562a81617540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a81617540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b4a600640 1 -- 172.21.15.38:0/1644085396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a816129c0 con 0x562a81611d10 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.568+0000 7f7b49200640 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a81617540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b4a600640 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a81611d10 0x562a81612190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009ca0 tx=0x7f7b3c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e23490284c9134 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b2b400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b2b400640 1 -- 172.21.15.38:0/1644085396 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c034040 con 0x562a81611d10 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b380a4890 con 0x562a81611d10 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b2b400640 1 -- 172.21.15.38:0/1644085396 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7b3c004450 con 0x562a81611d10 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b2b400640 1 -- 172.21.15.38:0/1644085396 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b3c061050 con 0x562a81611d10 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b4ed22740 10 client.25199 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.569+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a81678ca0 con 0x562a81611d10 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b2b400640 1 -- 172.21.15.38:0/1644085396 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b380a4890 con 0x562a81611d10 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b2b400640 1 -- 172.21.15.38:0/1644085396 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7b3c030440 con 0x562a81611d10 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b4ed22740 10 client.25199 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b4ed22740 10 client.25199 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b4ed22740 20 client.25199 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8167d900 0x562a8167c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b4ed22740 4 client.25199 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.570+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "status"}) -- 0x562a8155eb30 con 0x562a8167d900 2024-09-12T12:25:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b49c00640 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8167d900 0x562a8167c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b49c00640 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8167d900 0x562a8167c610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=662a0b720c0455fe server_cookie=7fbbad4af5ef43f2 in_seq=0 out_seq=0 2024-09-12T12:25:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b2b400640 10 client.25199 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b2b400640 1 -- 172.21.15.38:0/1644085396 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562a8155eb30 con 0x562a8167d900 2024-09-12T12:25:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b2b400640 10 client.25199 handle_command_reply: tid=0 2024-09-12T12:25:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b4ed22740 1 client.25199 shutdown 2024-09-12T12:25:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a81611d10 msgr2=0x562a81612190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.571+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a81611d10 0x562a81612190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009ca0 tx=0x7f7b3c0095c0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 shutdown_connections 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562a8167d900 0x562a8167c610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a81611d10 0x562a81612190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562a815fc510 0x562a81617540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 --2- 172.21.15.38:0/1644085396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a815f1c50 0x562a81617000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 >> 172.21.15.38:0/1644085396 conn(0x562a815ed8c0 msgr2=0x562a815ec200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b2b400640 0 client.25199 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 shutdown_connections 2024-09-12T12:25:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 1 -- 172.21.15.38:0/1644085396 wait complete. 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.572+0000 7f7b4ed22740 20 client.25199 trim_cache size 0 max 16384 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 1, 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24529, 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:38.577 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 114.441477388, 2024-09-12T12:25:38.578 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:38.578 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:38.578 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:38.578 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 185.53503225899999 2024-09-12T12:25:38.578 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7b2c0a2c00 msgr2=0x7f7b2c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7b2c0a2c00 0x7f7b2c0a50c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c006010 tx=0x7f7b3c005d80 comp rx=0 tx=0).stop 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074620 msgr2=0x7f7b4419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074620 0x7f7b4419a630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e9f0 tx=0x7f7b3800edf0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 shutdown_connections 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7b2c0a2c00 0x7f7b2c0a50c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4410e3c0 0x7f7b4419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b44074f40 0x7f7b4419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 --2- 172.21.15.38:0/1467911291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b44074620 0x7f7b4419a630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 >> 172.21.15.38:0/1467911291 conn(0x7f7b440fd8c0 msgr2=0x7f7b440fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 shutdown_connections 2024-09-12T12:25:38.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:38.573+0000 7f7b4c600640 1 -- 172.21.15.38:0/1467911291 wait complete. 2024-09-12T12:25:39.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:39 smithi038 ceph-mon[30810]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T12:25:39.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T12:25:39.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:39 smithi071 ceph-mon[34859]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T12:25:39.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:39 smithi154 ceph-mon[35578]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T12:25:39.892 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 -- 172.21.15.38:0/247705597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 msgr2=0x7f320c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 --2- 172.21.15.38:0/247705597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c1043d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3200009900 tx=0x7f320002a410 comp rx=0 tx=0).stop 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 -- 172.21.15.38:0/247705597 shutdown_connections 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 --2- 172.21.15.38:0/247705597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f320c109120 0x7f320c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 --2- 172.21.15.38:0/247705597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c1049a0 0x7f320c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 --2- 172.21.15.38:0/247705597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c1043d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 -- 172.21.15.38:0/247705597 >> 172.21.15.38:0/247705597 conn(0x7f320c0ffa90 msgr2=0x7f320c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 -- 172.21.15.38:0/247705597 shutdown_connections 2024-09-12T12:25:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.524+0000 7f3214600640 1 -- 172.21.15.38:0/247705597 wait complete. 2024-09-12T12:25:40.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.525+0000 7f3214600640 1 Processor -- start 2024-09-12T12:25:40.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.525+0000 7f3214600640 1 -- start start 2024-09-12T12:25:40.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3214600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3214600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c1049a0 0x7f320c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3214600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f320c109120 0x7f320c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3214600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f320c114170 con 0x7f320c103ff0 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3214600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f320c113ff0 con 0x7f320c1049a0 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3214600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f320c1142f0 con 0x7f320c109120 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3211c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3211c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36384/0 (socket says 172.21.15.38:36384) 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3211c00640 1 -- 172.21.15.38:0/4073918483 learned_addr learned my addr 172.21.15.38:0/4073918483 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3212600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f320c109120 0x7f320c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.526+0000 7f3211200640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c1049a0 0x7f320c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3211c00640 1 -- 172.21.15.38:0/4073918483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f320c109120 msgr2=0x7f320c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3211c00640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f320c109120 0x7f320c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3211c00640 1 -- 172.21.15.38:0/4073918483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c1049a0 msgr2=0x7f320c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3211c00640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c1049a0 0x7f320c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3211c00640 1 -- 172.21.15.38:0/4073918483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c19f5b0 con 0x7f320c103ff0 2024-09-12T12:25:40.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3211c00640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c19a600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3200004770 tx=0x7f3200003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f320a000640 1 -- 172.21.15.38:0/4073918483 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320003f070 con 0x7f320c103ff0 2024-09-12T12:25:40.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f320a000640 1 -- 172.21.15.38:0/4073918483 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3200031ca0 con 0x7f320c103ff0 2024-09-12T12:25:40.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c19f840 con 0x7f320c103ff0 2024-09-12T12:25:40.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f320a000640 1 -- 172.21.15.38:0/4073918483 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200035030 con 0x7f320c103ff0 2024-09-12T12:25:40.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.527+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c1a7180 con 0x7f320c103ff0 2024-09-12T12:25:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.531+0000 7f3216fe2740 1 Processor -- start 2024-09-12T12:25:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3216fe2740 1 -- start start 2024-09-12T12:25:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f320a000640 1 -- 172.21.15.38:0/4073918483 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3200042070 con 0x7f320c103ff0 2024-09-12T12:25:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dac1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3216fe2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f87da1d0b0 con 0x55f87dac2510 2024-09-12T12:25:40.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3216fe2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f87d9c4ab0 con 0x55f87dab7330 2024-09-12T12:25:40.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3216fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f87da19070 con 0x55f87dab7c50 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.532+0000 7f3211200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36400/0 (socket says 172.21.15.38:36400) 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 -- 172.21.15.38:0/1738129755 learned_addr learned my addr 172.21.15.38:0/1738129755 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211c00640 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dac1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3212600640 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 -- 172.21.15.38:0/1738129755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 msgr2=0x55f87dac1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dac1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 -- 172.21.15.38:0/1738129755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 msgr2=0x55f87dab7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 -- 172.21.15.38:0/1738129755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87d9d14a0 con 0x55f87dac2510 2024-09-12T12:25:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.533+0000 7f3211200640 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac4900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009c90 tx=0x7f31f8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa7acbf73de4ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.534+0000 7f31fea00640 1 -- 172.21.15.38:0/1738129755 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f801e070 con 0x55f87dac2510 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.534+0000 7f31fea00640 1 -- 172.21.15.38:0/1738129755 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31f8019b10 con 0x55f87dac2510 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.534+0000 7f31fea00640 1 -- 172.21.15.38:0/1738129755 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f800ea00 con 0x55f87dac2510 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.534+0000 7f320a000640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31f40a2b80 0x7f31f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.534+0000 7f320a000640 1 -- 172.21.15.38:0/4073918483 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f32000ef9b0 con 0x7f320c103ff0 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.534+0000 7f3212600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31f40a2b80 0x7f31f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 -- 172.21.15.38:0/1738129755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 msgr2=0x55f87dac4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac4900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009c90 tx=0x7f31f8011810 comp rx=0 tx=0).stop 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 -- 172.21.15.38:0/1738129755 shutdown_connections 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac4900 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dac1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1738129755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 -- 172.21.15.38:0/1738129755 >> 172.21.15.38:0/1738129755 conn(0x55f87dab38c0 msgr2=0x55f87dab3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3212600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31f40a2b80 0x7f31f40a5040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3204005fd0 tx=0x7f3204009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 -- 172.21.15.38:0/1738129755 shutdown_connections 2024-09-12T12:25:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.535+0000 7f3216fe2740 1 -- 172.21.15.38:0/1738129755 wait complete. 2024-09-12T12:25:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 -- start start 2024-09-12T12:25:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 Processor -- start 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dabf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dabfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f87dac5060 con 0x55f87dac2510 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f87d9a5920 con 0x55f87dab7330 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f87dac51e0 con 0x55f87dab7c50 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.536+0000 7f3216fe2740 10 client.0 _ll_register_callbacks cb 0x55f87d9c98a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dabf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3212600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dabf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:46060/0 (socket says 172.21.15.38:46060) 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 -- 172.21.15.38:0/2645464976 learned_addr learned my addr 172.21.15.38:0/2645464976 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211200640 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dabfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 -- 172.21.15.38:0/2645464976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 msgr2=0x55f87dabfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dabfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 -- 172.21.15.38:0/2645464976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 msgr2=0x55f87dac0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 -- 172.21.15.38:0/2645464976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f87d78e2b0 con 0x55f87dab7330 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f3211c00640 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dabf5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3200031550 tx=0x7f32000b8330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d87052bf0ad316b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f31f3400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.537+0000 7f31f3400640 1 -- 172.21.15.38:0/2645464976 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32000efe60 con 0x55f87dab7330 2024-09-12T12:25:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f31f3400640 1 -- 172.21.15.38:0/2645464976 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f32000ba2d0 con 0x55f87dab7330 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31f8019b10 con 0x55f87dab7330 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f31f3400640 1 -- 172.21.15.38:0/2645464976 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3200049070 con 0x55f87dab7330 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 10 client.25211 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f87dad0e60 con 0x55f87dab7330 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f31f3400640 1 -- 172.21.15.38:0/2645464976 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31f8019b10 con 0x55f87dab7330 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f31f3400640 1 -- 172.21.15.38:0/2645464976 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f32000b8640 con 0x55f87dab7330 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 10 client.25211 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 10 client.25211 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 20 client.25211 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87dad34d0 0x55f87dad4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.538+0000 7f3216fe2740 4 client.25211 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.539+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f87da2a620 con 0x55f87dad34d0 2024-09-12T12:25:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.539+0000 7f3211200640 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87dad34d0 0x55f87dad4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.539+0000 7f3211200640 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87dad34d0 0x55f87dad4940 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb8683b4aa71069 server_cookie=87f31a2c32ac6bb6 in_seq=0 out_seq=0 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.539+0000 7f31f3400640 10 client.25211 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.540+0000 7f31f3400640 1 -- 172.21.15.38:0/2645464976 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f87da2a620 con 0x55f87dad34d0 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.540+0000 7f31f3400640 10 client.25211 handle_command_reply: tid=0 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.540+0000 7f3216fe2740 1 client.25211 shutdown 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 msgr2=0x55f87dabf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dabf5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3200031550 tx=0x7f32000b8330 comp rx=0 tx=0).stop 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 shutdown_connections 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87dad34d0 0x55f87dad4940 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dac2510 0x55f87dac0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dabfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 --2- 172.21.15.38:0/2645464976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dabf5c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f31f3400640 0 client.25211 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 >> 172.21.15.38:0/2645464976 conn(0x55f87dab38c0 msgr2=0x55f87dab95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 shutdown_connections 2024-09-12T12:25:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 1 -- 172.21.15.38:0/2645464976 wait complete. 2024-09-12T12:25:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.541+0000 7f3216fe2740 20 client.25211 trim_cache size 0 max 16384 2024-09-12T12:25:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.560+0000 7f3216fe2740 1 Processor -- start 2024-09-12T12:25:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3216fe2740 1 -- start start 2024-09-12T12:25:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7c50 0x55f87dabfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dac2510 0x55f87dadcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3216fe2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f87dad2c80 con 0x55f87dab7c50 2024-09-12T12:25:40.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3216fe2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f87dad3350 con 0x55f87dab7330 2024-09-12T12:25:40.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3216fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f87dad3a20 con 0x55f87dac2510 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3211200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7c50 0x55f87dabfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3211200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7c50 0x55f87dabfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36420/0 (socket says 172.21.15.38:36420) 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3211200640 1 -- 172.21.15.38:0/1028412699 learned_addr learned my addr 172.21.15.38:0/1028412699 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3212600640 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dac2510 0x55f87dadcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.561+0000 7f3211c00640 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f3211200640 1 -- 172.21.15.38:0/1028412699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dac2510 msgr2=0x55f87dadcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f3211200640 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dac2510 0x55f87dadcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f3211200640 1 -- 172.21.15.38:0/1028412699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 msgr2=0x55f87dab3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f3211200640 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f3211200640 1 -- 172.21.15.38:0/1028412699 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87dac4c70 con 0x55f87dab7c50 2024-09-12T12:25:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f3211200640 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7c50 0x55f87dabfb30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009230 tx=0x7f31f80051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7422addf5101607a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f31fe000640 1 -- 172.21.15.38:0/1028412699 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f801e040 con 0x55f87dab7c50 2024-09-12T12:25:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f31fe000640 1 -- 172.21.15.38:0/1028412699 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31f801f040 con 0x55f87dab7c50 2024-09-12T12:25:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.562+0000 7f31fe000640 1 -- 172.21.15.38:0/1028412699 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f800e610 con 0x55f87dab7c50 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 -- 172.21.15.38:0/1028412699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7c50 msgr2=0x55f87dabfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7c50 0x55f87dabfb30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009230 tx=0x7f31f80051d0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 -- 172.21.15.38:0/1028412699 shutdown_connections 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dac2510 0x55f87dadcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7c50 0x55f87dabfb30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 --2- 172.21.15.38:0/1028412699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dab7330 0x55f87dab3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 -- 172.21.15.38:0/1028412699 >> 172.21.15.38:0/1028412699 conn(0x55f87dab38c0 msgr2=0x55f87dac1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 -- 172.21.15.38:0/1028412699 shutdown_connections 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.563+0000 7f3216fe2740 1 -- 172.21.15.38:0/1028412699 wait complete. 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 -- start start 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 Processor -- start 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7330 0x55f87dadcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dadd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dac2510 0x55f87dad7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f87dad47c0 con 0x55f87dab7330 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f87dad40f0 con 0x55f87dac2510 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f87dad4e90 con 0x55f87dab7c50 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.564+0000 7f3216fe2740 10 client.0 _ll_register_callbacks cb 0x7f3200009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dadd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7330 0x55f87dadcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dadd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:45186/0 (socket says 172.21.15.38:45186) 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 -- 172.21.15.38:0/4245383684 learned_addr learned my addr 172.21.15.38:0/4245383684 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3212600640 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dac2510 0x55f87dad7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 -- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dac2510 msgr2=0x55f87dad7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dac2510 0x55f87dad7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 -- 172.21.15.38:0/4245383684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7330 msgr2=0x55f87dadcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7330 0x55f87dadcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 -- 172.21.15.38:0/4245383684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f87dad8230 con 0x55f87dab7c50 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f3211200640 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dadd330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31f8011d10 tx=0x7f31f8011dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8869424b4b992c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.565+0000 7f31f3400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.566+0000 7f31f3400640 1 -- 172.21.15.38:0/4245383684 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f803e020 con 0x55f87dab7c50 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.566+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31f801f040 con 0x55f87dab7c50 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.566+0000 7f31f3400640 1 -- 172.21.15.38:0/4245383684 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f31f8019430 con 0x55f87dab7c50 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.566+0000 7f31f3400640 1 -- 172.21.15.38:0/4245383684 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f31f8019650 con 0x55f87dab7c50 2024-09-12T12:25:40.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.566+0000 7f3216fe2740 10 client.25204 fetch_fsmap learned FSMap version 29 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.566+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f87db3e540 con 0x55f87dab7c50 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.566+0000 7f31f3400640 1 -- 172.21.15.38:0/4245383684 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31f801f040 con 0x55f87dab7c50 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f31f3400640 1 -- 172.21.15.38:0/4245383684 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f31f800eb80 con 0x55f87dab7c50 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f3216fe2740 10 client.25204 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f3216fe2740 10 client.25204 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f3216fe2740 20 client.25204 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f3216fe2740 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87db42ca0 0x55f87db419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f3216fe2740 4 client.25204 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:40.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "status"}) -- 0x55f87da24b30 con 0x55f87db42ca0 2024-09-12T12:25:40.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.567+0000 7f3211c00640 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87db42ca0 0x55f87db419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3211c00640 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87db42ca0 0x55f87db419b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e37ba6e208384a0 server_cookie=f3f73d7d09f28984 in_seq=0 out_seq=0 2024-09-12T12:25:40.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f31f3400640 10 client.25204 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:40.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f31f3400640 1 -- 172.21.15.38:0/4245383684 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f87da24b30 con 0x55f87db42ca0 2024-09-12T12:25:40.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f31f3400640 10 client.25204 handle_command_reply: tid=0 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 client.25204 shutdown 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 msgr2=0x55f87dadd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dadd330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31f8011d10 tx=0x7f31f8011dc0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 shutdown_connections 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55f87db42ca0 0x55f87db419b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f87dac2510 0x55f87dad7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f87dab7c50 0x55f87dadd330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 --2- 172.21.15.38:0/4245383684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f87dab7330 0x55f87dadcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f31f3400640 0 client.25204 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 >> 172.21.15.38:0/4245383684 conn(0x55f87dab38c0 msgr2=0x55f87dacd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 shutdown_connections 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 1 -- 172.21.15.38:0/4245383684 wait complete. 2024-09-12T12:25:40.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.568+0000 7f3216fe2740 20 client.25204 trim_cache size 0 max 16384 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "726420ce-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24557, 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 164.265085086, 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 29, 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 93, 2024-09-12T12:25:40.573 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 177.518944731 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31f40a2b80 msgr2=0x7f31f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31f40a2b80 0x7f31f40a5040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3204005fd0 tx=0x7f3204009500 comp rx=0 tx=0).stop 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 msgr2=0x7f320c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c19a600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3200004770 tx=0x7f3200003c10 comp rx=0 tx=0).stop 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 shutdown_connections 2024-09-12T12:25:40.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f31f40a2b80 0x7f31f40a5040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f320c109120 0x7f320c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f320c1049a0 0x7f320c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 --2- 172.21.15.38:0/4073918483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f320c103ff0 0x7f320c19a600 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 >> 172.21.15.38:0/4073918483 conn(0x7f320c0ffa90 msgr2=0x7f320c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 shutdown_connections 2024-09-12T12:25:40.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:40.569+0000 7f3214600640 1 -- 172.21.15.38:0/4073918483 wait complete. 2024-09-12T12:25:41.371 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T12:25:41.380 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T12:25:41.380 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T12:25:41.381 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T12:25:41.381 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T12:25:41.449 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T12:25:41.449 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T12:25:41.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:41.449 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-12T12:25:41.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:41 smithi038 ceph-mon[30810]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:41.486 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T12:25:41.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:41.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:25:41.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:41 smithi071 ceph-mon[34859]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:41.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:41.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-09-12T12:25:41.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:41 smithi154 ceph-mon[35578]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:41.909 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T12:25:41.910 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:25:41.910 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:41.910 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T12:25:42.292 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 -- 172.21.15.38:0/2289481201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c103ff0 msgr2=0x7f0a5c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 --2- 172.21.15.38:0/2289481201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c103ff0 0x7f0a5c1043d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009900 tx=0x7f0a4c02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 -- 172.21.15.38:0/2289481201 shutdown_connections 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 --2- 172.21.15.38:0/2289481201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a5c109120 0x7f0a5c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 --2- 172.21.15.38:0/2289481201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5c1049a0 0x7f0a5c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 --2- 172.21.15.38:0/2289481201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c103ff0 0x7f0a5c1043d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 -- 172.21.15.38:0/2289481201 >> 172.21.15.38:0/2289481201 conn(0x7f0a5c0ffa90 msgr2=0x7f0a5c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 -- 172.21.15.38:0/2289481201 shutdown_connections 2024-09-12T12:25:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.834+0000 7f0a62400640 1 -- 172.21.15.38:0/2289481201 wait complete. 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 Processor -- start 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 -- start start 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a5c103ff0 0x7f0a5c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5c1049a0 0x7f0a5c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c109120 0x7f0a5c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c114170 con 0x7f0a5c109120 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c113ff0 con 0x7f0a5c103ff0 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.835+0000 7f0a62400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1142f0 con 0x7f0a5c1049a0 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c109120 0x7f0a5c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a5c103ff0 0x7f0a5c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c109120 0x7f0a5c19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36452/0 (socket says 172.21.15.38:36452) 2024-09-12T12:25:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 -- 172.21.15.38:0/788688915 learned_addr learned my addr 172.21.15.38:0/788688915 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a53e00640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5c1049a0 0x7f0a5c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 -- 172.21.15.38:0/788688915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5c1049a0 msgr2=0x7f0a5c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5c1049a0 0x7f0a5c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 -- 172.21.15.38:0/788688915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a5c103ff0 msgr2=0x7f0a5c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a5c103ff0 0x7f0a5c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 -- 172.21.15.38:0/788688915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c19f640 con 0x7f0a5c109120 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a53e00640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5c1049a0 0x7f0a5c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.836+0000 7f0a5be00640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c109120 0x7f0a5c19ef60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009fd0 tx=0x7f0a5400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.837+0000 7f0a58c00640 1 -- 172.21.15.38:0/788688915 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54017070 con 0x7f0a5c109120 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.837+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5c19f930 con 0x7f0a5c109120 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.837+0000 7f0a58c00640 1 -- 172.21.15.38:0/788688915 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a54003e50 con 0x7f0a5c109120 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.837+0000 7f0a58c00640 1 -- 172.21.15.38:0/788688915 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a540106c0 con 0x7f0a5c109120 2024-09-12T12:25:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.837+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5c1a7210 con 0x7f0a5c109120 2024-09-12T12:25:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.838+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a5c1043d0 con 0x7f0a5c109120 2024-09-12T12:25:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.840+0000 7f0a58c00640 1 -- 172.21.15.38:0/788688915 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0a54003970 con 0x7f0a5c109120 2024-09-12T12:25:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.841+0000 7f0a58c00640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0a400a2b80 0x7f0a400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.841+0000 7f0a58c00640 1 -- 172.21.15.38:0/788688915 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f0a540cf1c0 con 0x7f0a5c109120 2024-09-12T12:25:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.841+0000 7f0a5b400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0a400a2b80 0x7f0a400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.842+0000 7f0a5b400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0a400a2b80 0x7f0a400a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c000c00 tx=0x7f0a4c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:42.846+0000 7f0a58c00640 1 -- 172.21.15.38:0/788688915 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a5409bd10 con 0x7f0a5c109120 2024-09-12T12:25:43.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.068+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a5c10bd70 con 0x7f0a5c109120 2024-09-12T12:25:43.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.068+0000 7f0a58c00640 1 -- 172.21.15.38:0/788688915 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f0a5409b610 con 0x7f0a5c109120 2024-09-12T12:25:43.069 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:25:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0a400a2b80 msgr2=0x7f0a400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0a400a2b80 0x7f0a400a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c000c00 tx=0x7f0a4c005b50 comp rx=0 tx=0).stop 2024-09-12T12:25:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c109120 msgr2=0x7f0a5c19ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c109120 0x7f0a5c19ef60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009fd0 tx=0x7f0a5400b260 comp rx=0 tx=0).stop 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 shutdown_connections 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0a400a2b80 0x7f0a400a5040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a5c109120 0x7f0a5c19ef60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5c1049a0 0x7f0a5c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 --2- 172.21.15.38:0/788688915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a5c103ff0 0x7f0a5c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 >> 172.21.15.38:0/788688915 conn(0x7f0a5c0ffa90 msgr2=0x7f0a5c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 shutdown_connections 2024-09-12T12:25:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43.072+0000 7f0a62400640 1 -- 172.21.15.38:0/788688915 wait complete. 2024-09-12T12:25:43.465 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:43 smithi038 ceph-mon[30810]: pgmap v387: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:43.466 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:43 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/788688915' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:25:43.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:43 smithi071 ceph-mon[34859]: pgmap v387: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:43.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:43 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/788688915' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:25:43.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:43 smithi154 ceph-mon[35578]: pgmap v387: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:25:43.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:43 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/788688915' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:25:43.822 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:25:43.823 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:25:43.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:43.823 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2024-09-12T12:25:43.858 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:25:43.858 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:25:43.858 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2024-09-12T12:25:43.859 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T12:25:43.860 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42049sec preferred_lft 42049sec 2024-09-12T12:25:43.860 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-09-12T12:25:43.860 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:43.860 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:25:43.860 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:43.860 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2024-09-12T12:25:43.861 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:25:43.861 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:25:43.861 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:25:43.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:25:43.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2024-09-12T12:25:43.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2024-09-12T12:25:43.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:25:43.861 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:25:43.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:25:44.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:44.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:44.089 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:25:44.144 INFO:teuthology.orchestra.run.smithi038.stdout:1 2024-09-12T12:25:44.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:44.148 DEBUG:teuthology.orchestra.run.smithi038:> route 2024-09-12T12:25:44.184 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2024-09-12T12:25:44.185 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:25:44.185 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T12:25:44.185 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T12:25:44.185 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:25:44.185 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:25:44.185 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:25:44.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T12:25:44.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T12:25:44.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T12:25:44.185 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:25:44.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:25:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:44.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:44.387 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-12T12:25:44.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:44.423 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2024-09-12T12:25:44.501 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:25:44.501 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:25:44.501 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:25:44.501 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T12:25:44.501 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:25:44.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:25:44.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:44.680 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T12:25:44.681 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:25:44.681 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:25:44.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T12:25:44.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:25:44.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T12:25:44.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T12:25:44.682 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T12:25:44.682 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:25:44.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:25:44.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:44.901 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:25:44.901 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-12T12:25:44.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2024-09-12T12:25:44.902 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:25:44.902 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-12T12:25:44.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:25:45.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:45.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:25:45.070 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:45.105 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:25:45.106 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:25:45.106 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:45.182 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T12:25:45.182 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T12:25:45.182 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/fe7beb60-a0f0-4540-a5e6-b697364df4c7 2024-09-12T12:25:45.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:45.182 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/fe7beb60-a0f0-4540-a5e6-b697364df4c7 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-12T12:25:45.312 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-12T12:25:45.312 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-12T12:25:45.312 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2024-09-12T12:25:45.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:45 smithi038 ceph-mon[30810]: pgmap v388: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:45 smithi071 ceph-mon[34859]: pgmap v388: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:45.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:45 smithi154 ceph-mon[35578]: pgmap v388: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:25:45.908 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-12T12:25:45.908 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-12T12:25:45.908 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2024-09-12T12:25:45.908 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:6789,172.21.15.71:6789,172.21.15.154:6789" 2024-09-12T12:25:45.908 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.38:6789,172.21.15.71:6789,172.21.15.154:6789:/volumes/qa/sv_1/fe7beb60-a0f0-4540-a5e6-b697364df4c7 2024-09-12T12:25:45.908 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=726420ce-7100-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T12:25:45.911 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T12:25:45.911 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2024-09-12T12:25:45.911 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T12:25:45.911 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T12:25:45.911 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T12:25:45.914 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:25:45.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:45.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:45.976 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:25:46.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:25:46.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:46.069 INFO:teuthology.orchestra.run.smithi038.stdout:client15216 2024-09-12T12:25:46.070 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:25:46.070 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:46.106 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:25:46.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:25:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:46.237 INFO:teuthology.orchestra.run.smithi038.stdout:client15216 2024-09-12T12:25:46.237 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:25:46.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:25:46.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:46.328 INFO:teuthology.orchestra.run.smithi038.stdout:client15216 2024-09-12T12:25:46.329 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/726420ce-7100-11ef-bcea-c7b262605968.client15216/status') 2024-09-12T12:25:46.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:25:46.432 INFO:teuthology.orchestra.run.smithi038.stdout:instance: client.15216 (3)192.168.0.1:0/2028675602 2024-09-12T12:25:46.432 INFO:teuthology.orchestra.run.smithi038.stdout:blocklisted: false 2024-09-12T12:25:46.432 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records in 2024-09-12T12:25:46.432 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records out 2024-09-12T12:25:46.433 INFO:teuthology.orchestra.run.smithi038.stderr:70 bytes copied, 6.9726e-05 s, 1.0 MB/s 2024-09-12T12:25:46.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:46.441 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T12:25:46.451 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T12:25:46.451 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-12T12:25:46.451 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T12:25:46.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 -- 172.21.15.38:0/2667867408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c105910 msgr2=0x7fcd4c10c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 --2- 172.21.15.38:0/2667867408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c105910 0x7fcd4c10c1a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009ca0 tx=0x7fcd4402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 -- 172.21.15.38:0/2667867408 shutdown_connections 2024-09-12T12:25:46.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 --2- 172.21.15.38:0/2667867408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c105910 0x7fcd4c10c1a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 --2- 172.21.15.38:0/2667867408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd4c104f50 0x7fcd4c1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 --2- 172.21.15.38:0/2667867408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd4c103d60 0x7fcd4c104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 -- 172.21.15.38:0/2667867408 >> 172.21.15.38:0/2667867408 conn(0x7fcd4c0ff4e0 msgr2=0x7fcd4c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 -- 172.21.15.38:0/2667867408 shutdown_connections 2024-09-12T12:25:46.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.607+0000 7fcd53400640 1 -- 172.21.15.38:0/2667867408 wait complete. 2024-09-12T12:25:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.608+0000 7fcd53400640 1 Processor -- start 2024-09-12T12:25:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.608+0000 7fcd53400640 1 -- start start 2024-09-12T12:25:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd53400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c103d60 0x7fcd4c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd53400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd4c104f50 0x7fcd4c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd53400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd4c105910 0x7fcd4c1a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd53400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c10f9e0 con 0x7fcd4c103d60 2024-09-12T12:25:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd53400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c10f860 con 0x7fcd4c105910 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd53400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c10fb60 con 0x7fcd4c104f50 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c103d60 0x7fcd4c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c103d60 0x7fcd4c199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40998/0 (socket says 172.21.15.38:40998) 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 -- 172.21.15.38:0/1850779231 learned_addr learned my addr 172.21.15.38:0/1850779231 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd51400640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd4c105910 0x7fcd4c1a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd4be00640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd4c104f50 0x7fcd4c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 -- 172.21.15.38:0/1850779231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd4c104f50 msgr2=0x7fcd4c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd4c104f50 0x7fcd4c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 -- 172.21.15.38:0/1850779231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd4c105910 msgr2=0x7fcd4c1a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd4c105910 0x7fcd4c1a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd50a00640 1 -- 172.21.15.38:0/1850779231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c1a1b70 con 0x7fcd4c103d60 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.609+0000 7fcd4be00640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd4c104f50 0x7fcd4c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.610+0000 7fcd50a00640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c103d60 0x7fcd4c199f50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e9c0 tx=0x7fcd4000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.610+0000 7fcd49600640 1 -- 172.21.15.38:0/1850779231 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000cd80 con 0x7fcd4c103d60 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.610+0000 7fcd49600640 1 -- 172.21.15.38:0/1850779231 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd400035f0 con 0x7fcd4c103d60 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.610+0000 7fcd49600640 1 -- 172.21.15.38:0/1850779231 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40010690 con 0x7fcd4c103d60 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.610+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c1a1e60 con 0x7fcd4c103d60 2024-09-12T12:25:46.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.610+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1a22c0 con 0x7fcd4c103d60 2024-09-12T12:25:46.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.611+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c10b080 con 0x7fcd4c103d60 2024-09-12T12:25:46.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.613+0000 7fcd49600640 1 -- 172.21.15.38:0/1850779231 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd400037a0 con 0x7fcd4c103d60 2024-09-12T12:25:46.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.614+0000 7fcd49600640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcd340a2cb0 0x7fcd340a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.615+0000 7fcd49600640 1 -- 172.21.15.38:0/1850779231 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fcd400cf800 con 0x7fcd4c103d60 2024-09-12T12:25:46.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.615+0000 7fcd4be00640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcd340a2cb0 0x7fcd340a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.615+0000 7fcd4be00640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcd340a2cb0 0x7fcd340a5170 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c19b460 tx=0x7fcd38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.619+0000 7fcd49600640 1 -- 172.21.15.38:0/1850779231 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd4009c350 con 0x7fcd4c103d60 2024-09-12T12:25:46.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:46.843+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fcd4c02d7c0 con 0x7fcd4c103d60 2024-09-12T12:25:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.219+0000 7fcd49600640 1 -- 172.21.15.38:0/1850779231 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v30) ==== 117+0+0 (secure 0 0 0) 0x7fcd4009bc50 con 0x7fcd4c103d60 2024-09-12T12:25:47.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.221+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcd340a2cb0 msgr2=0x7fcd340a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.221+0000 7fcd53400640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcd340a2cb0 0x7fcd340a5170 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c19b460 tx=0x7fcd38005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.221+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c103d60 msgr2=0x7fcd4c199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.221+0000 7fcd53400640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c103d60 0x7fcd4c199f50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e9c0 tx=0x7fcd4000ee80 comp rx=0 tx=0).stop 2024-09-12T12:25:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 shutdown_connections 2024-09-12T12:25:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcd340a2cb0 0x7fcd340a5170 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd4c105910 0x7fcd4c1a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd4c104f50 0x7fcd4c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 --2- 172.21.15.38:0/1850779231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd4c103d60 0x7fcd4c199f50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 >> 172.21.15.38:0/1850779231 conn(0x7fcd4c0ff4e0 msgr2=0x7fcd4c108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 shutdown_connections 2024-09-12T12:25:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.222+0000 7fcd53400640 1 -- 172.21.15.38:0/1850779231 wait complete. 2024-09-12T12:25:47.240 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T12:25:47.251 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T12:25:47.287 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 -- 172.21.15.38:0/2031898636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4105720 msgr2=0x7facd410bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 --2- 172.21.15.38:0/2031898636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4105720 0x7facd410bfb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faccc009ca0 tx=0x7faccc02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 -- 172.21.15.38:0/2031898636 shutdown_connections 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 --2- 172.21.15.38:0/2031898636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4105720 0x7facd410bfb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 --2- 172.21.15.38:0/2031898636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd4104d60 0x7facd41051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 --2- 172.21.15.38:0/2031898636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd4103b70 0x7facd4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 -- 172.21.15.38:0/2031898636 >> 172.21.15.38:0/2031898636 conn(0x7facd40ff2f0 msgr2=0x7facd4101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 -- 172.21.15.38:0/2031898636 shutdown_connections 2024-09-12T12:25:47.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.448+0000 7facda000640 1 -- 172.21.15.38:0/2031898636 wait complete. 2024-09-12T12:25:47.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.449+0000 7facda000640 1 Processor -- start 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.449+0000 7facda000640 1 -- start start 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.449+0000 7facda000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4103b70 0x7facd4199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facda000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd4104d60 0x7facd419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facda000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd4105720 0x7facd41a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facda000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7facd410f7d0 con 0x7facd4103b70 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facda000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facd410f650 con 0x7facd4105720 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facda000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7facd410f950 con 0x7facd4104d60 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4103b70 0x7facd4199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4103b70 0x7facd4199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41010/0 (socket says 172.21.15.38:41010) 2024-09-12T12:25:47.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 -- 172.21.15.38:0/404475783 learned_addr learned my addr 172.21.15.38:0/404475783 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd9600640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd4105720 0x7facd41a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd3e00640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd4104d60 0x7facd419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 -- 172.21.15.38:0/404475783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd4104d60 msgr2=0x7facd419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd4104d60 0x7facd419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 -- 172.21.15.38:0/404475783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd4105720 msgr2=0x7facd41a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd4105720 0x7facd41a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd8c00640 1 -- 172.21.15.38:0/404475783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd41a1a20 con 0x7facd4103b70 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.450+0000 7facd9600640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd4105720 0x7facd41a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.451+0000 7facd8c00640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4103b70 0x7facd4199e00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7facc800e9c0 tx=0x7facc800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.451+0000 7facd1600640 1 -- 172.21.15.38:0/404475783 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc800cd80 con 0x7facd4103b70 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.451+0000 7facd1600640 1 -- 172.21.15.38:0/404475783 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facc80035f0 con 0x7facd4103b70 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.451+0000 7facda000640 1 -- 172.21.15.38:0/404475783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd41a1d10 con 0x7facd4103b70 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.451+0000 7facd1600640 1 -- 172.21.15.38:0/404475783 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8010690 con 0x7facd4103b70 2024-09-12T12:25:47.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.451+0000 7facda000640 1 -- 172.21.15.38:0/404475783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd41a21b0 con 0x7facd4103b70 2024-09-12T12:25:47.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.452+0000 7facda000640 1 -- 172.21.15.38:0/404475783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd410af10 con 0x7facd4103b70 2024-09-12T12:25:47.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.454+0000 7facd1600640 1 -- 172.21.15.38:0/404475783 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7facc80037a0 con 0x7facd4103b70 2024-09-12T12:25:47.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.455+0000 7facd1600640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7facbc0a2b90 0x7facbc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.455+0000 7facd1600640 1 -- 172.21.15.38:0/404475783 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7facc80cf830 con 0x7facd4103b70 2024-09-12T12:25:47.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.456+0000 7facd3e00640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7facbc0a2b90 0x7facbc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.456+0000 7facd3e00640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7facbc0a2b90 0x7facbc0a5050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7facd419b310 tx=0x7facc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.459+0000 7facd1600640 1 -- 172.21.15.38:0/404475783 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facc809c380 con 0x7facd4103b70 2024-09-12T12:25:47.469 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:47 smithi154 ceph-mon[35578]: pgmap v389: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:47.469 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:47 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1850779231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:25:47.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:47 smithi038 ceph-mon[30810]: pgmap v389: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:47.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:47 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1850779231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:25:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:47 smithi071 ceph-mon[34859]: pgmap v389: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:47 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1850779231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:25:47.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.648+0000 7facda000640 1 -- 172.21.15.38:0/404475783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facd4062ec0 con 0x7facd4103b70 2024-09-12T12:25:47.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.650+0000 7facd1600640 1 -- 172.21.15.38:0/404475783 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24865 (secure 0 0 0) 0x7facc809bc80 con 0x7facd4103b70 2024-09-12T12:25:47.651 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:47.651 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:24:35.829591+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:47.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.652+0000 7facda000640 1 -- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7facbc0a2b90 msgr2=0x7facbc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.652+0000 7facda000640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7facbc0a2b90 0x7facbc0a5050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7facd419b310 tx=0x7facc0005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:47.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.652+0000 7facda000640 1 -- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4103b70 msgr2=0x7facd4199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.652+0000 7facda000640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4103b70 0x7facd4199e00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7facc800e9c0 tx=0x7facc800ee80 comp rx=0 tx=0).stop 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 -- 172.21.15.38:0/404475783 shutdown_connections 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7facbc0a2b90 0x7facbc0a5050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd4105720 0x7facd41a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd4104d60 0x7facd419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 --2- 172.21.15.38:0/404475783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facd4103b70 0x7facd4199e00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 -- 172.21.15.38:0/404475783 >> 172.21.15.38:0/404475783 conn(0x7facd40ff2f0 msgr2=0x7facd41080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 -- 172.21.15.38:0/404475783 shutdown_connections 2024-09-12T12:25:47.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.653+0000 7facda000640 1 -- 172.21.15.38:0/404475783 wait complete. 2024-09-12T12:25:47.669 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:17:58.604590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T12:22:50.782584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T12:22:53.282254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T12:23:01.880311+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T12:25:47.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:25:47.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 -- 172.21.15.38:0/1384801819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 msgr2=0x7f74481071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 --2- 172.21.15.38:0/1384801819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 0x7f74481071a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7434009900 tx=0x7f743402a410 comp rx=0 tx=0).stop 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 -- 172.21.15.38:0/1384801819 shutdown_connections 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 --2- 172.21.15.38:0/1384801819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74481076e0 0x7f7448109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 --2- 172.21.15.38:0/1384801819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 0x7f74481071a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 --2- 172.21.15.38:0/1384801819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448102480 0x7f7448104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 -- 172.21.15.38:0/1384801819 >> 172.21.15.38:0/1384801819 conn(0x7f74480fc0a0 msgr2=0x7f74480fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 -- 172.21.15.38:0/1384801819 shutdown_connections 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.831+0000 7f744de00640 1 -- 172.21.15.38:0/1384801819 wait complete. 2024-09-12T12:25:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 Processor -- start 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 -- start start 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448102480 0x7f7448101df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 0x7f7448100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74481076e0 0x7f7448100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f744810d700 con 0x7f7448104db0 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f744810d580 con 0x7f74481076e0 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f744de00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f744810d880 con 0x7f7448102480 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f7447e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 0x7f7448100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.832+0000 7f7447e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 0x7f7448100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41022/0 (socket says 172.21.15.38:41022) 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f7447e00640 1 -- 172.21.15.38:0/2813428086 learned_addr learned my addr 172.21.15.38:0/2813428086 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744d400640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74481076e0 0x7f7448100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744ca00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448102480 0x7f7448101df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744d400640 1 -- 172.21.15.38:0/2813428086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448102480 msgr2=0x7f7448101df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744d400640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448102480 0x7f7448101df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744d400640 1 -- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 msgr2=0x7f7448100430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744d400640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 0x7f7448100430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744d400640 1 -- 172.21.15.38:0/2813428086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7448101200 con 0x7f74481076e0 2024-09-12T12:25:47.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.833+0000 7f744d400640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74481076e0 0x7f7448100970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7440005fd0 tx=0x7f744000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.834+0000 7f7445600640 1 -- 172.21.15.38:0/2813428086 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744000cdf0 con 0x7f74481076e0 2024-09-12T12:25:47.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.834+0000 7f7445600640 1 -- 172.21.15.38:0/2813428086 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7440005020 con 0x7f74481076e0 2024-09-12T12:25:47.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.834+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74481a1ee0 con 0x7f74481076e0 2024-09-12T12:25:47.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.834+0000 7f7445600640 1 -- 172.21.15.38:0/2813428086 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74400106d0 con 0x7f74481076e0 2024-09-12T12:25:47.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.834+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74481a22f0 con 0x7f74481076e0 2024-09-12T12:25:47.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.835+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74480fdb90 con 0x7f74481076e0 2024-09-12T12:25:47.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.837+0000 7f7445600640 1 -- 172.21.15.38:0/2813428086 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f74400054d0 con 0x7f74481076e0 2024-09-12T12:25:47.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.838+0000 7f7445600640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f74300a2b90 0x7f74300a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.838+0000 7f7445600640 1 -- 172.21.15.38:0/2813428086 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f74400cfad0 con 0x7f74481076e0 2024-09-12T12:25:47.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.838+0000 7f744ca00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f74300a2b90 0x7f74300a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.839+0000 7f744ca00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f74300a2b90 0x7f74300a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f743c009bd0 tx=0x7f743c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:47.840+0000 7f7445600640 1 -- 172.21.15.38:0/2813428086 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f744009c620 con 0x7f74481076e0 2024-09-12T12:25:48.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.028+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f744802d7c0 con 0x7f74481076e0 2024-09-12T12:25:48.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.030+0000 7f7445600640 1 -- 172.21.15.38:0/2813428086 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f744009bf20 con 0x7f74481076e0 2024-09-12T12:25:48.029 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f74300a2b90 msgr2=0x7f74300a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f74300a2b90 0x7f74300a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f743c009bd0 tx=0x7f743c005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74481076e0 msgr2=0x7f7448100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74481076e0 0x7f7448100970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7440005fd0 tx=0x7f744000ef10 comp rx=0 tx=0).stop 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 shutdown_connections 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f74300a2b90 0x7f74300a5050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74481076e0 0x7f7448100970 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7448104db0 0x7f7448100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 --2- 172.21.15.38:0/2813428086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448102480 0x7f7448101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 >> 172.21.15.38:0/2813428086 conn(0x7f74480fc0a0 msgr2=0x7f7448102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 shutdown_connections 2024-09-12T12:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.031+0000 7f744de00640 1 -- 172.21.15.38:0/2813428086 wait complete. 2024-09-12T12:25:48.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T12:25:48.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 -- 172.21.15.38:0/1001841197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f90104f20 msgr2=0x7f0f901053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 --2- 172.21.15.38:0/1001841197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f90104f20 0x7f0f901053a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009900 tx=0x7f0f7802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:48.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 -- 172.21.15.38:0/1001841197 shutdown_connections 2024-09-12T12:25:48.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 --2- 172.21.15.38:0/1001841197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f901058e0 0x7f0f9010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 --2- 172.21.15.38:0/1001841197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f90104f20 0x7f0f901053a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 --2- 172.21.15.38:0/1001841197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90103d30 0x7f0f90104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 -- 172.21.15.38:0/1001841197 >> 172.21.15.38:0/1001841197 conn(0x7f0f900ff470 msgr2=0x7f0f901018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 -- 172.21.15.38:0/1001841197 shutdown_connections 2024-09-12T12:25:48.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.210+0000 7f0f96e00640 1 -- 172.21.15.38:0/1001841197 wait complete. 2024-09-12T12:25:48.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 Processor -- start 2024-09-12T12:25:48.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 -- start start 2024-09-12T12:25:48.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f90103d30 0x7f0f9019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90104f20 0x7f0f9019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f901058e0 0x7f0f901a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9010fa00 con 0x7f0f901058e0 2024-09-12T12:25:48.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9010f880 con 0x7f0f90103d30 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.211+0000 7f0f96e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9010fb80 con 0x7f0f90104f20 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f901058e0 0x7f0f901a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90104f20 0x7f0f9019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f8fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f90103d30 0x7f0f9019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90104f20 0x7f0f9019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:46818/0 (socket says 172.21.15.38:46818) 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f901058e0 0x7f0f901a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41038/0 (socket says 172.21.15.38:41038) 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f87e00640 1 -- 172.21.15.38:0/2439078023 learned_addr learned my addr 172.21.15.38:0/2439078023 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 -- 172.21.15.38:0/2439078023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90104f20 msgr2=0x7f0f9019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90104f20 0x7f0f9019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 -- 172.21.15.38:0/2439078023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f90103d30 msgr2=0x7f0f9019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f90103d30 0x7f0f9019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 -- 172.21.15.38:0/2439078023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f901a1cd0 con 0x7f0f901058e0 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f87e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90104f20 0x7f0f9019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.212+0000 7f0f94e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f901058e0 0x7f0f901a1660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800da10 tx=0x7f0f8800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.213+0000 7f0f8d600640 1 -- 172.21.15.38:0/2439078023 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800bd70 con 0x7f0f901058e0 2024-09-12T12:25:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.213+0000 7f0f8d600640 1 -- 172.21.15.38:0/2439078023 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f88003e50 con 0x7f0f901058e0 2024-09-12T12:25:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.213+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f901a1fc0 con 0x7f0f901058e0 2024-09-12T12:25:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.213+0000 7f0f8d600640 1 -- 172.21.15.38:0/2439078023 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880106a0 con 0x7f0f901058e0 2024-09-12T12:25:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.213+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f901a2480 con 0x7f0f901058e0 2024-09-12T12:25:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.214+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9010b1c0 con 0x7f0f901058e0 2024-09-12T12:25:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.216+0000 7f0f8d600640 1 -- 172.21.15.38:0/2439078023 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0f88003970 con 0x7f0f901058e0 2024-09-12T12:25:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.217+0000 7f0f8d600640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0f740a2c10 0x7f0f740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.217+0000 7f0f8d600640 1 -- 172.21.15.38:0/2439078023 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f0f880cf760 con 0x7f0f901058e0 2024-09-12T12:25:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.217+0000 7f0f8fe00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0f740a2c10 0x7f0f740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.218+0000 7f0f8fe00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0f740a2c10 0x7f0f740a50d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005fd0 tx=0x7f0f8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.221+0000 7f0f8d600640 1 -- 172.21.15.38:0/2439078023 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f8809c2b0 con 0x7f0f901058e0 2024-09-12T12:25:48.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.407+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0f90062e90 con 0x7f0f901058e0 2024-09-12T12:25:48.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.407+0000 7f0f8d600640 1 -- 172.21.15.38:0/2439078023 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f0f8809bbb0 con 0x7f0f901058e0 2024-09-12T12:25:48.408 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-12T12:25:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0f740a2c10 msgr2=0x7f0f740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0f740a2c10 0x7f0f740a50d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005fd0 tx=0x7f0f8000b390 comp rx=0 tx=0).stop 2024-09-12T12:25:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f901058e0 msgr2=0x7f0f901a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f901058e0 0x7f0f901a1660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800da10 tx=0x7f0f8800ded0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 shutdown_connections 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0f740a2c10 0x7f0f740a50d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f901058e0 0x7f0f901a1660 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f90104f20 0x7f0f9019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 --2- 172.21.15.38:0/2439078023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f90103d30 0x7f0f9019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 >> 172.21.15.38:0/2439078023 conn(0x7f0f900ff470 msgr2=0x7f0f90108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 shutdown_connections 2024-09-12T12:25:48.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.409+0000 7f0f96e00640 1 -- 172.21.15.38:0/2439078023 wait complete. 2024-09-12T12:25:48.423 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:48 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1850779231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:25:48.424 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:48 smithi038 ceph-mon[30810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:25:48.424 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:48 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/404475783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:48.424 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:48 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2813428086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:25:48.425 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T12:25:48.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:48 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1850779231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:25:48.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:48 smithi071 ceph-mon[34859]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:25:48.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:48 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/404475783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:48.515 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:48 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2813428086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 -- 172.21.15.38:0/316056649 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c103d30 msgr2=0x7f332c104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 --2- 172.21.15.38:0/316056649 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c103d30 0x7f332c104130 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f331c009ca0 tx=0x7f331c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 -- 172.21.15.38:0/316056649 shutdown_connections 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 --2- 172.21.15.38:0/316056649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f332c1058e0 0x7f332c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 --2- 172.21.15.38:0/316056649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f332c104f20 0x7f332c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 --2- 172.21.15.38:0/316056649 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c103d30 0x7f332c104130 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 -- 172.21.15.38:0/316056649 >> 172.21.15.38:0/316056649 conn(0x7f332c0ff470 msgr2=0x7f332c1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 -- 172.21.15.38:0/316056649 shutdown_connections 2024-09-12T12:25:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.587+0000 7f3330a00640 1 -- 172.21.15.38:0/316056649 wait complete. 2024-09-12T12:25:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 Processor -- start 2024-09-12T12:25:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 -- start start 2024-09-12T12:25:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f332c103d30 0x7f332c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c104f20 0x7f332c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f332c1058e0 0x7f332c1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f332c10f9b0 con 0x7f332c104f20 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f332c10f830 con 0x7f332c103d30 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.588+0000 7f3330a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f332c10fb30 con 0x7f332c1058e0 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c104f20 0x7f332c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c104f20 0x7f332c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41052/0 (socket says 172.21.15.38:41052) 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 -- 172.21.15.38:0/738567314 learned_addr learned my addr 172.21.15.38:0/738567314 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3329e00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f332c103d30 0x7f332c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f332a800640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f332c1058e0 0x7f332c1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 -- 172.21.15.38:0/738567314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f332c1058e0 msgr2=0x7f332c1a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f332c1058e0 0x7f332c1a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 -- 172.21.15.38:0/738567314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f332c103d30 msgr2=0x7f332c19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f332c103d30 0x7f332c19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 -- 172.21.15.38:0/738567314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c1a1ce0 con 0x7f332c104f20 2024-09-12T12:25:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.589+0000 7f3321400640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c104f20 0x7f332c19a600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f331400e9f0 tx=0x7f331400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.590+0000 7f3323400640 1 -- 172.21.15.38:0/738567314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331400cd80 con 0x7f332c104f20 2024-09-12T12:25:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.590+0000 7f3323400640 1 -- 172.21.15.38:0/738567314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3314005500 con 0x7f332c104f20 2024-09-12T12:25:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.590+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c1a1fd0 con 0x7f332c104f20 2024-09-12T12:25:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.590+0000 7f3323400640 1 -- 172.21.15.38:0/738567314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3314010690 con 0x7f332c104f20 2024-09-12T12:25:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.590+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c1a2440 con 0x7f332c104f20 2024-09-12T12:25:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.591+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332c10b1c0 con 0x7f332c104f20 2024-09-12T12:25:48.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.593+0000 7f3323400640 1 -- 172.21.15.38:0/738567314 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f33140046c0 con 0x7f332c104f20 2024-09-12T12:25:48.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.594+0000 7f3323400640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f33100a2b90 0x7f33100a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.594+0000 7f3323400640 1 -- 172.21.15.38:0/738567314 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f33140cf8a0 con 0x7f332c104f20 2024-09-12T12:25:48.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.594+0000 7f3329e00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f33100a2b90 0x7f33100a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.595+0000 7f3329e00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f33100a2b90 0x7f33100a5050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f331c006010 tx=0x7f331c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.596+0000 7f3323400640 1 -- 172.21.15.38:0/738567314 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f331409c3f0 con 0x7f332c104f20 2024-09-12T12:25:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:48 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1850779231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:25:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:48 smithi154 ceph-mon[35578]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:25:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:48 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/404475783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:48.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:48 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2813428086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:25:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.782+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f332c02da10 con 0x7f332c104f20 2024-09-12T12:25:48.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.782+0000 7f3323400640 1 -- 172.21.15.38:0/738567314 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f331409bcf0 con 0x7f332c104f20 2024-09-12T12:25:48.783 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-09-12T12:25:48.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.784+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f33100a2b90 msgr2=0x7f33100a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.784+0000 7f3330a00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f33100a2b90 0x7f33100a5050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f331c006010 tx=0x7f331c000f40 comp rx=0 tx=0).stop 2024-09-12T12:25:48.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.784+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c104f20 msgr2=0x7f332c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.784+0000 7f3330a00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c104f20 0x7f332c19a600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f331400e9f0 tx=0x7f331400edf0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 shutdown_connections 2024-09-12T12:25:48.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f33100a2b90 0x7f33100a5050 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f332c1058e0 0x7f332c1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f332c104f20 0x7f332c19a600 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 --2- 172.21.15.38:0/738567314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f332c103d30 0x7f332c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 >> 172.21.15.38:0/738567314 conn(0x7f332c0ff470 msgr2=0x7f332c108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 shutdown_connections 2024-09-12T12:25:48.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.785+0000 7f3330a00640 1 -- 172.21.15.38:0/738567314 wait complete. 2024-09-12T12:25:48.801 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T12:25:48.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 -- 172.21.15.38:0/3746963039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c104f10 msgr2=0x7f904c105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 --2- 172.21.15.38:0/3746963039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c104f10 0x7f904c105390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9034009860 tx=0x7f903402a340 comp rx=0 tx=0).stop 2024-09-12T12:25:48.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 -- 172.21.15.38:0/3746963039 shutdown_connections 2024-09-12T12:25:48.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 --2- 172.21.15.38:0/3746963039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c1058d0 0x7f904c10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 --2- 172.21.15.38:0/3746963039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c104f10 0x7f904c105390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 --2- 172.21.15.38:0/3746963039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 0x7f904c104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 -- 172.21.15.38:0/3746963039 >> 172.21.15.38:0/3746963039 conn(0x7f904c0ff4a0 msgr2=0x7f904c1018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 -- 172.21.15.38:0/3746963039 shutdown_connections 2024-09-12T12:25:48.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.963+0000 7f9052400640 1 -- 172.21.15.38:0/3746963039 wait complete. 2024-09-12T12:25:48.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 Processor -- start 2024-09-12T12:25:48.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 -- start start 2024-09-12T12:25:48.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 0x7f904c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c104f10 0x7f904c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c1058d0 0x7f904c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10f9a0 con 0x7f904c103d20 2024-09-12T12:25:48.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10f820 con 0x7f904c1058d0 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9052400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f904c10fb20 con 0x7f904c104f10 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f904b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 0x7f904c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f904b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 0x7f904c19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41070/0 (socket says 172.21.15.38:41070) 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f904b400640 1 -- 172.21.15.38:0/2390356474 learned_addr learned my addr 172.21.15.38:0/2390356474 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f9043e00640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c104f10 0x7f904c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.964+0000 7f904be00640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c1058d0 0x7f904c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f904b400640 1 -- 172.21.15.38:0/2390356474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c104f10 msgr2=0x7f904c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f904b400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c104f10 0x7f904c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f904b400640 1 -- 172.21.15.38:0/2390356474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c1058d0 msgr2=0x7f904c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f904b400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c1058d0 0x7f904c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f904b400640 1 -- 172.21.15.38:0/2390356474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c1a1ca0 con 0x7f904c103d20 2024-09-12T12:25:48.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f904be00640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c1058d0 0x7f904c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:48.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f904b400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 0x7f904c19a080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f903c00e9f0 tx=0x7f903c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f9048c00640 1 -- 172.21.15.38:0/2390356474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c00ccc0 con 0x7f904c103d20 2024-09-12T12:25:48.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f9048c00640 1 -- 172.21.15.38:0/2390356474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f903c0035f0 con 0x7f904c103d20 2024-09-12T12:25:48.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c1a1f90 con 0x7f904c103d20 2024-09-12T12:25:48.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f9048c00640 1 -- 172.21.15.38:0/2390356474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c00ce60 con 0x7f904c103d20 2024-09-12T12:25:48.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.965+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c1a23f0 con 0x7f904c103d20 2024-09-12T12:25:48.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.966+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c10b160 con 0x7f904c103d20 2024-09-12T12:25:48.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.968+0000 7f9048c00640 1 -- 172.21.15.38:0/2390356474 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f903c0037a0 con 0x7f904c103d20 2024-09-12T12:25:48.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.969+0000 7f9048c00640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f90300a2b90 0x7f90300a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.970+0000 7f9048c00640 1 -- 172.21.15.38:0/2390356474 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f903c0cf720 con 0x7f904c103d20 2024-09-12T12:25:48.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.970+0000 7f9043e00640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f90300a2b90 0x7f90300a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.971+0000 7f9043e00640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f90300a2b90 0x7f90300a5050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9034009830 tx=0x7f9034030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:48.974+0000 7f9048c00640 1 -- 172.21.15.38:0/2390356474 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f903c09c270 con 0x7f904c103d20 2024-09-12T12:25:49.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.158+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f904c062ef0 con 0x7f904c103d20 2024-09-12T12:25:49.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.158+0000 7f9048c00640 1 -- 172.21.15.38:0/2390356474 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f903c09bb70 con 0x7f904c103d20 2024-09-12T12:25:49.159 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-12T12:25:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f90300a2b90 msgr2=0x7f90300a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f90300a2b90 0x7f90300a5050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9034009830 tx=0x7f9034030550 comp rx=0 tx=0).stop 2024-09-12T12:25:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 msgr2=0x7f904c19a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 0x7f904c19a080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f903c00e9f0 tx=0x7f903c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 shutdown_connections 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f90300a2b90 0x7f90300a5050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f904c1058d0 0x7f904c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c104f10 0x7f904c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 --2- 172.21.15.38:0/2390356474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c103d20 0x7f904c19a080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 >> 172.21.15.38:0/2390356474 conn(0x7f904c0ff4a0 msgr2=0x7f904c108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 shutdown_connections 2024-09-12T12:25:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:49.161+0000 7f9052400640 1 -- 172.21.15.38:0/2390356474 wait complete. 2024-09-12T12:25:49.178 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T12:25:49.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:49 smithi038 ceph-mon[30810]: pgmap v390: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-12T12:25:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:49 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2439078023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:49 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/738567314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:49 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2390356474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:49 smithi071 ceph-mon[34859]: pgmap v390: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-12T12:25:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:49 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2439078023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:49 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/738567314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:49 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2390356474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.561 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:49.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:49 smithi154 ceph-mon[35578]: pgmap v390: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-12T12:25:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:49 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2439078023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:49 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/738567314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:25:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:49 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2390356474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 -- 172.21.15.38:0/1683253303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 msgr2=0x7f6b94104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 --2- 172.21.15.38:0/1683253303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b94104230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009900 tx=0x7f6b8402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 -- 172.21.15.38:0/1683253303 shutdown_connections 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 --2- 172.21.15.38:0/1683253303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b94109090 0x7f6b94110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 --2- 172.21.15.38:0/1683253303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b94104800 0x7f6b94108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 --2- 172.21.15.38:0/1683253303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b94104230 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 -- 172.21.15.38:0/1683253303 >> 172.21.15.38:0/1683253303 conn(0x7f6b940ff8b0 msgr2=0x7f6b94101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 -- 172.21.15.38:0/1683253303 shutdown_connections 2024-09-12T12:25:50.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.114+0000 7f6b93e00640 1 -- 172.21.15.38:0/1683253303 wait complete. 2024-09-12T12:25:50.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.115+0000 7f6b93e00640 1 Processor -- start 2024-09-12T12:25:50.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.116+0000 7f6b93e00640 1 -- start start 2024-09-12T12:25:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.116+0000 7f6b93e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b9419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.116+0000 7f6b93e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b94104800 0x7f6b9419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.116+0000 7f6b93e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b94109090 0x7f6b9419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.116+0000 7f6b93e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b941140a0 con 0x7f6b94103e50 2024-09-12T12:25:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.116+0000 7f6b93e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94113f20 con 0x7f6b94104800 2024-09-12T12:25:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.116+0000 7f6b93e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94114220 con 0x7f6b94109090 2024-09-12T12:25:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b9419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b9419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41090/0 (socket says 172.21.15.38:41090) 2024-09-12T12:25:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 -- 172.21.15.38:0/2276185855 learned_addr learned my addr 172.21.15.38:0/2276185855 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b8be00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b94104800 0x7f6b9419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 -- 172.21.15.38:0/2276185855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b94109090 msgr2=0x7f6b9419ee50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b94109090 0x7f6b9419ee50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 -- 172.21.15.38:0/2276185855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b94104800 msgr2=0x7f6b9419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b94104800 0x7f6b9419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 -- 172.21.15.38:0/2276185855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9419f530 con 0x7f6b94103e50 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b8be00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b94104800 0x7f6b9419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.117+0000 7f6b92a00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b9419a580 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006010 tx=0x7f6b840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.118+0000 7f6b8b400640 1 -- 172.21.15.38:0/2276185855 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8403f030 con 0x7f6b94103e50 2024-09-12T12:25:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.118+0000 7f6b8b400640 1 -- 172.21.15.38:0/2276185855 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b84003ce0 con 0x7f6b94103e50 2024-09-12T12:25:50.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.118+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9419f7c0 con 0x7f6b94103e50 2024-09-12T12:25:50.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.118+0000 7f6b8b400640 1 -- 172.21.15.38:0/2276185855 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84035070 con 0x7f6b94103e50 2024-09-12T12:25:50.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.118+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b941a7100 con 0x7f6b94103e50 2024-09-12T12:25:50.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.119+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b94105330 con 0x7f6b94103e50 2024-09-12T12:25:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.121+0000 7f6b8b400640 1 -- 172.21.15.38:0/2276185855 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6b84042030 con 0x7f6b94103e50 2024-09-12T12:25:50.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.122+0000 7f6b8b400640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b780a2b80 0x7f6b780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.122+0000 7f6b8b400640 1 -- 172.21.15.38:0/2276185855 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f6b840efc70 con 0x7f6b94103e50 2024-09-12T12:25:50.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.123+0000 7f6b8be00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b780a2b80 0x7f6b780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.123+0000 7f6b8be00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b780a2b80 0x7f6b780a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b940ffd60 tx=0x7f6b7c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:50.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.125+0000 7f6b8b400640 1 -- 172.21.15.38:0/2276185855 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b840bc880 con 0x7f6b94103e50 2024-09-12T12:25:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.356+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b94104230 con 0x7f6b94103e50 2024-09-12T12:25:50.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.357+0000 7f6b8b400640 1 -- 172.21.15.38:0/2276185855 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7f6b840bc180 con 0x7f6b94103e50 2024-09-12T12:25:50.358 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:50.358 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:25:50.358 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b780a2b80 msgr2=0x7f6b780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b780a2b80 0x7f6b780a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b940ffd60 tx=0x7f6b7c005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 msgr2=0x7f6b9419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b9419a580 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006010 tx=0x7f6b840042f0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 shutdown_connections 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f6b780a2b80 0x7f6b780a5040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b94109090 0x7f6b9419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b94104800 0x7f6b9419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 --2- 172.21.15.38:0/2276185855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b94103e50 0x7f6b9419a580 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 >> 172.21.15.38:0/2276185855 conn(0x7f6b940ff8b0 msgr2=0x7f6b94100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:50.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.360+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 shutdown_connections 2024-09-12T12:25:50.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:50.361+0000 7f6b93e00640 1 -- 172.21.15.38:0/2276185855 wait complete. 2024-09-12T12:25:51.230 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T12:25:51.230 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T12:25:51.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 -- 172.21.15.38:0/3546046940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101f40 msgr2=0x7fe018109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 --2- 172.21.15.38:0/3546046940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101f40 0x7fe018109db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe010009be0 tx=0x7fe01002a6c0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 -- 172.21.15.38:0/3546046940 shutdown_connections 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 --2- 172.21.15.38:0/3546046940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101f40 0x7fe018109db0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 --2- 172.21.15.38:0/3546046940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018101580 0x7fe018101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 --2- 172.21.15.38:0/3546046940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe018103050 0x7fe018103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 -- 172.21.15.38:0/3546046940 >> 172.21.15.38:0/3546046940 conn(0x7fe0180fd110 msgr2=0x7fe0180ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:51.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.395+0000 7fe01ce00640 1 -- 172.21.15.38:0/3546046940 shutdown_connections 2024-09-12T12:25:51.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.396+0000 7fe01ce00640 1 -- 172.21.15.38:0/3546046940 wait complete. 2024-09-12T12:25:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.396+0000 7fe01ce00640 1 Processor -- start 2024-09-12T12:25:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.396+0000 7fe01ce00640 1 -- start start 2024-09-12T12:25:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe01ce00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101580 0x7fe018199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe01ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe018101f40 0x7fe01819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe01ce00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018103050 0x7fe0181a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe01ce00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810d6d0 con 0x7fe018103050 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe01ce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810d550 con 0x7fe018101f40 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe01ce00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810d850 con 0x7fe018101580 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe017e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018103050 0x7fe0181a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe016a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe018101f40 0x7fe01819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe017400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101580 0x7fe018199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe017e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018103050 0x7fe0181a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41100/0 (socket says 172.21.15.38:41100) 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe017e00640 1 -- 172.21.15.38:0/490282387 learned_addr learned my addr 172.21.15.38:0/490282387 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe016a00640 1 -- 172.21.15.38:0/490282387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101580 msgr2=0x7fe018199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe016a00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101580 0x7fe018199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe016a00640 1 -- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018103050 msgr2=0x7fe0181a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe016a00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018103050 0x7fe0181a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe016a00640 1 -- 172.21.15.38:0/490282387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0181a1b80 con 0x7fe018101f40 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.397+0000 7fe017e00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018103050 0x7fe0181a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.398+0000 7fe016a00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe018101f40 0x7fe01819a4a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe004005fd0 tx=0x7fe00400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.398+0000 7fe00fe00640 1 -- 172.21.15.38:0/490282387 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00400cd00 con 0x7fe018101f40 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.398+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0181a1e70 con 0x7fe018101f40 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.398+0000 7fe00fe00640 1 -- 172.21.15.38:0/490282387 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0040035f0 con 0x7fe018101f40 2024-09-12T12:25:51.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.398+0000 7fe00fe00640 1 -- 172.21.15.38:0/490282387 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004010690 con 0x7fe018101f40 2024-09-12T12:25:51.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.398+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0181a2380 con 0x7fe018101f40 2024-09-12T12:25:51.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.399+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe018101a00 con 0x7fe018101f40 2024-09-12T12:25:51.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.402+0000 7fe00fe00640 1 -- 172.21.15.38:0/490282387 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe0040037a0 con 0x7fe018101f40 2024-09-12T12:25:51.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.403+0000 7fe00fe00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdffc0a2b90 0x7fdffc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.403+0000 7fe00fe00640 1 -- 172.21.15.38:0/490282387 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fe0040cf6e0 con 0x7fe018101f40 2024-09-12T12:25:51.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.404+0000 7fe017400640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdffc0a2b90 0x7fdffc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.404+0000 7fe017400640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdffc0a2b90 0x7fdffc0a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0181029c0 tx=0x7fe008005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.405+0000 7fe00fe00640 1 -- 172.21.15.38:0/490282387 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe004009510 con 0x7fe018101f40 2024-09-12T12:25:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:51 smithi038 ceph-mon[30810]: pgmap v391: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T12:25:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:51 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2276185855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:51.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:51 smithi071 ceph-mon[34859]: pgmap v391: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T12:25:51.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:51 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2276185855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:51.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.588+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0181a2610 con 0x7fdffc0a2b90 2024-09-12T12:25:51.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.597+0000 7fe00fe00640 1 -- 172.21.15.38:0/490282387 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340549 (secure 0 0 0) 0x7fe0181a2610 con 0x7fdffc0a2b90 2024-09-12T12:25:51.602 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:51.605 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-12T12:25:51.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdffc0a2b90 msgr2=0x7fdffc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdffc0a2b90 0x7fdffc0a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0181029c0 tx=0x7fe008005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:51.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe018101f40 msgr2=0x7fe01819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe018101f40 0x7fe01819a4a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe004005fd0 tx=0x7fe00400ee50 comp rx=0 tx=0).stop 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 shutdown_connections 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fdffc0a2b90 0x7fdffc0a5050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe018103050 0x7fe0181a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe018101f40 0x7fe01819a4a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 --2- 172.21.15.38:0/490282387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe018101580 0x7fe018199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 >> 172.21.15.38:0/490282387 conn(0x7fe0180fd110 msgr2=0x7fe018074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 shutdown_connections 2024-09-12T12:25:51.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.602+0000 7fe01ce00640 1 -- 172.21.15.38:0/490282387 wait complete. 2024-09-12T12:25:51.618 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2024-09-12T12:25:50.118975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661940,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1354,"num_read_kb":799,"num_write":442,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388976,"kb_used_data":14768,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552848,"statfs":{"total":1151940427776,"available":1151542116352,"internally_reserved":0,"allocated":15122432,"data_stored":8345463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":622,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003703"},"pg_stats":[{"pgid":"2.1f","version":"91'13","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.359943+0000","last_change":"2024-09-12T12:22:51.847865+0000","last_active":"2024-09-12T12:25:45.359943+0000","last_peered":"2024-09-12T12:25:45.359943+0000","last_clean":"2024-09-12T12:25:45.359943+0000","last_became_active":"2024-09-12T12:22:51.847437+0000","last_became_peered":"2024-09-12T12:22:51.847437+0000","last_unstale":"2024-09-12T12:25:45.359943+0000","last_undegraded":"2024-09-12T12:25:45.359943+0000","last_fullsized":"2024-09-12T12:25:45.359943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:34.486264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.095342+0000","last_change":"2024-09-12T12:22:54.316759+0000","last_active":"2024-09-12T12:25:04.095342+0000","last_peered":"2024-09-12T12:25:04.095342+0000","last_clean":"2024-09-12T12:25:04.095342+0000","last_became_active":"2024-09-12T12:22:54.315906+0000","last_became_peered":"2024-09-12T12:22:54.315906+0000","last_unstale":"2024-09-12T12:25:04.095342+0000","last_undegraded":"2024-09-12T12:25:04.095342+0000","last_fullsized":"2024-09-12T12:25:04.095342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:54.465835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845553+0000","last_change":"2024-09-12T12:23:03.387327+0000","last_active":"2024-09-12T12:24:35.845553+0000","last_peered":"2024-09-12T12:24:35.845553+0000","last_clean":"2024-09-12T12:24:35.845553+0000","last_became_active":"2024-09-12T12:23:03.386929+0000","last_became_peered":"2024-09-12T12:23:03.386929+0000","last_unstale":"2024-09-12T12:24:35.845553+0000","last_undegraded":"2024-09-12T12:24:35.845553+0000","last_fullsized":"2024-09-12T12:24:35.845553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.033999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845672+0000","last_change":"2024-09-12T12:22:51.990331+0000","last_active":"2024-09-12T12:24:35.845672+0000","last_peered":"2024-09-12T12:24:35.845672+0000","last_clean":"2024-09-12T12:24:35.845672+0000","last_became_active":"2024-09-12T12:22:51.989844+0000","last_became_peered":"2024-09-12T12:22:51.989844+0000","last_unstale":"2024-09-12T12:24:35.845672+0000","last_undegraded":"2024-09-12T12:24:35.845672+0000","last_fullsized":"2024-09-12T12:24:35.845672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:47.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115744+0000","last_change":"2024-09-12T12:22:54.317141+0000","last_active":"2024-09-12T12:25:04.115744+0000","last_peered":"2024-09-12T12:25:04.115744+0000","last_clean":"2024-09-12T12:25:04.115744+0000","last_became_active":"2024-09-12T12:22:54.312292+0000","last_became_peered":"2024-09-12T12:22:54.312292+0000","last_unstale":"2024-09-12T12:25:04.115744+0000","last_undegraded":"2024-09-12T12:25:04.115744+0000","last_fullsized":"2024-09-12T12:25:04.115744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.943100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267584+0000","last_change":"2024-09-12T12:23:03.379532+0000","last_active":"2024-09-12T12:24:36.267584+0000","last_peered":"2024-09-12T12:24:36.267584+0000","last_clean":"2024-09-12T12:24:36.267584+0000","last_became_active":"2024-09-12T12:23:03.379087+0000","last_became_peered":"2024-09-12T12:23:03.379087+0000","last_unstale":"2024-09-12T12:24:36.267584+0000","last_undegraded":"2024-09-12T12:24:36.267584+0000","last_fullsized":"2024-09-12T12:24:36.267584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.971474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.279148+0000","last_change":"2024-09-12T12:24:36.278754+0000","last_active":"2024-09-12T12:24:36.279148+0000","last_peered":"2024-09-12T12:24:36.279148+0000","last_clean":"2024-09-12T12:24:36.279148+0000","last_became_active":"2024-09-12T12:24:36.269065+0000","last_became_peered":"2024-09-12T12:24:36.269065+0000","last_unstale":"2024-09-12T12:24:36.279148+0000","last_undegraded":"2024-09-12T12:24:36.279148+0000","last_fullsized":"2024-09-12T12:24:36.279148+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:12.224802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125655+0000","last_change":"2024-09-12T12:22:54.315178+0000","last_active":"2024-09-12T12:25:04.125655+0000","last_peered":"2024-09-12T12:25:04.125655+0000","last_clean":"2024-09-12T12:25:04.125655+0000","last_became_active":"2024-09-12T12:22:54.314408+0000","last_became_peered":"2024-09-12T12:22:54.314408+0000","last_unstale":"2024-09-12T12:25:04.125655+0000","last_undegraded":"2024-09-12T12:25:04.125655+0000","last_fullsized":"2024-09-12T12:25:04.125655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268083+0000","last_change":"2024-09-12T12:23:03.384629+0000","last_active":"2024-09-12T12:24:36.268083+0000","last_peered":"2024-09-12T12:24:36.268083+0000","last_clean":"2024-09-12T12:24:36.268083+0000","last_became_active":"2024-09-12T12:23:03.383750+0000","last_became_peered":"2024-09-12T12:23:03.383750+0000","last_unstale":"2024-09-12T12:24:36.268083+0000","last_undegraded":"2024-09-12T12:24:36.268083+0000","last_fullsized":"2024-09-12T12:24:36.268083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:24.377269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844538+0000","last_change":"2024-09-12T12:22:51.847561+0000","last_active":"2024-09-12T12:24:35.844538+0000","last_peered":"2024-09-12T12:24:35.844538+0000","last_clean":"2024-09-12T12:24:35.844538+0000","last_became_active":"2024-09-12T12:22:51.846862+0000","last_became_peered":"2024-09-12T12:22:51.846862+0000","last_unstale":"2024-09-12T12:24:35.844538+0000","last_undegraded":"2024-09-12T12:24:35.844538+0000","last_fullsized":"2024-09-12T12:24:35.844538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:37.907652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107286+0000","last_change":"2024-09-12T12:22:54.313493+0000","last_active":"2024-09-12T12:25:04.107286+0000","last_peered":"2024-09-12T12:25:04.107286+0000","last_clean":"2024-09-12T12:25:04.107286+0000","last_became_active":"2024-09-12T12:22:54.313115+0000","last_became_peered":"2024-09-12T12:22:54.313115+0000","last_unstale":"2024-09-12T12:25:04.107286+0000","last_undegraded":"2024-09-12T12:25:04.107286+0000","last_fullsized":"2024-09-12T12:25:04.107286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:39.631537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267750+0000","last_change":"2024-09-12T12:23:03.383997+0000","last_active":"2024-09-12T12:24:36.267750+0000","last_peered":"2024-09-12T12:24:36.267750+0000","last_clean":"2024-09-12T12:24:36.267750+0000","last_became_active":"2024-09-12T12:23:03.382952+0000","last_became_peered":"2024-09-12T12:23:03.382952+0000","last_unstale":"2024-09-12T12:24:36.267750+0000","last_undegraded":"2024-09-12T12:24:36.267750+0000","last_fullsized":"2024-09-12T12:24:36.267750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:37.949848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124206+0000","last_change":"2024-09-12T12:22:54.311875+0000","last_active":"2024-09-12T12:25:04.124206+0000","last_peered":"2024-09-12T12:25:04.124206+0000","last_clean":"2024-09-12T12:25:04.124206+0000","last_became_active":"2024-09-12T12:22:54.311301+0000","last_became_peered":"2024-09-12T12:22:54.311301+0000","last_unstale":"2024-09-12T12:25:04.124206+0000","last_undegraded":"2024-09-12T12:25:04.124206+0000","last_fullsized":"2024-09-12T12:25:04.124206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:47.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844056+0000","last_change":"2024-09-12T12:22:51.849400+0000","last_active":"2024-09-12T12:24:35.844056+0000","last_peered":"2024-09-12T12:24:35.844056+0000","last_clean":"2024-09-12T12:24:35.844056+0000","last_became_active":"2024-09-12T12:22:51.848295+0000","last_became_peered":"2024-09-12T12:22:51.848295+0000","last_unstale":"2024-09-12T12:24:35.844056+0000","last_undegraded":"2024-09-12T12:24:35.844056+0000","last_fullsized":"2024-09-12T12:24:35.844056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268139+0000","last_change":"2024-09-12T12:23:03.779217+0000","last_active":"2024-09-12T12:24:36.268139+0000","last_peered":"2024-09-12T12:24:36.268139+0000","last_clean":"2024-09-12T12:24:36.268139+0000","last_became_active":"2024-09-12T12:23:03.778732+0000","last_became_peered":"2024-09-12T12:23:03.778732+0000","last_unstale":"2024-09-12T12:24:36.268139+0000","last_undegraded":"2024-09-12T12:24:36.268139+0000","last_fullsized":"2024-09-12T12:24:36.268139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:49.676157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119742+0000","last_change":"2024-09-12T12:22:54.323222+0000","last_active":"2024-09-12T12:25:04.119742+0000","last_peered":"2024-09-12T12:25:04.119742+0000","last_clean":"2024-09-12T12:25:04.119742+0000","last_became_active":"2024-09-12T12:22:54.321035+0000","last_became_peered":"2024-09-12T12:22:54.321035+0000","last_unstale":"2024-09-12T12:25:04.119742+0000","last_undegraded":"2024-09-12T12:25:04.119742+0000","last_fullsized":"2024-09-12T12:25:04.119742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:04.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:37.742255+0000","last_change":"2024-09-12T12:24:35.850509+0000","last_active":"2024-09-12T12:24:37.742255+0000","last_peered":"2024-09-12T12:24:37.742255+0000","last_clean":"2024-09-12T12:24:37.742255+0000","last_became_active":"2024-09-12T12:24:35.846578+0000","last_became_peered":"2024-09-12T12:24:35.846578+0000","last_unstale":"2024-09-12T12:24:37.742255+0000","last_undegraded":"2024-09-12T12:24:37.742255+0000","last_fullsized":"2024-09-12T12:24:37.742255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:10.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267896+0000","last_change":"2024-09-12T12:23:35.079820+0000","last_active":"2024-09-12T12:24:36.267896+0000","last_peered":"2024-09-12T12:24:36.267896+0000","last_clean":"2024-09-12T12:24:36.267896+0000","last_became_active":"2024-09-12T12:23:35.079362+0000","last_became_peered":"2024-09-12T12:23:35.079362+0000","last_unstale":"2024-09-12T12:24:36.267896+0000","last_undegraded":"2024-09-12T12:24:36.267896+0000","last_fullsized":"2024-09-12T12:24:36.267896+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:22.713646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.113669+0000","last_change":"2024-09-12T12:22:54.307950+0000","last_active":"2024-09-12T12:25:04.113669+0000","last_peered":"2024-09-12T12:25:04.113669+0000","last_clean":"2024-09-12T12:25:04.113669+0000","last_became_active":"2024-09-12T12:22:54.307595+0000","last_became_peered":"2024-09-12T12:22:54.307595+0000","last_unstale":"2024-09-12T12:25:04.113669+0000","last_undegraded":"2024-09-12T12:25:04.113669+0000","last_fullsized":"2024-09-12T12:25:04.113669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:11.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845284+0000","last_change":"2024-09-12T12:22:51.851424+0000","last_active":"2024-09-12T12:24:35.845284+0000","last_peered":"2024-09-12T12:24:35.845284+0000","last_clean":"2024-09-12T12:24:35.845284+0000","last_became_active":"2024-09-12T12:22:51.851043+0000","last_became_peered":"2024-09-12T12:22:51.851043+0000","last_unstale":"2024-09-12T12:24:35.845284+0000","last_undegraded":"2024-09-12T12:24:35.845284+0000","last_fullsized":"2024-09-12T12:24:35.845284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841205+0000","last_change":"2024-09-12T12:23:03.381773+0000","last_active":"2024-09-12T12:24:35.841205+0000","last_peered":"2024-09-12T12:24:35.841205+0000","last_clean":"2024-09-12T12:24:35.841205+0000","last_became_active":"2024-09-12T12:23:03.378442+0000","last_became_peered":"2024-09-12T12:23:03.378442+0000","last_unstale":"2024-09-12T12:24:35.841205+0000","last_undegraded":"2024-09-12T12:24:35.841205+0000","last_fullsized":"2024-09-12T12:24:35.841205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.570787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.085994+0000","last_change":"2024-09-12T12:22:54.310010+0000","last_active":"2024-09-12T12:25:04.085994+0000","last_peered":"2024-09-12T12:25:04.085994+0000","last_clean":"2024-09-12T12:25:04.085994+0000","last_became_active":"2024-09-12T12:22:54.309499+0000","last_became_peered":"2024-09-12T12:22:54.309499+0000","last_unstale":"2024-09-12T12:25:04.085994+0000","last_undegraded":"2024-09-12T12:25:04.085994+0000","last_fullsized":"2024-09-12T12:25:04.085994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.456842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.453985+0000","last_change":"2024-09-12T12:22:51.990294+0000","last_active":"2024-09-12T12:24:36.453985+0000","last_peered":"2024-09-12T12:24:36.453985+0000","last_clean":"2024-09-12T12:24:36.453985+0000","last_became_active":"2024-09-12T12:22:51.989925+0000","last_became_peered":"2024-09-12T12:22:51.989925+0000","last_unstale":"2024-09-12T12:24:36.453985+0000","last_undegraded":"2024-09-12T12:24:36.453985+0000","last_fullsized":"2024-09-12T12:24:36.453985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:56.754802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267961+0000","last_change":"2024-09-12T12:23:03.780256+0000","last_active":"2024-09-12T12:24:36.267961+0000","last_peered":"2024-09-12T12:24:36.267961+0000","last_clean":"2024-09-12T12:24:36.267961+0000","last_became_active":"2024-09-12T12:23:03.779808+0000","last_became_peered":"2024-09-12T12:23:03.779808+0000","last_unstale":"2024-09-12T12:24:36.267961+0000","last_undegraded":"2024-09-12T12:24:36.267961+0000","last_fullsized":"2024-09-12T12:24:36.267961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:58.236749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115819+0000","last_change":"2024-09-12T12:23:35.084287+0000","last_active":"2024-09-12T12:25:04.115819+0000","last_peered":"2024-09-12T12:25:04.115819+0000","last_clean":"2024-09-12T12:25:04.115819+0000","last_became_active":"2024-09-12T12:23:35.083828+0000","last_became_peered":"2024-09-12T12:23:35.083828+0000","last_unstale":"2024-09-12T12:25:04.115819+0000","last_undegraded":"2024-09-12T12:25:04.115819+0000","last_fullsized":"2024-09-12T12:25:04.115819+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:36.183575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268345+0000","last_change":"2024-09-12T12:22:52.557264+0000","last_active":"2024-09-12T12:24:36.268345+0000","last_peered":"2024-09-12T12:24:36.268345+0000","last_clean":"2024-09-12T12:24:36.268345+0000","last_became_active":"2024-09-12T12:22:52.556783+0000","last_became_peered":"2024-09-12T12:22:52.556783+0000","last_unstale":"2024-09-12T12:24:36.268345+0000","last_undegraded":"2024-09-12T12:24:36.268345+0000","last_fullsized":"2024-09-12T12:24:36.268345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:08.815983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845595+0000","last_change":"2024-09-12T12:23:03.376129+0000","last_active":"2024-09-12T12:24:35.845595+0000","last_peered":"2024-09-12T12:24:35.845595+0000","last_clean":"2024-09-12T12:24:35.845595+0000","last_became_active":"2024-09-12T12:23:03.375200+0000","last_became_peered":"2024-09-12T12:23:03.375200+0000","last_unstale":"2024-09-12T12:24:35.845595+0000","last_undegraded":"2024-09-12T12:24:35.845595+0000","last_fullsized":"2024-09-12T12:24:35.845595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.418366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111408+0000","last_change":"2024-09-12T12:22:54.314708+0000","last_active":"2024-09-12T12:25:04.111408+0000","last_peered":"2024-09-12T12:25:04.111408+0000","last_clean":"2024-09-12T12:25:04.111408+0000","last_became_active":"2024-09-12T12:22:54.314304+0000","last_became_peered":"2024-09-12T12:22:54.314304+0000","last_unstale":"2024-09-12T12:25:04.111408+0000","last_undegraded":"2024-09-12T12:25:04.111408+0000","last_fullsized":"2024-09-12T12:25:04.111408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:52.198831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'16","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.327501+0000","last_change":"2024-09-12T12:22:51.846753+0000","last_active":"2024-09-12T12:25:04.327501+0000","last_peered":"2024-09-12T12:25:04.327501+0000","last_clean":"2024-09-12T12:25:04.327501+0000","last_became_active":"2024-09-12T12:22:51.846388+0000","last_became_peered":"2024-09-12T12:22:51.846388+0000","last_unstale":"2024-09-12T12:25:04.327501+0000","last_undegraded":"2024-09-12T12:25:04.327501+0000","last_fullsized":"2024-09-12T12:25:04.327501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:34.511644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844866+0000","last_change":"2024-09-12T12:23:03.779254+0000","last_active":"2024-09-12T12:24:35.844866+0000","last_peered":"2024-09-12T12:24:35.844866+0000","last_clean":"2024-09-12T12:24:35.844866+0000","last_became_active":"2024-09-12T12:23:03.778801+0000","last_became_peered":"2024-09-12T12:23:03.778801+0000","last_unstale":"2024-09-12T12:24:35.844866+0000","last_undegraded":"2024-09-12T12:24:35.844866+0000","last_fullsized":"2024-09-12T12:24:35.844866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.121722+0000","last_change":"2024-09-12T12:22:54.312002+0000","last_active":"2024-09-12T12:25:04.121722+0000","last_peered":"2024-09-12T12:25:04.121722+0000","last_clean":"2024-09-12T12:25:04.121722+0000","last_became_active":"2024-09-12T12:22:54.311670+0000","last_became_peered":"2024-09-12T12:22:54.311670+0000","last_unstale":"2024-09-12T12:25:04.121722+0000","last_undegraded":"2024-09-12T12:25:04.121722+0000","last_fullsized":"2024-09-12T12:25:04.121722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:08.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.856791+0000","last_change":"2024-09-12T12:24:35.856332+0000","last_active":"2024-09-12T12:24:35.856791+0000","last_peered":"2024-09-12T12:24:35.856791+0000","last_clean":"2024-09-12T12:24:35.856791+0000","last_became_active":"2024-09-12T12:24:35.846638+0000","last_became_peered":"2024-09-12T12:24:35.846638+0000","last_unstale":"2024-09-12T12:24:35.856791+0000","last_undegraded":"2024-09-12T12:24:35.856791+0000","last_fullsized":"2024-09-12T12:24:35.856791+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.181686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842993+0000","last_change":"2024-09-12T12:23:03.379901+0000","last_active":"2024-09-12T12:24:35.842993+0000","last_peered":"2024-09-12T12:24:35.842993+0000","last_clean":"2024-09-12T12:24:35.842993+0000","last_became_active":"2024-09-12T12:23:03.379385+0000","last_became_peered":"2024-09-12T12:23:03.379385+0000","last_unstale":"2024-09-12T12:24:35.842993+0000","last_undegraded":"2024-09-12T12:24:35.842993+0000","last_fullsized":"2024-09-12T12:24:35.842993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:47.939223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123208+0000","last_change":"2024-09-12T12:22:54.316450+0000","last_active":"2024-09-12T12:25:04.123208+0000","last_peered":"2024-09-12T12:25:04.123208+0000","last_clean":"2024-09-12T12:25:04.123208+0000","last_became_active":"2024-09-12T12:22:54.316058+0000","last_became_peered":"2024-09-12T12:22:54.316058+0000","last_unstale":"2024-09-12T12:25:04.123208+0000","last_undegraded":"2024-09-12T12:25:04.123208+0000","last_fullsized":"2024-09-12T12:25:04.123208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:38.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841156+0000","last_change":"2024-09-12T12:22:51.992564+0000","last_active":"2024-09-12T12:24:35.841156+0000","last_peered":"2024-09-12T12:24:35.841156+0000","last_clean":"2024-09-12T12:24:35.841156+0000","last_became_active":"2024-09-12T12:22:51.992012+0000","last_became_peered":"2024-09-12T12:22:51.992012+0000","last_unstale":"2024-09-12T12:24:35.841156+0000","last_undegraded":"2024-09-12T12:24:35.841156+0000","last_fullsized":"2024-09-12T12:24:35.841156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:26.190486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843880+0000","last_change":"2024-09-12T12:23:03.779309+0000","last_active":"2024-09-12T12:24:35.843880+0000","last_peered":"2024-09-12T12:24:35.843880+0000","last_clean":"2024-09-12T12:24:35.843880+0000","last_became_active":"2024-09-12T12:23:03.778812+0000","last_became_peered":"2024-09-12T12:23:03.778812+0000","last_unstale":"2024-09-12T12:24:35.843880+0000","last_undegraded":"2024-09-12T12:24:35.843880+0000","last_fullsized":"2024-09-12T12:24:35.843880+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:56.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115436+0000","last_change":"2024-09-12T12:22:54.309745+0000","last_active":"2024-09-12T12:25:04.115436+0000","last_peered":"2024-09-12T12:25:04.115436+0000","last_clean":"2024-09-12T12:25:04.115436+0000","last_became_active":"2024-09-12T12:22:54.309388+0000","last_became_peered":"2024-09-12T12:22:54.309388+0000","last_unstale":"2024-09-12T12:25:04.115436+0000","last_undegraded":"2024-09-12T12:25:04.115436+0000","last_fullsized":"2024-09-12T12:25:04.115436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.268141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.360609+0000","last_change":"2024-09-12T12:22:51.850494+0000","last_active":"2024-09-12T12:25:45.360609+0000","last_peered":"2024-09-12T12:25:45.360609+0000","last_clean":"2024-09-12T12:25:45.360609+0000","last_became_active":"2024-09-12T12:22:51.849071+0000","last_became_peered":"2024-09-12T12:22:51.849071+0000","last_unstale":"2024-09-12T12:25:45.360609+0000","last_undegraded":"2024-09-12T12:25:45.360609+0000","last_fullsized":"2024-09-12T12:25:45.360609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:19.203267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265150+0000","last_change":"2024-09-12T12:23:03.383096+0000","last_active":"2024-09-12T12:24:36.265150+0000","last_peered":"2024-09-12T12:24:36.265150+0000","last_clean":"2024-09-12T12:24:36.265150+0000","last_became_active":"2024-09-12T12:23:03.382261+0000","last_became_peered":"2024-09-12T12:23:03.382261+0000","last_unstale":"2024-09-12T12:24:36.265150+0000","last_undegraded":"2024-09-12T12:24:36.265150+0000","last_fullsized":"2024-09-12T12:24:36.265150+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:08.976679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.103037+0000","last_change":"2024-09-12T12:23:35.079333+0000","last_active":"2024-09-12T12:25:04.103037+0000","last_peered":"2024-09-12T12:25:04.103037+0000","last_clean":"2024-09-12T12:25:04.103037+0000","last_became_active":"2024-09-12T12:23:35.078908+0000","last_became_peered":"2024-09-12T12:23:35.078908+0000","last_unstale":"2024-09-12T12:25:04.103037+0000","last_undegraded":"2024-09-12T12:25:04.103037+0000","last_fullsized":"2024-09-12T12:25:04.103037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:55:59.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.359943+0000","last_change":"2024-09-12T12:22:51.990322+0000","last_active":"2024-09-12T12:25:45.359943+0000","last_peered":"2024-09-12T12:25:45.359943+0000","last_clean":"2024-09-12T12:25:45.359943+0000","last_became_active":"2024-09-12T12:22:51.989970+0000","last_became_peered":"2024-09-12T12:22:51.989970+0000","last_unstale":"2024-09-12T12:25:45.359943+0000","last_undegraded":"2024-09-12T12:25:45.359943+0000","last_fullsized":"2024-09-12T12:25:45.359943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:14.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265419+0000","last_change":"2024-09-12T12:23:35.083806+0000","last_active":"2024-09-12T12:24:36.265419+0000","last_peered":"2024-09-12T12:24:36.265419+0000","last_clean":"2024-09-12T12:24:36.265419+0000","last_became_active":"2024-09-12T12:23:35.083379+0000","last_became_peered":"2024-09-12T12:23:35.083379+0000","last_unstale":"2024-09-12T12:24:36.265419+0000","last_undegraded":"2024-09-12T12:24:36.265419+0000","last_fullsized":"2024-09-12T12:24:36.265419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:54.146429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119046+0000","last_change":"2024-09-12T12:22:54.305747+0000","last_active":"2024-09-12T12:25:04.119046+0000","last_peered":"2024-09-12T12:25:04.119046+0000","last_clean":"2024-09-12T12:25:04.119046+0000","last_became_active":"2024-09-12T12:22:54.305423+0000","last_became_peered":"2024-09-12T12:22:54.305423+0000","last_unstale":"2024-09-12T12:25:04.119046+0000","last_undegraded":"2024-09-12T12:25:04.119046+0000","last_fullsized":"2024-09-12T12:25:04.119046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.463661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846664+0000","last_change":"2024-09-12T12:22:51.852216+0000","last_active":"2024-09-12T12:24:35.846664+0000","last_peered":"2024-09-12T12:24:35.846664+0000","last_clean":"2024-09-12T12:24:35.846664+0000","last_became_active":"2024-09-12T12:22:51.850495+0000","last_became_peered":"2024-09-12T12:22:51.850495+0000","last_unstale":"2024-09-12T12:24:35.846664+0000","last_undegraded":"2024-09-12T12:24:35.846664+0000","last_fullsized":"2024-09-12T12:24:35.846664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:51.711697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840677+0000","last_change":"2024-09-12T12:23:35.118914+0000","last_active":"2024-09-12T12:24:35.840677+0000","last_peered":"2024-09-12T12:24:35.840677+0000","last_clean":"2024-09-12T12:24:35.840677+0000","last_became_active":"2024-09-12T12:23:35.118411+0000","last_became_peered":"2024-09-12T12:23:35.118411+0000","last_unstale":"2024-09-12T12:24:35.840677+0000","last_undegraded":"2024-09-12T12:24:35.840677+0000","last_fullsized":"2024-09-12T12:24:35.840677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:08.350538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109066+0000","last_change":"2024-09-12T12:22:54.320573+0000","last_active":"2024-09-12T12:25:04.109066+0000","last_peered":"2024-09-12T12:25:04.109066+0000","last_clean":"2024-09-12T12:25:04.109066+0000","last_became_active":"2024-09-12T12:22:54.320120+0000","last_became_peered":"2024-09-12T12:22:54.320120+0000","last_unstale":"2024-09-12T12:25:04.109066+0000","last_undegraded":"2024-09-12T12:25:04.109066+0000","last_fullsized":"2024-09-12T12:25:04.109066+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:35.490584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267023+0000","last_change":"2024-09-12T12:22:51.851098+0000","last_active":"2024-09-12T12:24:36.267023+0000","last_peered":"2024-09-12T12:24:36.267023+0000","last_clean":"2024-09-12T12:24:36.267023+0000","last_became_active":"2024-09-12T12:22:51.850725+0000","last_became_peered":"2024-09-12T12:22:51.850725+0000","last_unstale":"2024-09-12T12:24:36.267023+0000","last_undegraded":"2024-09-12T12:24:36.267023+0000","last_fullsized":"2024-09-12T12:24:36.267023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:18.308742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846840+0000","last_change":"2024-09-12T12:21:34.312000+0000","last_active":"2024-09-12T12:24:35.846840+0000","last_peered":"2024-09-12T12:24:35.846840+0000","last_clean":"2024-09-12T12:24:35.846840+0000","last_became_active":"2024-09-12T12:21:34.311472+0000","last_became_peered":"2024-09-12T12:21:34.311472+0000","last_unstale":"2024-09-12T12:24:35.846840+0000","last_undegraded":"2024-09-12T12:24:35.846840+0000","last_fullsized":"2024-09-12T12:24:35.846840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_clean_scrub_stamp":"2024-09-12T12:17:58.852566+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847001+0000","last_change":"2024-09-12T12:23:03.387802+0000","last_active":"2024-09-12T12:24:35.847001+0000","last_peered":"2024-09-12T12:24:35.847001+0000","last_clean":"2024-09-12T12:24:35.847001+0000","last_became_active":"2024-09-12T12:23:03.387391+0000","last_became_peered":"2024-09-12T12:23:03.387391+0000","last_unstale":"2024-09-12T12:24:35.847001+0000","last_undegraded":"2024-09-12T12:24:35.847001+0000","last_fullsized":"2024-09-12T12:24:35.847001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:24.741915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118292+0000","last_change":"2024-09-12T12:22:54.314326+0000","last_active":"2024-09-12T12:25:04.118292+0000","last_peered":"2024-09-12T12:25:04.118292+0000","last_clean":"2024-09-12T12:25:04.118292+0000","last_became_active":"2024-09-12T12:22:54.313892+0000","last_became_peered":"2024-09-12T12:22:54.313892+0000","last_unstale":"2024-09-12T12:25:04.118292+0000","last_undegraded":"2024-09-12T12:25:04.118292+0000","last_fullsized":"2024-09-12T12:25:04.118292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:50.980891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'7","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.361468+0000","last_change":"2024-09-12T12:22:52.557126+0000","last_active":"2024-09-12T12:25:45.361468+0000","last_peered":"2024-09-12T12:25:45.361468+0000","last_clean":"2024-09-12T12:25:45.361468+0000","last_became_active":"2024-09-12T12:22:52.556736+0000","last_became_peered":"2024-09-12T12:22:52.556736+0000","last_unstale":"2024-09-12T12:25:45.361468+0000","last_undegraded":"2024-09-12T12:25:45.361468+0000","last_fullsized":"2024-09-12T12:25:45.361468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:09.199871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454196+0000","last_change":"2024-09-12T12:23:03.380117+0000","last_active":"2024-09-12T12:24:36.454196+0000","last_peered":"2024-09-12T12:24:36.454196+0000","last_clean":"2024-09-12T12:24:36.454196+0000","last_became_active":"2024-09-12T12:23:03.379635+0000","last_became_peered":"2024-09-12T12:23:03.379635+0000","last_unstale":"2024-09-12T12:24:36.454196+0000","last_undegraded":"2024-09-12T12:24:36.454196+0000","last_fullsized":"2024-09-12T12:24:36.454196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:23.227681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116460+0000","last_change":"2024-09-12T12:22:54.316010+0000","last_active":"2024-09-12T12:25:04.116460+0000","last_peered":"2024-09-12T12:25:04.116460+0000","last_clean":"2024-09-12T12:25:04.116460+0000","last_became_active":"2024-09-12T12:22:54.315702+0000","last_became_peered":"2024-09-12T12:22:54.315702+0000","last_unstale":"2024-09-12T12:25:04.116460+0000","last_undegraded":"2024-09-12T12:25:04.116460+0000","last_fullsized":"2024-09-12T12:25:04.116460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:52.370650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840843+0000","last_change":"2024-09-12T12:22:51.854456+0000","last_active":"2024-09-12T12:24:35.840843+0000","last_peered":"2024-09-12T12:24:35.840843+0000","last_clean":"2024-09-12T12:24:35.840843+0000","last_became_active":"2024-09-12T12:22:51.854092+0000","last_became_peered":"2024-09-12T12:22:51.854092+0000","last_unstale":"2024-09-12T12:24:35.840843+0000","last_undegraded":"2024-09-12T12:24:35.840843+0000","last_fullsized":"2024-09-12T12:24:35.840843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:57.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846546+0000","last_change":"2024-09-12T12:23:03.390443+0000","last_active":"2024-09-12T12:24:35.846546+0000","last_peered":"2024-09-12T12:24:35.846546+0000","last_clean":"2024-09-12T12:24:35.846546+0000","last_became_active":"2024-09-12T12:23:03.389825+0000","last_became_peered":"2024-09-12T12:23:03.389825+0000","last_unstale":"2024-09-12T12:24:35.846546+0000","last_undegraded":"2024-09-12T12:24:35.846546+0000","last_fullsized":"2024-09-12T12:24:35.846546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.711075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.112283+0000","last_change":"2024-09-12T12:22:54.311694+0000","last_active":"2024-09-12T12:25:04.112283+0000","last_peered":"2024-09-12T12:25:04.112283+0000","last_clean":"2024-09-12T12:25:04.112283+0000","last_became_active":"2024-09-12T12:22:54.311381+0000","last_became_peered":"2024-09-12T12:22:54.311381+0000","last_unstale":"2024-09-12T12:25:04.112283+0000","last_undegraded":"2024-09-12T12:25:04.112283+0000","last_fullsized":"2024-09-12T12:25:04.112283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.378495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.264726+0000","last_change":"2024-09-12T12:22:51.852126+0000","last_active":"2024-09-12T12:24:36.264726+0000","last_peered":"2024-09-12T12:24:36.264726+0000","last_clean":"2024-09-12T12:24:36.264726+0000","last_became_active":"2024-09-12T12:22:51.851766+0000","last_became_peered":"2024-09-12T12:22:51.851766+0000","last_unstale":"2024-09-12T12:24:36.264726+0000","last_undegraded":"2024-09-12T12:24:36.264726+0000","last_fullsized":"2024-09-12T12:24:36.264726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:37.263329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840007+0000","last_change":"2024-09-12T12:23:03.375569+0000","last_active":"2024-09-12T12:24:35.840007+0000","last_peered":"2024-09-12T12:24:35.840007+0000","last_clean":"2024-09-12T12:24:35.840007+0000","last_became_active":"2024-09-12T12:23:03.375136+0000","last_became_peered":"2024-09-12T12:23:03.375136+0000","last_unstale":"2024-09-12T12:24:35.840007+0000","last_undegraded":"2024-09-12T12:24:35.840007+0000","last_fullsized":"2024-09-12T12:24:35.840007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:05.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.108357+0000","last_change":"2024-09-12T12:22:54.304943+0000","last_active":"2024-09-12T12:25:04.108357+0000","last_peered":"2024-09-12T12:25:04.108357+0000","last_clean":"2024-09-12T12:25:04.108357+0000","last_became_active":"2024-09-12T12:22:54.304573+0000","last_became_peered":"2024-09-12T12:22:54.304573+0000","last_unstale":"2024-09-12T12:25:04.108357+0000","last_undegraded":"2024-09-12T12:25:04.108357+0000","last_fullsized":"2024-09-12T12:25:04.108357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844624+0000","last_change":"2024-09-12T12:22:51.846998+0000","last_active":"2024-09-12T12:24:35.844624+0000","last_peered":"2024-09-12T12:24:35.844624+0000","last_clean":"2024-09-12T12:24:35.844624+0000","last_became_active":"2024-09-12T12:22:51.846617+0000","last_became_peered":"2024-09-12T12:22:51.846617+0000","last_unstale":"2024-09-12T12:24:35.844624+0000","last_undegraded":"2024-09-12T12:24:35.844624+0000","last_fullsized":"2024-09-12T12:24:35.844624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.428244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840084+0000","last_change":"2024-09-12T12:23:03.383519+0000","last_active":"2024-09-12T12:24:35.840084+0000","last_peered":"2024-09-12T12:24:35.840084+0000","last_clean":"2024-09-12T12:24:35.840084+0000","last_became_active":"2024-09-12T12:23:03.383131+0000","last_became_peered":"2024-09-12T12:23:03.383131+0000","last_unstale":"2024-09-12T12:24:35.840084+0000","last_undegraded":"2024-09-12T12:24:35.840084+0000","last_fullsized":"2024-09-12T12:24:35.840084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:59.602027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107058+0000","last_change":"2024-09-12T12:22:54.312418+0000","last_active":"2024-09-12T12:25:04.107058+0000","last_peered":"2024-09-12T12:25:04.107058+0000","last_clean":"2024-09-12T12:25:04.107058+0000","last_became_active":"2024-09-12T12:22:54.311932+0000","last_became_peered":"2024-09-12T12:22:54.311932+0000","last_unstale":"2024-09-12T12:25:04.107058+0000","last_undegraded":"2024-09-12T12:25:04.107058+0000","last_fullsized":"2024-09-12T12:25:04.107058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:48.395607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843747+0000","last_change":"2024-09-12T12:22:51.993506+0000","last_active":"2024-09-12T12:24:35.843747+0000","last_peered":"2024-09-12T12:24:35.843747+0000","last_clean":"2024-09-12T12:24:35.843747+0000","last_became_active":"2024-09-12T12:22:51.993204+0000","last_became_peered":"2024-09-12T12:22:51.993204+0000","last_unstale":"2024-09-12T12:24:35.843747+0000","last_undegraded":"2024-09-12T12:24:35.843747+0000","last_fullsized":"2024-09-12T12:24:35.843747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:34.670023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265433+0000","last_change":"2024-09-12T12:23:03.388552+0000","last_active":"2024-09-12T12:24:36.265433+0000","last_peered":"2024-09-12T12:24:36.265433+0000","last_clean":"2024-09-12T12:24:36.265433+0000","last_became_active":"2024-09-12T12:23:03.388105+0000","last_became_peered":"2024-09-12T12:23:03.388105+0000","last_unstale":"2024-09-12T12:24:36.265433+0000","last_undegraded":"2024-09-12T12:24:36.265433+0000","last_fullsized":"2024-09-12T12:24:36.265433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:08.927714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106325+0000","last_change":"2024-09-12T12:23:35.081015+0000","last_active":"2024-09-12T12:25:04.106325+0000","last_peered":"2024-09-12T12:25:04.106325+0000","last_clean":"2024-09-12T12:25:04.106325+0000","last_became_active":"2024-09-12T12:23:35.080609+0000","last_became_peered":"2024-09-12T12:23:35.080609+0000","last_unstale":"2024-09-12T12:25:04.106325+0000","last_undegraded":"2024-09-12T12:25:04.106325+0000","last_fullsized":"2024-09-12T12:25:04.106325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:26.700031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:46.361952+0000","last_change":"2024-09-12T12:22:51.848784+0000","last_active":"2024-09-12T12:25:46.361952+0000","last_peered":"2024-09-12T12:25:46.361952+0000","last_clean":"2024-09-12T12:25:46.361952+0000","last_became_active":"2024-09-12T12:22:51.848255+0000","last_became_peered":"2024-09-12T12:22:51.848255+0000","last_unstale":"2024-09-12T12:25:46.361952+0000","last_undegraded":"2024-09-12T12:25:46.361952+0000","last_fullsized":"2024-09-12T12:25:46.361952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:00.680332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841265+0000","last_change":"2024-09-12T12:23:03.386046+0000","last_active":"2024-09-12T12:24:35.841265+0000","last_peered":"2024-09-12T12:24:35.841265+0000","last_clean":"2024-09-12T12:24:35.841265+0000","last_became_active":"2024-09-12T12:23:03.384264+0000","last_became_peered":"2024-09-12T12:23:03.384264+0000","last_unstale":"2024-09-12T12:24:35.841265+0000","last_undegraded":"2024-09-12T12:24:35.841265+0000","last_fullsized":"2024-09-12T12:24:35.841265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:23.605769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125553+0000","last_change":"2024-09-12T12:22:54.315588+0000","last_active":"2024-09-12T12:25:04.125553+0000","last_peered":"2024-09-12T12:25:04.125553+0000","last_clean":"2024-09-12T12:25:04.125553+0000","last_became_active":"2024-09-12T12:22:54.315216+0000","last_became_peered":"2024-09-12T12:22:54.315216+0000","last_unstale":"2024-09-12T12:25:04.125553+0000","last_undegraded":"2024-09-12T12:25:04.125553+0000","last_fullsized":"2024-09-12T12:25:04.125553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:06.556373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840444+0000","last_change":"2024-09-12T12:22:51.851246+0000","last_active":"2024-09-12T12:24:35.840444+0000","last_peered":"2024-09-12T12:24:35.840444+0000","last_clean":"2024-09-12T12:24:35.840444+0000","last_became_active":"2024-09-12T12:22:51.850963+0000","last_became_peered":"2024-09-12T12:22:51.850963+0000","last_unstale":"2024-09-12T12:24:35.840444+0000","last_undegraded":"2024-09-12T12:24:35.840444+0000","last_fullsized":"2024-09-12T12:24:35.840444+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:12.032126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843036+0000","last_change":"2024-09-12T12:23:03.382950+0000","last_active":"2024-09-12T12:24:35.843036+0000","last_peered":"2024-09-12T12:24:35.843036+0000","last_clean":"2024-09-12T12:24:35.843036+0000","last_became_active":"2024-09-12T12:23:03.382503+0000","last_became_peered":"2024-09-12T12:23:03.382503+0000","last_unstale":"2024-09-12T12:24:35.843036+0000","last_undegraded":"2024-09-12T12:24:35.843036+0000","last_fullsized":"2024-09-12T12:24:35.843036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:03.991304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123029+0000","last_change":"2024-09-12T12:22:54.315788+0000","last_active":"2024-09-12T12:25:04.123029+0000","last_peered":"2024-09-12T12:25:04.123029+0000","last_clean":"2024-09-12T12:25:04.123029+0000","last_became_active":"2024-09-12T12:22:54.315343+0000","last_became_peered":"2024-09-12T12:22:54.315343+0000","last_unstale":"2024-09-12T12:25:04.123029+0000","last_undegraded":"2024-09-12T12:25:04.123029+0000","last_fullsized":"2024-09-12T12:25:04.123029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:22.549415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845915+0000","last_change":"2024-09-12T12:22:51.854532+0000","last_active":"2024-09-12T12:24:35.845915+0000","last_peered":"2024-09-12T12:24:35.845915+0000","last_clean":"2024-09-12T12:24:35.845915+0000","last_became_active":"2024-09-12T12:22:51.854206+0000","last_became_peered":"2024-09-12T12:22:51.854206+0000","last_unstale":"2024-09-12T12:24:35.845915+0000","last_undegraded":"2024-09-12T12:24:35.845915+0000","last_fullsized":"2024-09-12T12:24:35.845915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:46.908917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840512+0000","last_change":"2024-09-12T12:23:03.383647+0000","last_active":"2024-09-12T12:24:35.840512+0000","last_peered":"2024-09-12T12:24:35.840512+0000","last_clean":"2024-09-12T12:24:35.840512+0000","last_became_active":"2024-09-12T12:23:03.383094+0000","last_became_peered":"2024-09-12T12:23:03.383094+0000","last_unstale":"2024-09-12T12:24:35.840512+0000","last_undegraded":"2024-09-12T12:24:35.840512+0000","last_fullsized":"2024-09-12T12:24:35.840512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:03.754250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.091694+0000","last_change":"2024-09-12T12:22:54.310717+0000","last_active":"2024-09-12T12:25:04.091694+0000","last_peered":"2024-09-12T12:25:04.091694+0000","last_clean":"2024-09-12T12:25:04.091694+0000","last_became_active":"2024-09-12T12:22:54.309485+0000","last_became_peered":"2024-09-12T12:22:54.309485+0000","last_unstale":"2024-09-12T12:25:04.091694+0000","last_undegraded":"2024-09-12T12:25:04.091694+0000","last_fullsized":"2024-09-12T12:25:04.091694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:10.293726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'39","reported_seq":323,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.973111+0000","last_change":"2024-09-12T12:22:51.856735+0000","last_active":"2024-09-12T12:25:45.973111+0000","last_peered":"2024-09-12T12:25:45.973111+0000","last_clean":"2024-09-12T12:25:45.973111+0000","last_became_active":"2024-09-12T12:22:51.856340+0000","last_became_peered":"2024-09-12T12:22:51.856340+0000","last_unstale":"2024-09-12T12:25:45.973111+0000","last_undegraded":"2024-09-12T12:25:45.973111+0000","last_fullsized":"2024-09-12T12:25:45.973111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:40.727645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64071,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":244,"num_read_kb":184,"num_write":41,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840936+0000","last_change":"2024-09-12T12:23:03.379726+0000","last_active":"2024-09-12T12:24:35.840936+0000","last_peered":"2024-09-12T12:24:35.840936+0000","last_clean":"2024-09-12T12:24:35.840936+0000","last_became_active":"2024-09-12T12:23:03.378168+0000","last_became_peered":"2024-09-12T12:23:03.378168+0000","last_unstale":"2024-09-12T12:24:35.840936+0000","last_undegraded":"2024-09-12T12:24:35.840936+0000","last_fullsized":"2024-09-12T12:24:35.840936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125522+0000","last_change":"2024-09-12T12:23:35.083119+0000","last_active":"2024-09-12T12:25:04.125522+0000","last_peered":"2024-09-12T12:25:04.125522+0000","last_clean":"2024-09-12T12:25:04.125522+0000","last_became_active":"2024-09-12T12:23:35.082800+0000","last_became_peered":"2024-09-12T12:23:35.082800+0000","last_unstale":"2024-09-12T12:25:04.125522+0000","last_undegraded":"2024-09-12T12:25:04.125522+0000","last_fullsized":"2024-09-12T12:25:04.125522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.717540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840793+0000","last_change":"2024-09-12T12:22:51.989886+0000","last_active":"2024-09-12T12:24:35.840793+0000","last_peered":"2024-09-12T12:24:35.840793+0000","last_clean":"2024-09-12T12:24:35.840793+0000","last_became_active":"2024-09-12T12:22:51.989524+0000","last_became_peered":"2024-09-12T12:22:51.989524+0000","last_unstale":"2024-09-12T12:24:35.840793+0000","last_undegraded":"2024-09-12T12:24:35.840793+0000","last_fullsized":"2024-09-12T12:24:35.840793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:26.409342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268030+0000","last_change":"2024-09-12T12:23:03.384583+0000","last_active":"2024-09-12T12:24:36.268030+0000","last_peered":"2024-09-12T12:24:36.268030+0000","last_clean":"2024-09-12T12:24:36.268030+0000","last_became_active":"2024-09-12T12:23:03.383639+0000","last_became_peered":"2024-09-12T12:23:03.383639+0000","last_unstale":"2024-09-12T12:24:36.268030+0000","last_undegraded":"2024-09-12T12:24:36.268030+0000","last_fullsized":"2024-09-12T12:24:36.268030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:09.755052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116744+0000","last_change":"2024-09-12T12:22:54.309874+0000","last_active":"2024-09-12T12:25:04.116744+0000","last_peered":"2024-09-12T12:25:04.116744+0000","last_clean":"2024-09-12T12:25:04.116744+0000","last_became_active":"2024-09-12T12:22:54.309294+0000","last_became_peered":"2024-09-12T12:22:54.309294+0000","last_unstale":"2024-09-12T12:25:04.116744+0000","last_undegraded":"2024-09-12T12:25:04.116744+0000","last_fullsized":"2024-09-12T12:25:04.116744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:50.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847221+0000","last_change":"2024-09-12T12:22:51.849467+0000","last_active":"2024-09-12T12:24:35.847221+0000","last_peered":"2024-09-12T12:24:35.847221+0000","last_clean":"2024-09-12T12:24:35.847221+0000","last_became_active":"2024-09-12T12:22:51.849076+0000","last_became_peered":"2024-09-12T12:22:51.849076+0000","last_unstale":"2024-09-12T12:24:35.847221+0000","last_undegraded":"2024-09-12T12:24:35.847221+0000","last_fullsized":"2024-09-12T12:24:35.847221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:04.821105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843557+0000","last_change":"2024-09-12T12:23:35.083542+0000","last_active":"2024-09-12T12:24:35.843557+0000","last_peered":"2024-09-12T12:24:35.843557+0000","last_clean":"2024-09-12T12:24:35.843557+0000","last_became_active":"2024-09-12T12:23:35.083095+0000","last_became_peered":"2024-09-12T12:23:35.083095+0000","last_unstale":"2024-09-12T12:24:35.843557+0000","last_undegraded":"2024-09-12T12:24:35.843557+0000","last_fullsized":"2024-09-12T12:24:35.843557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:06.750223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.121933+0000","last_change":"2024-09-12T12:22:54.315215+0000","last_active":"2024-09-12T12:25:04.121933+0000","last_peered":"2024-09-12T12:25:04.121933+0000","last_clean":"2024-09-12T12:25:04.121933+0000","last_became_active":"2024-09-12T12:22:54.314879+0000","last_became_peered":"2024-09-12T12:22:54.314879+0000","last_unstale":"2024-09-12T12:25:04.121933+0000","last_undegraded":"2024-09-12T12:25:04.121933+0000","last_fullsized":"2024-09-12T12:25:04.121933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:35.501376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'6","reported_seq":282,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.360940+0000","last_change":"2024-09-12T12:22:51.851461+0000","last_active":"2024-09-12T12:25:45.360940+0000","last_peered":"2024-09-12T12:25:45.360940+0000","last_clean":"2024-09-12T12:25:45.360940+0000","last_became_active":"2024-09-12T12:22:51.851105+0000","last_became_peered":"2024-09-12T12:22:51.851105+0000","last_unstale":"2024-09-12T12:25:45.360940+0000","last_undegraded":"2024-09-12T12:25:45.360940+0000","last_fullsized":"2024-09-12T12:25:45.360940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:42.604983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":236,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845020+0000","last_change":"2024-09-12T12:23:03.383308+0000","last_active":"2024-09-12T12:24:35.845020+0000","last_peered":"2024-09-12T12:24:35.845020+0000","last_clean":"2024-09-12T12:24:35.845020+0000","last_became_active":"2024-09-12T12:23:03.382294+0000","last_became_peered":"2024-09-12T12:23:03.382294+0000","last_unstale":"2024-09-12T12:24:35.845020+0000","last_undegraded":"2024-09-12T12:24:35.845020+0000","last_fullsized":"2024-09-12T12:24:35.845020+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:43.920306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846769+0000","last_change":"2024-09-12T12:23:03.386850+0000","last_active":"2024-09-12T12:24:35.846769+0000","last_peered":"2024-09-12T12:24:35.846769+0000","last_clean":"2024-09-12T12:24:35.846769+0000","last_became_active":"2024-09-12T12:23:03.386350+0000","last_became_peered":"2024-09-12T12:23:03.386350+0000","last_unstale":"2024-09-12T12:24:35.846769+0000","last_undegraded":"2024-09-12T12:24:35.846769+0000","last_fullsized":"2024-09-12T12:24:35.846769+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.295745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116408+0000","last_change":"2024-09-12T12:22:54.320709+0000","last_active":"2024-09-12T12:25:04.116408+0000","last_peered":"2024-09-12T12:25:04.116408+0000","last_clean":"2024-09-12T12:25:04.116408+0000","last_became_active":"2024-09-12T12:22:54.320208+0000","last_became_peered":"2024-09-12T12:22:54.320208+0000","last_unstale":"2024-09-12T12:25:04.116408+0000","last_undegraded":"2024-09-12T12:25:04.116408+0000","last_fullsized":"2024-09-12T12:25:04.116408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:45.452449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840308+0000","last_change":"2024-09-12T12:22:51.853047+0000","last_active":"2024-09-12T12:24:35.840308+0000","last_peered":"2024-09-12T12:24:35.840308+0000","last_clean":"2024-09-12T12:24:35.840308+0000","last_became_active":"2024-09-12T12:22:51.852653+0000","last_became_peered":"2024-09-12T12:22:51.852653+0000","last_unstale":"2024-09-12T12:24:35.840308+0000","last_undegraded":"2024-09-12T12:24:35.840308+0000","last_fullsized":"2024-09-12T12:24:35.840308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:39.035009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843207+0000","last_change":"2024-09-12T12:23:03.382997+0000","last_active":"2024-09-12T12:24:35.843207+0000","last_peered":"2024-09-12T12:24:35.843207+0000","last_clean":"2024-09-12T12:24:35.843207+0000","last_became_active":"2024-09-12T12:23:03.382594+0000","last_became_peered":"2024-09-12T12:23:03.382594+0000","last_unstale":"2024-09-12T12:24:35.843207+0000","last_undegraded":"2024-09-12T12:24:35.843207+0000","last_fullsized":"2024-09-12T12:24:35.843207+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:25.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.122806+0000","last_change":"2024-09-12T12:22:54.322595+0000","last_active":"2024-09-12T12:25:04.122806+0000","last_peered":"2024-09-12T12:25:04.122806+0000","last_clean":"2024-09-12T12:25:04.122806+0000","last_became_active":"2024-09-12T12:22:54.320182+0000","last_became_peered":"2024-09-12T12:22:54.320182+0000","last_unstale":"2024-09-12T12:25:04.122806+0000","last_undegraded":"2024-09-12T12:25:04.122806+0000","last_fullsized":"2024-09-12T12:25:04.122806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265174+0000","last_change":"2024-09-12T12:22:51.850045+0000","last_active":"2024-09-12T12:24:36.265174+0000","last_peered":"2024-09-12T12:24:36.265174+0000","last_clean":"2024-09-12T12:24:36.265174+0000","last_became_active":"2024-09-12T12:22:51.849643+0000","last_became_peered":"2024-09-12T12:22:51.849643+0000","last_unstale":"2024-09-12T12:24:36.265174+0000","last_undegraded":"2024-09-12T12:24:36.265174+0000","last_fullsized":"2024-09-12T12:24:36.265174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:18.255368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840542+0000","last_change":"2024-09-12T12:22:51.852692+0000","last_active":"2024-09-12T12:24:35.840542+0000","last_peered":"2024-09-12T12:24:35.840542+0000","last_clean":"2024-09-12T12:24:35.840542+0000","last_became_active":"2024-09-12T12:22:51.852265+0000","last_became_peered":"2024-09-12T12:22:51.852265+0000","last_unstale":"2024-09-12T12:24:35.840542+0000","last_undegraded":"2024-09-12T12:24:35.840542+0000","last_fullsized":"2024-09-12T12:24:35.840542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:55.853073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111746+0000","last_change":"2024-09-12T12:22:54.315519+0000","last_active":"2024-09-12T12:25:04.111746+0000","last_peered":"2024-09-12T12:25:04.111746+0000","last_clean":"2024-09-12T12:25:04.111746+0000","last_became_active":"2024-09-12T12:22:54.315158+0000","last_became_peered":"2024-09-12T12:22:54.315158+0000","last_unstale":"2024-09-12T12:25:04.111746+0000","last_undegraded":"2024-09-12T12:25:04.111746+0000","last_fullsized":"2024-09-12T12:25:04.111746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845873+0000","last_change":"2024-09-12T12:23:03.383443+0000","last_active":"2024-09-12T12:24:35.845873+0000","last_peered":"2024-09-12T12:24:35.845873+0000","last_clean":"2024-09-12T12:24:35.845873+0000","last_became_active":"2024-09-12T12:23:03.382865+0000","last_became_peered":"2024-09-12T12:23:03.382865+0000","last_unstale":"2024-09-12T12:24:35.845873+0000","last_undegraded":"2024-09-12T12:24:35.845873+0000","last_fullsized":"2024-09-12T12:24:35.845873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:26.339910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:46.363863+0000","last_change":"2024-09-12T12:22:51.849963+0000","last_active":"2024-09-12T12:25:46.363863+0000","last_peered":"2024-09-12T12:25:46.363863+0000","last_clean":"2024-09-12T12:25:46.363863+0000","last_became_active":"2024-09-12T12:22:51.849596+0000","last_became_peered":"2024-09-12T12:22:51.849596+0000","last_unstale":"2024-09-12T12:25:46.363863+0000","last_undegraded":"2024-09-12T12:25:46.363863+0000","last_fullsized":"2024-09-12T12:25:46.363863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:48.695657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104951+0000","last_change":"2024-09-12T12:22:54.312543+0000","last_active":"2024-09-12T12:25:04.104951+0000","last_peered":"2024-09-12T12:25:04.104951+0000","last_clean":"2024-09-12T12:25:04.104951+0000","last_became_active":"2024-09-12T12:22:54.312154+0000","last_became_peered":"2024-09-12T12:22:54.312154+0000","last_unstale":"2024-09-12T12:25:04.104951+0000","last_undegraded":"2024-09-12T12:25:04.104951+0000","last_fullsized":"2024-09-12T12:25:04.104951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:28.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846443+0000","last_change":"2024-09-12T12:23:03.376938+0000","last_active":"2024-09-12T12:24:35.846443+0000","last_peered":"2024-09-12T12:24:35.846443+0000","last_clean":"2024-09-12T12:24:35.846443+0000","last_became_active":"2024-09-12T12:23:03.376450+0000","last_became_peered":"2024-09-12T12:23:03.376450+0000","last_unstale":"2024-09-12T12:24:35.846443+0000","last_undegraded":"2024-09-12T12:24:35.846443+0000","last_fullsized":"2024-09-12T12:24:35.846443+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:35.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106500+0000","last_change":"2024-09-12T12:22:54.305562+0000","last_active":"2024-09-12T12:25:04.106500+0000","last_peered":"2024-09-12T12:25:04.106500+0000","last_clean":"2024-09-12T12:25:04.106500+0000","last_became_active":"2024-09-12T12:22:54.305208+0000","last_became_peered":"2024-09-12T12:22:54.305208+0000","last_unstale":"2024-09-12T12:25:04.106500+0000","last_undegraded":"2024-09-12T12:25:04.106500+0000","last_fullsized":"2024-09-12T12:25:04.106500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:46.643949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106018+0000","last_change":"2024-09-12T12:22:54.310634+0000","last_active":"2024-09-12T12:25:04.106018+0000","last_peered":"2024-09-12T12:25:04.106018+0000","last_clean":"2024-09-12T12:25:04.106018+0000","last_became_active":"2024-09-12T12:22:54.310194+0000","last_became_peered":"2024-09-12T12:22:54.310194+0000","last_unstale":"2024-09-12T12:25:04.106018+0000","last_undegraded":"2024-09-12T12:25:04.106018+0000","last_fullsized":"2024-09-12T12:25:04.106018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:05.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.112065+0000","last_change":"2024-09-12T12:22:54.315119+0000","last_active":"2024-09-12T12:25:04.112065+0000","last_peered":"2024-09-12T12:25:04.112065+0000","last_clean":"2024-09-12T12:25:04.112065+0000","last_became_active":"2024-09-12T12:22:54.314729+0000","last_became_peered":"2024-09-12T12:22:54.314729+0000","last_unstale":"2024-09-12T12:25:04.112065+0000","last_undegraded":"2024-09-12T12:25:04.112065+0000","last_fullsized":"2024-09-12T12:25:04.112065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:07.888005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123993+0000","last_change":"2024-09-12T12:23:35.083672+0000","last_active":"2024-09-12T12:25:04.123993+0000","last_peered":"2024-09-12T12:25:04.123993+0000","last_clean":"2024-09-12T12:25:04.123993+0000","last_became_active":"2024-09-12T12:23:35.083222+0000","last_became_peered":"2024-09-12T12:23:35.083222+0000","last_unstale":"2024-09-12T12:25:04.123993+0000","last_undegraded":"2024-09-12T12:25:04.123993+0000","last_fullsized":"2024-09-12T12:25:04.123993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124802+0000","last_change":"2024-09-12T12:22:54.321649+0000","last_active":"2024-09-12T12:25:04.124802+0000","last_peered":"2024-09-12T12:25:04.124802+0000","last_clean":"2024-09-12T12:25:04.124802+0000","last_became_active":"2024-09-12T12:22:54.320859+0000","last_became_peered":"2024-09-12T12:22:54.320859+0000","last_unstale":"2024-09-12T12:25:04.124802+0000","last_undegraded":"2024-09-12T12:25:04.124802+0000","last_fullsized":"2024-09-12T12:25:04.124802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:49.706632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104517+0000","last_change":"2024-09-12T12:22:54.306900+0000","last_active":"2024-09-12T12:25:04.104517+0000","last_peered":"2024-09-12T12:25:04.104517+0000","last_clean":"2024-09-12T12:25:04.104517+0000","last_became_active":"2024-09-12T12:22:54.306432+0000","last_became_peered":"2024-09-12T12:22:54.306432+0000","last_unstale":"2024-09-12T12:25:04.104517+0000","last_undegraded":"2024-09-12T12:25:04.104517+0000","last_fullsized":"2024-09-12T12:25:04.104517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:07.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.110181+0000","last_change":"2024-09-12T12:22:54.318123+0000","last_active":"2024-09-12T12:25:04.110181+0000","last_peered":"2024-09-12T12:25:04.110181+0000","last_clean":"2024-09-12T12:25:04.110181+0000","last_became_active":"2024-09-12T12:22:54.317820+0000","last_became_peered":"2024-09-12T12:22:54.317820+0000","last_unstale":"2024-09-12T12:25:04.110181+0000","last_undegraded":"2024-09-12T12:25:04.110181+0000","last_fullsized":"2024-09-12T12:25:04.110181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:19.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107607+0000","last_change":"2024-09-12T12:22:54.318029+0000","last_active":"2024-09-12T12:25:04.107607+0000","last_peered":"2024-09-12T12:25:04.107607+0000","last_clean":"2024-09-12T12:25:04.107607+0000","last_became_active":"2024-09-12T12:22:54.316015+0000","last_became_peered":"2024-09-12T12:22:54.316015+0000","last_unstale":"2024-09-12T12:25:04.107607+0000","last_undegraded":"2024-09-12T12:25:04.107607+0000","last_fullsized":"2024-09-12T12:25:04.107607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118186+0000","last_change":"2024-09-12T12:22:54.325688+0000","last_active":"2024-09-12T12:25:04.118186+0000","last_peered":"2024-09-12T12:25:04.118186+0000","last_clean":"2024-09-12T12:25:04.118186+0000","last_became_active":"2024-09-12T12:22:54.325375+0000","last_became_peered":"2024-09-12T12:22:54.325375+0000","last_unstale":"2024-09-12T12:25:04.118186+0000","last_undegraded":"2024-09-12T12:25:04.118186+0000","last_fullsized":"2024-09-12T12:25:04.118186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:43.971575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109830+0000","last_change":"2024-09-12T12:22:54.315713+0000","last_active":"2024-09-12T12:25:04.109830+0000","last_peered":"2024-09-12T12:25:04.109830+0000","last_clean":"2024-09-12T12:25:04.109830+0000","last_became_active":"2024-09-12T12:22:54.315401+0000","last_became_peered":"2024-09-12T12:22:54.315401+0000","last_unstale":"2024-09-12T12:25:04.109830+0000","last_undegraded":"2024-09-12T12:25:04.109830+0000","last_fullsized":"2024-09-12T12:25:04.109830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:35:31.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118235+0000","last_change":"2024-09-12T12:22:54.314543+0000","last_active":"2024-09-12T12:25:04.118235+0000","last_peered":"2024-09-12T12:25:04.118235+0000","last_clean":"2024-09-12T12:25:04.118235+0000","last_became_active":"2024-09-12T12:22:54.314216+0000","last_became_peered":"2024-09-12T12:22:54.314216+0000","last_unstale":"2024-09-12T12:25:04.118235+0000","last_undegraded":"2024-09-12T12:25:04.118235+0000","last_fullsized":"2024-09-12T12:25:04.118235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:12.180355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124305+0000","last_change":"2024-09-12T12:22:54.313637+0000","last_active":"2024-09-12T12:25:04.124305+0000","last_peered":"2024-09-12T12:25:04.124305+0000","last_clean":"2024-09-12T12:25:04.124305+0000","last_became_active":"2024-09-12T12:22:54.313327+0000","last_became_peered":"2024-09-12T12:22:54.313327+0000","last_unstale":"2024-09-12T12:25:04.124305+0000","last_undegraded":"2024-09-12T12:25:04.124305+0000","last_fullsized":"2024-09-12T12:25:04.124305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:24.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109135+0000","last_change":"2024-09-12T12:22:54.306018+0000","last_active":"2024-09-12T12:25:04.109135+0000","last_peered":"2024-09-12T12:25:04.109135+0000","last_clean":"2024-09-12T12:25:04.109135+0000","last_became_active":"2024-09-12T12:22:54.305683+0000","last_became_peered":"2024-09-12T12:22:54.305683+0000","last_unstale":"2024-09-12T12:25:04.109135+0000","last_undegraded":"2024-09-12T12:25:04.109135+0000","last_fullsized":"2024-09-12T12:25:04.109135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:00.464765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123634+0000","last_change":"2024-09-12T12:22:54.319169+0000","last_active":"2024-09-12T12:25:04.123634+0000","last_peered":"2024-09-12T12:25:04.123634+0000","last_clean":"2024-09-12T12:25:04.123634+0000","last_became_active":"2024-09-12T12:22:54.318831+0000","last_became_peered":"2024-09-12T12:22:54.318831+0000","last_unstale":"2024-09-12T12:25:04.123634+0000","last_undegraded":"2024-09-12T12:25:04.123634+0000","last_fullsized":"2024-09-12T12:25:04.123634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:42.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.120814+0000","last_change":"2024-09-12T12:22:54.305760+0000","last_active":"2024-09-12T12:25:04.120814+0000","last_peered":"2024-09-12T12:25:04.120814+0000","last_clean":"2024-09-12T12:25:04.120814+0000","last_became_active":"2024-09-12T12:22:54.305455+0000","last_became_peered":"2024-09-12T12:22:54.305455+0000","last_unstale":"2024-09-12T12:25:04.120814+0000","last_undegraded":"2024-09-12T12:25:04.120814+0000","last_fullsized":"2024-09-12T12:25:04.120814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:54.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114429+0000","last_change":"2024-09-12T12:22:54.311420+0000","last_active":"2024-09-12T12:25:04.114429+0000","last_peered":"2024-09-12T12:25:04.114429+0000","last_clean":"2024-09-12T12:25:04.114429+0000","last_became_active":"2024-09-12T12:22:54.311072+0000","last_became_peered":"2024-09-12T12:22:54.311072+0000","last_unstale":"2024-09-12T12:25:04.114429+0000","last_undegraded":"2024-09-12T12:25:04.114429+0000","last_fullsized":"2024-09-12T12:25:04.114429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:54.476587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118981+0000","last_change":"2024-09-12T12:22:54.313093+0000","last_active":"2024-09-12T12:25:04.118981+0000","last_peered":"2024-09-12T12:25:04.118981+0000","last_clean":"2024-09-12T12:25:04.118981+0000","last_became_active":"2024-09-12T12:22:54.312220+0000","last_became_peered":"2024-09-12T12:22:54.312220+0000","last_unstale":"2024-09-12T12:25:04.118981+0000","last_undegraded":"2024-09-12T12:25:04.118981+0000","last_fullsized":"2024-09-12T12:25:04.118981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:33.241798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109467+0000","last_change":"2024-09-12T12:22:54.310536+0000","last_active":"2024-09-12T12:25:04.109467+0000","last_peered":"2024-09-12T12:25:04.109467+0000","last_clean":"2024-09-12T12:25:04.109467+0000","last_became_active":"2024-09-12T12:22:54.310203+0000","last_became_peered":"2024-09-12T12:22:54.310203+0000","last_unstale":"2024-09-12T12:25:04.109467+0000","last_undegraded":"2024-09-12T12:25:04.109467+0000","last_fullsized":"2024-09-12T12:25:04.109467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:40.957367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116751+0000","last_change":"2024-09-12T12:22:54.312898+0000","last_active":"2024-09-12T12:25:04.116751+0000","last_peered":"2024-09-12T12:25:04.116751+0000","last_clean":"2024-09-12T12:25:04.116751+0000","last_became_active":"2024-09-12T12:22:54.312449+0000","last_became_peered":"2024-09-12T12:22:54.312449+0000","last_unstale":"2024-09-12T12:25:04.116751+0000","last_undegraded":"2024-09-12T12:25:04.116751+0000","last_fullsized":"2024-09-12T12:25:04.116751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:57.384949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124720+0000","last_change":"2024-09-12T12:22:54.312206+0000","last_active":"2024-09-12T12:25:04.124720+0000","last_peered":"2024-09-12T12:25:04.124720+0000","last_clean":"2024-09-12T12:25:04.124720+0000","last_became_active":"2024-09-12T12:22:54.311187+0000","last_became_peered":"2024-09-12T12:22:54.311187+0000","last_unstale":"2024-09-12T12:25:04.124720+0000","last_undegraded":"2024-09-12T12:25:04.124720+0000","last_fullsized":"2024-09-12T12:25:04.124720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:22.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.097156+0000","last_change":"2024-09-12T12:22:54.312083+0000","last_active":"2024-09-12T12:25:04.097156+0000","last_peered":"2024-09-12T12:25:04.097156+0000","last_clean":"2024-09-12T12:25:04.097156+0000","last_became_active":"2024-09-12T12:22:54.310716+0000","last_became_peered":"2024-09-12T12:22:54.310716+0000","last_unstale":"2024-09-12T12:25:04.097156+0000","last_undegraded":"2024-09-12T12:25:04.097156+0000","last_fullsized":"2024-09-12T12:25:04.097156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:22.717416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.117943+0000","last_change":"2024-09-12T12:22:54.315088+0000","last_active":"2024-09-12T12:25:04.117943+0000","last_peered":"2024-09-12T12:25:04.117943+0000","last_clean":"2024-09-12T12:25:04.117943+0000","last_became_active":"2024-09-12T12:22:54.314601+0000","last_became_peered":"2024-09-12T12:22:54.314601+0000","last_unstale":"2024-09-12T12:25:04.117943+0000","last_undegraded":"2024-09-12T12:25:04.117943+0000","last_fullsized":"2024-09-12T12:25:04.117943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:35.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.103569+0000","last_change":"2024-09-12T12:22:54.305332+0000","last_active":"2024-09-12T12:25:04.103569+0000","last_peered":"2024-09-12T12:25:04.103569+0000","last_clean":"2024-09-12T12:25:04.103569+0000","last_became_active":"2024-09-12T12:22:54.305017+0000","last_became_peered":"2024-09-12T12:22:54.305017+0000","last_unstale":"2024-09-12T12:25:04.103569+0000","last_undegraded":"2024-09-12T12:25:04.103569+0000","last_fullsized":"2024-09-12T12:25:04.103569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:16.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114402+0000","last_change":"2024-09-12T12:22:54.319768+0000","last_active":"2024-09-12T12:25:04.114402+0000","last_peered":"2024-09-12T12:25:04.114402+0000","last_clean":"2024-09-12T12:25:04.114402+0000","last_became_active":"2024-09-12T12:22:54.319451+0000","last_became_peered":"2024-09-12T12:22:54.319451+0000","last_unstale":"2024-09-12T12:25:04.114402+0000","last_undegraded":"2024-09-12T12:25:04.114402+0000","last_fullsized":"2024-09-12T12:25:04.114402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:56.368891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.108893+0000","last_change":"2024-09-12T12:22:54.323162+0000","last_active":"2024-09-12T12:25:04.108893+0000","last_peered":"2024-09-12T12:25:04.108893+0000","last_clean":"2024-09-12T12:25:04.108893+0000","last_became_active":"2024-09-12T12:22:54.322068+0000","last_became_peered":"2024-09-12T12:22:54.322068+0000","last_unstale":"2024-09-12T12:25:04.108893+0000","last_undegraded":"2024-09-12T12:25:04.108893+0000","last_fullsized":"2024-09-12T12:25:04.108893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:54.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118082+0000","last_change":"2024-09-12T12:22:54.306125+0000","last_active":"2024-09-12T12:25:04.118082+0000","last_peered":"2024-09-12T12:25:04.118082+0000","last_clean":"2024-09-12T12:25:04.118082+0000","last_became_active":"2024-09-12T12:22:54.305790+0000","last_became_peered":"2024-09-12T12:22:54.305790+0000","last_unstale":"2024-09-12T12:25:04.118082+0000","last_undegraded":"2024-09-12T12:25:04.118082+0000","last_fullsized":"2024-09-12T12:25:04.118082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:36.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106172+0000","last_change":"2024-09-12T12:22:54.305099+0000","last_active":"2024-09-12T12:25:04.106172+0000","last_peered":"2024-09-12T12:25:04.106172+0000","last_clean":"2024-09-12T12:25:04.106172+0000","last_became_active":"2024-09-12T12:22:54.304649+0000","last_became_peered":"2024-09-12T12:22:54.304649+0000","last_unstale":"2024-09-12T12:25:04.106172+0000","last_undegraded":"2024-09-12T12:25:04.106172+0000","last_fullsized":"2024-09-12T12:25:04.106172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:05.771434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119410+0000","last_change":"2024-09-12T12:22:54.319247+0000","last_active":"2024-09-12T12:25:04.119410+0000","last_peered":"2024-09-12T12:25:04.119410+0000","last_clean":"2024-09-12T12:25:04.119410+0000","last_became_active":"2024-09-12T12:22:54.318894+0000","last_became_peered":"2024-09-12T12:22:54.318894+0000","last_unstale":"2024-09-12T12:25:04.119410+0000","last_undegraded":"2024-09-12T12:25:04.119410+0000","last_fullsized":"2024-09-12T12:25:04.119410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:55.692071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104860+0000","last_change":"2024-09-12T12:23:35.076997+0000","last_active":"2024-09-12T12:25:04.104860+0000","last_peered":"2024-09-12T12:25:04.104860+0000","last_clean":"2024-09-12T12:25:04.104860+0000","last_became_active":"2024-09-12T12:23:35.076506+0000","last_became_peered":"2024-09-12T12:23:35.076506+0000","last_unstale":"2024-09-12T12:25:04.104860+0000","last_undegraded":"2024-09-12T12:25:04.104860+0000","last_fullsized":"2024-09-12T12:25:04.104860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111898+0000","last_change":"2024-09-12T12:22:54.314298+0000","last_active":"2024-09-12T12:25:04.111898+0000","last_peered":"2024-09-12T12:25:04.111898+0000","last_clean":"2024-09-12T12:25:04.111898+0000","last_became_active":"2024-09-12T12:22:54.311726+0000","last_became_peered":"2024-09-12T12:22:54.311726+0000","last_unstale":"2024-09-12T12:25:04.111898+0000","last_undegraded":"2024-09-12T12:25:04.111898+0000","last_fullsized":"2024-09-12T12:25:04.111898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:13.298082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109460+0000","last_change":"2024-09-12T12:22:54.304397+0000","last_active":"2024-09-12T12:25:04.109460+0000","last_peered":"2024-09-12T12:25:04.109460+0000","last_clean":"2024-09-12T12:25:04.109460+0000","last_became_active":"2024-09-12T12:22:54.304048+0000","last_became_peered":"2024-09-12T12:22:54.304048+0000","last_unstale":"2024-09-12T12:25:04.109460+0000","last_undegraded":"2024-09-12T12:25:04.109460+0000","last_fullsized":"2024-09-12T12:25:04.109460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:13.518433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114189+0000","last_change":"2024-09-12T12:22:54.312229+0000","last_active":"2024-09-12T12:25:04.114189+0000","last_peered":"2024-09-12T12:25:04.114189+0000","last_clean":"2024-09-12T12:25:04.114189+0000","last_became_active":"2024-09-12T12:22:54.311806+0000","last_became_peered":"2024-09-12T12:22:54.311806+0000","last_unstale":"2024-09-12T12:25:04.114189+0000","last_undegraded":"2024-09-12T12:25:04.114189+0000","last_fullsized":"2024-09-12T12:25:04.114189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:28.865595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71338,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1228,"num_read_kb":690,"num_write":259,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":214014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514545,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":533258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743477,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716392,"statfs":{"total":95995035648,"available":95965585408,"internally_reserved":0,"allocated":1777664,"data_stored":1187284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877907003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":532542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135938,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":532808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397574,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37000,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708152,"statfs":{"total":95995035648,"available":95957147648,"internally_reserved":0,"allocated":1695744,"data_stored":1129337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561100,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":528046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822736,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37008,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708144,"statfs":{"total":95995035648,"available":95957139456,"internally_reserved":0,"allocated":1703936,"data_stored":1124919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953559,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":532120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182491,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":527754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36484,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708668,"statfs":{"total":95995035648,"available":95957676032,"internally_reserved":0,"allocated":1167360,"data_stored":594212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1146880,"data_stored":593147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":530036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:25:51.678 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:25:51.679 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:51 smithi154 ceph-mon[35578]: pgmap v391: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T12:25:51.679 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:51 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2276185855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 -- 172.21.15.38:0/4062062810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc1076e0 msgr2=0x7fabcc109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 --2- 172.21.15.38:0/4062062810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc1076e0 0x7fabcc109ad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009ca0 tx=0x7fabc402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 -- 172.21.15.38:0/4062062810 shutdown_connections 2024-09-12T12:25:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 --2- 172.21.15.38:0/4062062810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc1076e0 0x7fabcc109ad0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 --2- 172.21.15.38:0/4062062810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc104db0 0x7fabcc1071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 --2- 172.21.15.38:0/4062062810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabcc102480 0x7fabcc104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 -- 172.21.15.38:0/4062062810 >> 172.21.15.38:0/4062062810 conn(0x7fabcc0fc000 msgr2=0x7fabcc0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 -- 172.21.15.38:0/4062062810 shutdown_connections 2024-09-12T12:25:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.839+0000 7fabd1400640 1 -- 172.21.15.38:0/4062062810 wait complete. 2024-09-12T12:25:51.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 Processor -- start 2024-09-12T12:25:51.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 -- start start 2024-09-12T12:25:51.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc102480 0x7fabcc197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabcc104db0 0x7fabcc1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc1076e0 0x7fabcc19f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc10d620 con 0x7fabcc102480 2024-09-12T12:25:51.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc10d4a0 con 0x7fabcc104db0 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd1400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc10d7a0 con 0x7fabcc1076e0 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabcbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc102480 0x7fabcc197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabcbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc102480 0x7fabcc197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41116/0 (socket says 172.21.15.38:41116) 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabcbe00640 1 -- 172.21.15.38:0/2227530645 learned_addr learned my addr 172.21.15.38:0/2227530645 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.840+0000 7fabd0a00640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc1076e0 0x7fabcc19f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabc3400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabcc104db0 0x7fabcc1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabcbe00640 1 -- 172.21.15.38:0/2227530645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc1076e0 msgr2=0x7fabcc19f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabcbe00640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc1076e0 0x7fabcc19f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabcbe00640 1 -- 172.21.15.38:0/2227530645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabcc104db0 msgr2=0x7fabcc1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabcbe00640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabcc104db0 0x7fabcc1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabcbe00640 1 -- 172.21.15.38:0/2227530645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc19f8e0 con 0x7fabcc102480 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabcbe00640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc102480 0x7fabcc197ca0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00e9f0 tx=0x7fabbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabc9600640 1 -- 172.21.15.38:0/2227530645 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00cd80 con 0x7fabcc102480 2024-09-12T12:25:51.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabcc19fbd0 con 0x7fabcc102480 2024-09-12T12:25:51.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.841+0000 7fabc9600640 1 -- 172.21.15.38:0/2227530645 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabbc010910 con 0x7fabcc102480 2024-09-12T12:25:51.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.842+0000 7fabc9600640 1 -- 172.21.15.38:0/2227530645 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc018910 con 0x7fabcc102480 2024-09-12T12:25:51.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.842+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabcc1a0170 con 0x7fabcc102480 2024-09-12T12:25:51.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.843+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabcc0fdaf0 con 0x7fabcc102480 2024-09-12T12:25:51.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.844+0000 7fabc9600640 1 -- 172.21.15.38:0/2227530645 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fabbc010ac0 con 0x7fabcc102480 2024-09-12T12:25:51.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.846+0000 7fabc9600640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fabb00a2b90 0x7fabb00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.846+0000 7fabc9600640 1 -- 172.21.15.38:0/2227530645 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fabbc0cf7d0 con 0x7fabcc102480 2024-09-12T12:25:51.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.846+0000 7fabc3400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fabb00a2b90 0x7fabb00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.846+0000 7fabc3400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fabb00a2b90 0x7fabb00a5050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fabcc1991a0 tx=0x7fabb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:51.850+0000 7fabc9600640 1 -- 172.21.15.38:0/2227530645 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabbc09bcd0 con 0x7fabcc102480 2024-09-12T12:25:52.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.033+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabcc062630 con 0x7fabb00a2b90 2024-09-12T12:25:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.041+0000 7fabc9600640 1 -- 172.21.15.38:0/2227530645 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340549 (secure 0 0 0) 0x7fabcc062630 con 0x7fabb00a2b90 2024-09-12T12:25:52.045 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:52.047 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-12T12:25:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fabb00a2b90 msgr2=0x7fabb00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fabb00a2b90 0x7fabb00a5050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fabcc1991a0 tx=0x7fabb4005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc102480 msgr2=0x7fabcc197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc102480 0x7fabcc197ca0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00e9f0 tx=0x7fabbc00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 shutdown_connections 2024-09-12T12:25:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fabb00a2b90 0x7fabb00a5050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc1076e0 0x7fabcc19f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabcc104db0 0x7fabcc1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 --2- 172.21.15.38:0/2227530645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabcc102480 0x7fabcc197ca0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 >> 172.21.15.38:0/2227530645 conn(0x7fabcc0fc000 msgr2=0x7fabcc102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 shutdown_connections 2024-09-12T12:25:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.046+0000 7fabd1400640 1 -- 172.21.15.38:0/2227530645 wait complete. 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2024-09-12T12:25:50.118975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661940,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1354,"num_read_kb":799,"num_write":442,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388976,"kb_used_data":14768,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552848,"statfs":{"total":1151940427776,"available":1151542116352,"internally_reserved":0,"allocated":15122432,"data_stored":8345463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":622,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003703"},"pg_stats":[{"pgid":"2.1f","version":"91'13","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.359943+0000","last_change":"2024-09-12T12:22:51.847865+0000","last_active":"2024-09-12T12:25:45.359943+0000","last_peered":"2024-09-12T12:25:45.359943+0000","last_clean":"2024-09-12T12:25:45.359943+0000","last_became_active":"2024-09-12T12:22:51.847437+0000","last_became_peered":"2024-09-12T12:22:51.847437+0000","last_unstale":"2024-09-12T12:25:45.359943+0000","last_undegraded":"2024-09-12T12:25:45.359943+0000","last_fullsized":"2024-09-12T12:25:45.359943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:34.486264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.095342+0000","last_change":"2024-09-12T12:22:54.316759+0000","last_active":"2024-09-12T12:25:04.095342+0000","last_peered":"2024-09-12T12:25:04.095342+0000","last_clean":"2024-09-12T12:25:04.095342+0000","last_became_active":"2024-09-12T12:22:54.315906+0000","last_became_peered":"2024-09-12T12:22:54.315906+0000","last_unstale":"2024-09-12T12:25:04.095342+0000","last_undegraded":"2024-09-12T12:25:04.095342+0000","last_fullsized":"2024-09-12T12:25:04.095342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:54.465835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845553+0000","last_change":"2024-09-12T12:23:03.387327+0000","last_active":"2024-09-12T12:24:35.845553+0000","last_peered":"2024-09-12T12:24:35.845553+0000","last_clean":"2024-09-12T12:24:35.845553+0000","last_became_active":"2024-09-12T12:23:03.386929+0000","last_became_peered":"2024-09-12T12:23:03.386929+0000","last_unstale":"2024-09-12T12:24:35.845553+0000","last_undegraded":"2024-09-12T12:24:35.845553+0000","last_fullsized":"2024-09-12T12:24:35.845553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.033999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845672+0000","last_change":"2024-09-12T12:22:51.990331+0000","last_active":"2024-09-12T12:24:35.845672+0000","last_peered":"2024-09-12T12:24:35.845672+0000","last_clean":"2024-09-12T12:24:35.845672+0000","last_became_active":"2024-09-12T12:22:51.989844+0000","last_became_peered":"2024-09-12T12:22:51.989844+0000","last_unstale":"2024-09-12T12:24:35.845672+0000","last_undegraded":"2024-09-12T12:24:35.845672+0000","last_fullsized":"2024-09-12T12:24:35.845672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:47.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115744+0000","last_change":"2024-09-12T12:22:54.317141+0000","last_active":"2024-09-12T12:25:04.115744+0000","last_peered":"2024-09-12T12:25:04.115744+0000","last_clean":"2024-09-12T12:25:04.115744+0000","last_became_active":"2024-09-12T12:22:54.312292+0000","last_became_peered":"2024-09-12T12:22:54.312292+0000","last_unstale":"2024-09-12T12:25:04.115744+0000","last_undegraded":"2024-09-12T12:25:04.115744+0000","last_fullsized":"2024-09-12T12:25:04.115744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.943100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267584+0000","last_change":"2024-09-12T12:23:03.379532+0000","last_active":"2024-09-12T12:24:36.267584+0000","last_peered":"2024-09-12T12:24:36.267584+0000","last_clean":"2024-09-12T12:24:36.267584+0000","last_became_active":"2024-09-12T12:23:03.379087+0000","last_became_peered":"2024-09-12T12:23:03.379087+0000","last_unstale":"2024-09-12T12:24:36.267584+0000","last_undegraded":"2024-09-12T12:24:36.267584+0000","last_fullsized":"2024-09-12T12:24:36.267584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.971474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.279148+0000","last_change":"2024-09-12T12:24:36.278754+0000","last_active":"2024-09-12T12:24:36.279148+0000","last_peered":"2024-09-12T12:24:36.279148+0000","last_clean":"2024-09-12T12:24:36.279148+0000","last_became_active":"2024-09-12T12:24:36.269065+0000","last_became_peered":"2024-09-12T12:24:36.269065+0000","last_unstale":"2024-09-12T12:24:36.279148+0000","last_undegraded":"2024-09-12T12:24:36.279148+0000","last_fullsized":"2024-09-12T12:24:36.279148+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:12.224802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125655+0000","last_change":"2024-09-12T12:22:54.315178+0000","last_active":"2024-09-12T12:25:04.125655+0000","last_peered":"2024-09-12T12:25:04.125655+0000","last_clean":"2024-09-12T12:25:04.125655+0000","last_became_active":"2024-09-12T12:22:54.314408+0000","last_became_peered":"2024-09-12T12:22:54.314408+0000","last_unstale":"2024-09-12T12:25:04.125655+0000","last_undegraded":"2024-09-12T12:25:04.125655+0000","last_fullsized":"2024-09-12T12:25:04.125655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268083+0000","last_change":"2024-09-12T12:23:03.384629+0000","last_active":"2024-09-12T12:24:36.268083+0000","last_peered":"2024-09-12T12:24:36.268083+0000","last_clean":"2024-09-12T12:24:36.268083+0000","last_became_active":"2024-09-12T12:23:03.383750+0000","last_became_peered":"2024-09-12T12:23:03.383750+0000","last_unstale":"2024-09-12T12:24:36.268083+0000","last_undegraded":"2024-09-12T12:24:36.268083+0000","last_fullsized":"2024-09-12T12:24:36.268083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:24.377269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844538+0000","last_change":"2024-09-12T12:22:51.847561+0000","last_active":"2024-09-12T12:24:35.844538+0000","last_peered":"2024-09-12T12:24:35.844538+0000","last_clean":"2024-09-12T12:24:35.844538+0000","last_became_active":"2024-09-12T12:22:51.846862+0000","last_became_peered":"2024-09-12T12:22:51.846862+0000","last_unstale":"2024-09-12T12:24:35.844538+0000","last_undegraded":"2024-09-12T12:24:35.844538+0000","last_fullsized":"2024-09-12T12:24:35.844538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:37.907652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107286+0000","last_change":"2024-09-12T12:22:54.313493+0000","last_active":"2024-09-12T12:25:04.107286+0000","last_peered":"2024-09-12T12:25:04.107286+0000","last_clean":"2024-09-12T12:25:04.107286+0000","last_became_active":"2024-09-12T12:22:54.313115+0000","last_became_peered":"2024-09-12T12:22:54.313115+0000","last_unstale":"2024-09-12T12:25:04.107286+0000","last_undegraded":"2024-09-12T12:25:04.107286+0000","last_fullsized":"2024-09-12T12:25:04.107286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:39.631537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267750+0000","last_change":"2024-09-12T12:23:03.383997+0000","last_active":"2024-09-12T12:24:36.267750+0000","last_peered":"2024-09-12T12:24:36.267750+0000","last_clean":"2024-09-12T12:24:36.267750+0000","last_became_active":"2024-09-12T12:23:03.382952+0000","last_became_peered":"2024-09-12T12:23:03.382952+0000","last_unstale":"2024-09-12T12:24:36.267750+0000","last_undegraded":"2024-09-12T12:24:36.267750+0000","last_fullsized":"2024-09-12T12:24:36.267750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:37.949848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124206+0000","last_change":"2024-09-12T12:22:54.311875+0000","last_active":"2024-09-12T12:25:04.124206+0000","last_peered":"2024-09-12T12:25:04.124206+0000","last_clean":"2024-09-12T12:25:04.124206+0000","last_became_active":"2024-09-12T12:22:54.311301+0000","last_became_peered":"2024-09-12T12:22:54.311301+0000","last_unstale":"2024-09-12T12:25:04.124206+0000","last_undegraded":"2024-09-12T12:25:04.124206+0000","last_fullsized":"2024-09-12T12:25:04.124206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:47.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844056+0000","last_change":"2024-09-12T12:22:51.849400+0000","last_active":"2024-09-12T12:24:35.844056+0000","last_peered":"2024-09-12T12:24:35.844056+0000","last_clean":"2024-09-12T12:24:35.844056+0000","last_became_active":"2024-09-12T12:22:51.848295+0000","last_became_peered":"2024-09-12T12:22:51.848295+0000","last_unstale":"2024-09-12T12:24:35.844056+0000","last_undegraded":"2024-09-12T12:24:35.844056+0000","last_fullsized":"2024-09-12T12:24:35.844056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268139+0000","last_change":"2024-09-12T12:23:03.779217+0000","last_active":"2024-09-12T12:24:36.268139+0000","last_peered":"2024-09-12T12:24:36.268139+0000","last_clean":"2024-09-12T12:24:36.268139+0000","last_became_active":"2024-09-12T12:23:03.778732+0000","last_became_peered":"2024-09-12T12:23:03.778732+0000","last_unstale":"2024-09-12T12:24:36.268139+0000","last_undegraded":"2024-09-12T12:24:36.268139+0000","last_fullsized":"2024-09-12T12:24:36.268139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:49.676157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119742+0000","last_change":"2024-09-12T12:22:54.323222+0000","last_active":"2024-09-12T12:25:04.119742+0000","last_peered":"2024-09-12T12:25:04.119742+0000","last_clean":"2024-09-12T12:25:04.119742+0000","last_became_active":"2024-09-12T12:22:54.321035+0000","last_became_peered":"2024-09-12T12:22:54.321035+0000","last_unstale":"2024-09-12T12:25:04.119742+0000","last_undegraded":"2024-09-12T12:25:04.119742+0000","last_fullsized":"2024-09-12T12:25:04.119742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:04.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:37.742255+0000","last_change":"2024-09-12T12:24:35.850509+0000","last_active":"2024-09-12T12:24:37.742255+0000","last_peered":"2024-09-12T12:24:37.742255+0000","last_clean":"2024-09-12T12:24:37.742255+0000","last_became_active":"2024-09-12T12:24:35.846578+0000","last_became_peered":"2024-09-12T12:24:35.846578+0000","last_unstale":"2024-09-12T12:24:37.742255+0000","last_undegraded":"2024-09-12T12:24:37.742255+0000","last_fullsized":"2024-09-12T12:24:37.742255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:10.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267896+0000","last_change":"2024-09-12T12:23:35.079820+0000","last_active":"2024-09-12T12:24:36.267896+0000","last_peered":"2024-09-12T12:24:36.267896+0000","last_clean":"2024-09-12T12:24:36.267896+0000","last_became_active":"2024-09-12T12:23:35.079362+0000","last_became_peered":"2024-09-12T12:23:35.079362+0000","last_unstale":"2024-09-12T12:24:36.267896+0000","last_undegraded":"2024-09-12T12:24:36.267896+0000","last_fullsized":"2024-09-12T12:24:36.267896+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:22.713646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.113669+0000","last_change":"2024-09-12T12:22:54.307950+0000","last_active":"2024-09-12T12:25:04.113669+0000","last_peered":"2024-09-12T12:25:04.113669+0000","last_clean":"2024-09-12T12:25:04.113669+0000","last_became_active":"2024-09-12T12:22:54.307595+0000","last_became_peered":"2024-09-12T12:22:54.307595+0000","last_unstale":"2024-09-12T12:25:04.113669+0000","last_undegraded":"2024-09-12T12:25:04.113669+0000","last_fullsized":"2024-09-12T12:25:04.113669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:11.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845284+0000","last_change":"2024-09-12T12:22:51.851424+0000","last_active":"2024-09-12T12:24:35.845284+0000","last_peered":"2024-09-12T12:24:35.845284+0000","last_clean":"2024-09-12T12:24:35.845284+0000","last_became_active":"2024-09-12T12:22:51.851043+0000","last_became_peered":"2024-09-12T12:22:51.851043+0000","last_unstale":"2024-09-12T12:24:35.845284+0000","last_undegraded":"2024-09-12T12:24:35.845284+0000","last_fullsized":"2024-09-12T12:24:35.845284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841205+0000","last_change":"2024-09-12T12:23:03.381773+0000","last_active":"2024-09-12T12:24:35.841205+0000","last_peered":"2024-09-12T12:24:35.841205+0000","last_clean":"2024-09-12T12:24:35.841205+0000","last_became_active":"2024-09-12T12:23:03.378442+0000","last_became_peered":"2024-09-12T12:23:03.378442+0000","last_unstale":"2024-09-12T12:24:35.841205+0000","last_undegraded":"2024-09-12T12:24:35.841205+0000","last_fullsized":"2024-09-12T12:24:35.841205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.570787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.085994+0000","last_change":"2024-09-12T12:22:54.310010+0000","last_active":"2024-09-12T12:25:04.085994+0000","last_peered":"2024-09-12T12:25:04.085994+0000","last_clean":"2024-09-12T12:25:04.085994+0000","last_became_active":"2024-09-12T12:22:54.309499+0000","last_became_peered":"2024-09-12T12:22:54.309499+0000","last_unstale":"2024-09-12T12:25:04.085994+0000","last_undegraded":"2024-09-12T12:25:04.085994+0000","last_fullsized":"2024-09-12T12:25:04.085994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.456842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.453985+0000","last_change":"2024-09-12T12:22:51.990294+0000","last_active":"2024-09-12T12:24:36.453985+0000","last_peered":"2024-09-12T12:24:36.453985+0000","last_clean":"2024-09-12T12:24:36.453985+0000","last_became_active":"2024-09-12T12:22:51.989925+0000","last_became_peered":"2024-09-12T12:22:51.989925+0000","last_unstale":"2024-09-12T12:24:36.453985+0000","last_undegraded":"2024-09-12T12:24:36.453985+0000","last_fullsized":"2024-09-12T12:24:36.453985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:56.754802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267961+0000","last_change":"2024-09-12T12:23:03.780256+0000","last_active":"2024-09-12T12:24:36.267961+0000","last_peered":"2024-09-12T12:24:36.267961+0000","last_clean":"2024-09-12T12:24:36.267961+0000","last_became_active":"2024-09-12T12:23:03.779808+0000","last_became_peered":"2024-09-12T12:23:03.779808+0000","last_unstale":"2024-09-12T12:24:36.267961+0000","last_undegraded":"2024-09-12T12:24:36.267961+0000","last_fullsized":"2024-09-12T12:24:36.267961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:58.236749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115819+0000","last_change":"2024-09-12T12:23:35.084287+0000","last_active":"2024-09-12T12:25:04.115819+0000","last_peered":"2024-09-12T12:25:04.115819+0000","last_clean":"2024-09-12T12:25:04.115819+0000","last_became_active":"2024-09-12T12:23:35.083828+0000","last_became_peered":"2024-09-12T12:23:35.083828+0000","last_unstale":"2024-09-12T12:25:04.115819+0000","last_undegraded":"2024-09-12T12:25:04.115819+0000","last_fullsized":"2024-09-12T12:25:04.115819+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:36.183575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268345+0000","last_change":"2024-09-12T12:22:52.557264+0000","last_active":"2024-09-12T12:24:36.268345+0000","last_peered":"2024-09-12T12:24:36.268345+0000","last_clean":"2024-09-12T12:24:36.268345+0000","last_became_active":"2024-09-12T12:22:52.556783+0000","last_became_peered":"2024-09-12T12:22:52.556783+0000","last_unstale":"2024-09-12T12:24:36.268345+0000","last_undegraded":"2024-09-12T12:24:36.268345+0000","last_fullsized":"2024-09-12T12:24:36.268345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:08.815983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845595+0000","last_change":"2024-09-12T12:23:03.376129+0000","last_active":"2024-09-12T12:24:35.845595+0000","last_peered":"2024-09-12T12:24:35.845595+0000","last_clean":"2024-09-12T12:24:35.845595+0000","last_became_active":"2024-09-12T12:23:03.375200+0000","last_became_peered":"2024-09-12T12:23:03.375200+0000","last_unstale":"2024-09-12T12:24:35.845595+0000","last_undegraded":"2024-09-12T12:24:35.845595+0000","last_fullsized":"2024-09-12T12:24:35.845595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.418366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111408+0000","last_change":"2024-09-12T12:22:54.314708+0000","last_active":"2024-09-12T12:25:04.111408+0000","last_peered":"2024-09-12T12:25:04.111408+0000","last_clean":"2024-09-12T12:25:04.111408+0000","last_became_active":"2024-09-12T12:22:54.314304+0000","last_became_peered":"2024-09-12T12:22:54.314304+0000","last_unstale":"2024-09-12T12:25:04.111408+0000","last_undegraded":"2024-09-12T12:25:04.111408+0000","last_fullsized":"2024-09-12T12:25:04.111408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:52.198831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'16","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.327501+0000","last_change":"2024-09-12T12:22:51.846753+0000","last_active":"2024-09-12T12:25:04.327501+0000","last_peered":"2024-09-12T12:25:04.327501+0000","last_clean":"2024-09-12T12:25:04.327501+0000","last_became_active":"2024-09-12T12:22:51.846388+0000","last_became_peered":"2024-09-12T12:22:51.846388+0000","last_unstale":"2024-09-12T12:25:04.327501+0000","last_undegraded":"2024-09-12T12:25:04.327501+0000","last_fullsized":"2024-09-12T12:25:04.327501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:34.511644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844866+0000","last_change":"2024-09-12T12:23:03.779254+0000","last_active":"2024-09-12T12:24:35.844866+0000","last_peered":"2024-09-12T12:24:35.844866+0000","last_clean":"2024-09-12T12:24:35.844866+0000","last_became_active":"2024-09-12T12:23:03.778801+0000","last_became_peered":"2024-09-12T12:23:03.778801+0000","last_unstale":"2024-09-12T12:24:35.844866+0000","last_undegraded":"2024-09-12T12:24:35.844866+0000","last_fullsized":"2024-09-12T12:24:35.844866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.121722+0000","last_change":"2024-09-12T12:22:54.312002+0000","last_active":"2024-09-12T12:25:04.121722+0000","last_peered":"2024-09-12T12:25:04.121722+0000","last_clean":"2024-09-12T12:25:04.121722+0000","last_became_active":"2024-09-12T12:22:54.311670+0000","last_became_peered":"2024-09-12T12:22:54.311670+0000","last_unstale":"2024-09-12T12:25:04.121722+0000","last_undegraded":"2024-09-12T12:25:04.121722+0000","last_fullsized":"2024-09-12T12:25:04.121722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:08.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.856791+0000","last_change":"2024-09-12T12:24:35.856332+0000","last_active":"2024-09-12T12:24:35.856791+0000","last_peered":"2024-09-12T12:24:35.856791+0000","last_clean":"2024-09-12T12:24:35.856791+0000","last_became_active":"2024-09-12T12:24:35.846638+0000","last_became_peered":"2024-09-12T12:24:35.846638+0000","last_unstale":"2024-09-12T12:24:35.856791+0000","last_undegraded":"2024-09-12T12:24:35.856791+0000","last_fullsized":"2024-09-12T12:24:35.856791+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.181686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842993+0000","last_change":"2024-09-12T12:23:03.379901+0000","last_active":"2024-09-12T12:24:35.842993+0000","last_peered":"2024-09-12T12:24:35.842993+0000","last_clean":"2024-09-12T12:24:35.842993+0000","last_became_active":"2024-09-12T12:23:03.379385+0000","last_became_peered":"2024-09-12T12:23:03.379385+0000","last_unstale":"2024-09-12T12:24:35.842993+0000","last_undegraded":"2024-09-12T12:24:35.842993+0000","last_fullsized":"2024-09-12T12:24:35.842993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:47.939223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123208+0000","last_change":"2024-09-12T12:22:54.316450+0000","last_active":"2024-09-12T12:25:04.123208+0000","last_peered":"2024-09-12T12:25:04.123208+0000","last_clean":"2024-09-12T12:25:04.123208+0000","last_became_active":"2024-09-12T12:22:54.316058+0000","last_became_peered":"2024-09-12T12:22:54.316058+0000","last_unstale":"2024-09-12T12:25:04.123208+0000","last_undegraded":"2024-09-12T12:25:04.123208+0000","last_fullsized":"2024-09-12T12:25:04.123208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:38.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841156+0000","last_change":"2024-09-12T12:22:51.992564+0000","last_active":"2024-09-12T12:24:35.841156+0000","last_peered":"2024-09-12T12:24:35.841156+0000","last_clean":"2024-09-12T12:24:35.841156+0000","last_became_active":"2024-09-12T12:22:51.992012+0000","last_became_peered":"2024-09-12T12:22:51.992012+0000","last_unstale":"2024-09-12T12:24:35.841156+0000","last_undegraded":"2024-09-12T12:24:35.841156+0000","last_fullsized":"2024-09-12T12:24:35.841156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:26.190486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843880+0000","last_change":"2024-09-12T12:23:03.779309+0000","last_active":"2024-09-12T12:24:35.843880+0000","last_peered":"2024-09-12T12:24:35.843880+0000","last_clean":"2024-09-12T12:24:35.843880+0000","last_became_active":"2024-09-12T12:23:03.778812+0000","last_became_peered":"2024-09-12T12:23:03.778812+0000","last_unstale":"2024-09-12T12:24:35.843880+0000","last_undegraded":"2024-09-12T12:24:35.843880+0000","last_fullsized":"2024-09-12T12:24:35.843880+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:56.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115436+0000","last_change":"2024-09-12T12:22:54.309745+0000","last_active":"2024-09-12T12:25:04.115436+0000","last_peered":"2024-09-12T12:25:04.115436+0000","last_clean":"2024-09-12T12:25:04.115436+0000","last_became_active":"2024-09-12T12:22:54.309388+0000","last_became_peered":"2024-09-12T12:22:54.309388+0000","last_unstale":"2024-09-12T12:25:04.115436+0000","last_undegraded":"2024-09-12T12:25:04.115436+0000","last_fullsized":"2024-09-12T12:25:04.115436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.268141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.360609+0000","last_change":"2024-09-12T12:22:51.850494+0000","last_active":"2024-09-12T12:25:45.360609+0000","last_peered":"2024-09-12T12:25:45.360609+0000","last_clean":"2024-09-12T12:25:45.360609+0000","last_became_active":"2024-09-12T12:22:51.849071+0000","last_became_peered":"2024-09-12T12:22:51.849071+0000","last_unstale":"2024-09-12T12:25:45.360609+0000","last_undegraded":"2024-09-12T12:25:45.360609+0000","last_fullsized":"2024-09-12T12:25:45.360609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:19.203267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265150+0000","last_change":"2024-09-12T12:23:03.383096+0000","last_active":"2024-09-12T12:24:36.265150+0000","last_peered":"2024-09-12T12:24:36.265150+0000","last_clean":"2024-09-12T12:24:36.265150+0000","last_became_active":"2024-09-12T12:23:03.382261+0000","last_became_peered":"2024-09-12T12:23:03.382261+0000","last_unstale":"2024-09-12T12:24:36.265150+0000","last_undegraded":"2024-09-12T12:24:36.265150+0000","last_fullsized":"2024-09-12T12:24:36.265150+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:08.976679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.103037+0000","last_change":"2024-09-12T12:23:35.079333+0000","last_active":"2024-09-12T12:25:04.103037+0000","last_peered":"2024-09-12T12:25:04.103037+0000","last_clean":"2024-09-12T12:25:04.103037+0000","last_became_active":"2024-09-12T12:23:35.078908+0000","last_became_peered":"2024-09-12T12:23:35.078908+0000","last_unstale":"2024-09-12T12:25:04.103037+0000","last_undegraded":"2024-09-12T12:25:04.103037+0000","last_fullsized":"2024-09-12T12:25:04.103037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:55:59.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.359943+0000","last_change":"2024-09-12T12:22:51.990322+0000","last_active":"2024-09-12T12:25:45.359943+0000","last_peered":"2024-09-12T12:25:45.359943+0000","last_clean":"2024-09-12T12:25:45.359943+0000","last_became_active":"2024-09-12T12:22:51.989970+0000","last_became_peered":"2024-09-12T12:22:51.989970+0000","last_unstale":"2024-09-12T12:25:45.359943+0000","last_undegraded":"2024-09-12T12:25:45.359943+0000","last_fullsized":"2024-09-12T12:25:45.359943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:14.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265419+0000","last_change":"2024-09-12T12:23:35.083806+0000","last_active":"2024-09-12T12:24:36.265419+0000","last_peered":"2024-09-12T12:24:36.265419+0000","last_clean":"2024-09-12T12:24:36.265419+0000","last_became_active":"2024-09-12T12:23:35.083379+0000","last_became_peered":"2024-09-12T12:23:35.083379+0000","last_unstale":"2024-09-12T12:24:36.265419+0000","last_undegraded":"2024-09-12T12:24:36.265419+0000","last_fullsized":"2024-09-12T12:24:36.265419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:54.146429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119046+0000","last_change":"2024-09-12T12:22:54.305747+0000","last_active":"2024-09-12T12:25:04.119046+0000","last_peered":"2024-09-12T12:25:04.119046+0000","last_clean":"2024-09-12T12:25:04.119046+0000","last_became_active":"2024-09-12T12:22:54.305423+0000","last_became_peered":"2024-09-12T12:22:54.305423+0000","last_unstale":"2024-09-12T12:25:04.119046+0000","last_undegraded":"2024-09-12T12:25:04.119046+0000","last_fullsized":"2024-09-12T12:25:04.119046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.463661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846664+0000","last_change":"2024-09-12T12:22:51.852216+0000","last_active":"2024-09-12T12:24:35.846664+0000","last_peered":"2024-09-12T12:24:35.846664+0000","last_clean":"2024-09-12T12:24:35.846664+0000","last_became_active":"2024-09-12T12:22:51.850495+0000","last_became_peered":"2024-09-12T12:22:51.850495+0000","last_unstale":"2024-09-12T12:24:35.846664+0000","last_undegraded":"2024-09-12T12:24:35.846664+0000","last_fullsized":"2024-09-12T12:24:35.846664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:51.711697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840677+0000","last_change":"2024-09-12T12:23:35.118914+0000","last_active":"2024-09-12T12:24:35.840677+0000","last_peered":"2024-09-12T12:24:35.840677+0000","last_clean":"2024-09-12T12:24:35.840677+0000","last_became_active":"2024-09-12T12:23:35.118411+0000","last_became_peered":"2024-09-12T12:23:35.118411+0000","last_unstale":"2024-09-12T12:24:35.840677+0000","last_undegraded":"2024-09-12T12:24:35.840677+0000","last_fullsized":"2024-09-12T12:24:35.840677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:08.350538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109066+0000","last_change":"2024-09-12T12:22:54.320573+0000","last_active":"2024-09-12T12:25:04.109066+0000","last_peered":"2024-09-12T12:25:04.109066+0000","last_clean":"2024-09-12T12:25:04.109066+0000","last_became_active":"2024-09-12T12:22:54.320120+0000","last_became_peered":"2024-09-12T12:22:54.320120+0000","last_unstale":"2024-09-12T12:25:04.109066+0000","last_undegraded":"2024-09-12T12:25:04.109066+0000","last_fullsized":"2024-09-12T12:25:04.109066+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:35.490584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267023+0000","last_change":"2024-09-12T12:22:51.851098+0000","last_active":"2024-09-12T12:24:36.267023+0000","last_peered":"2024-09-12T12:24:36.267023+0000","last_clean":"2024-09-12T12:24:36.267023+0000","last_became_active":"2024-09-12T12:22:51.850725+0000","last_became_peered":"2024-09-12T12:22:51.850725+0000","last_unstale":"2024-09-12T12:24:36.267023+0000","last_undegraded":"2024-09-12T12:24:36.267023+0000","last_fullsized":"2024-09-12T12:24:36.267023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:18.308742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846840+0000","last_change":"2024-09-12T12:21:34.312000+0000","last_active":"2024-09-12T12:24:35.846840+0000","last_peered":"2024-09-12T12:24:35.846840+0000","last_clean":"2024-09-12T12:24:35.846840+0000","last_became_active":"2024-09-12T12:21:34.311472+0000","last_became_peered":"2024-09-12T12:21:34.311472+0000","last_unstale":"2024-09-12T12:24:35.846840+0000","last_undegraded":"2024-09-12T12:24:35.846840+0000","last_fullsized":"2024-09-12T12:24:35.846840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_clean_scrub_stamp":"2024-09-12T12:17:58.852566+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847001+0000","last_change":"2024-09-12T12:23:03.387802+0000","last_active":"2024-09-12T12:24:35.847001+0000","last_peered":"2024-09-12T12:24:35.847001+0000","last_clean":"2024-09-12T12:24:35.847001+0000","last_became_active":"2024-09-12T12:23:03.387391+0000","last_became_peered":"2024-09-12T12:23:03.387391+0000","last_unstale":"2024-09-12T12:24:35.847001+0000","last_undegraded":"2024-09-12T12:24:35.847001+0000","last_fullsized":"2024-09-12T12:24:35.847001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:24.741915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118292+0000","last_change":"2024-09-12T12:22:54.314326+0000","last_active":"2024-09-12T12:25:04.118292+0000","last_peered":"2024-09-12T12:25:04.118292+0000","last_clean":"2024-09-12T12:25:04.118292+0000","last_became_active":"2024-09-12T12:22:54.313892+0000","last_became_peered":"2024-09-12T12:22:54.313892+0000","last_unstale":"2024-09-12T12:25:04.118292+0000","last_undegraded":"2024-09-12T12:25:04.118292+0000","last_fullsized":"2024-09-12T12:25:04.118292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:50.980891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'7","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.361468+0000","last_change":"2024-09-12T12:22:52.557126+0000","last_active":"2024-09-12T12:25:45.361468+0000","last_peered":"2024-09-12T12:25:45.361468+0000","last_clean":"2024-09-12T12:25:45.361468+0000","last_became_active":"2024-09-12T12:22:52.556736+0000","last_became_peered":"2024-09-12T12:22:52.556736+0000","last_unstale":"2024-09-12T12:25:45.361468+0000","last_undegraded":"2024-09-12T12:25:45.361468+0000","last_fullsized":"2024-09-12T12:25:45.361468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:09.199871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454196+0000","last_change":"2024-09-12T12:23:03.380117+0000","last_active":"2024-09-12T12:24:36.454196+0000","last_peered":"2024-09-12T12:24:36.454196+0000","last_clean":"2024-09-12T12:24:36.454196+0000","last_became_active":"2024-09-12T12:23:03.379635+0000","last_became_peered":"2024-09-12T12:23:03.379635+0000","last_unstale":"2024-09-12T12:24:36.454196+0000","last_undegraded":"2024-09-12T12:24:36.454196+0000","last_fullsized":"2024-09-12T12:24:36.454196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:23.227681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116460+0000","last_change":"2024-09-12T12:22:54.316010+0000","last_active":"2024-09-12T12:25:04.116460+0000","last_peered":"2024-09-12T12:25:04.116460+0000","last_clean":"2024-09-12T12:25:04.116460+0000","last_became_active":"2024-09-12T12:22:54.315702+0000","last_became_peered":"2024-09-12T12:22:54.315702+0000","last_unstale":"2024-09-12T12:25:04.116460+0000","last_undegraded":"2024-09-12T12:25:04.116460+0000","last_fullsized":"2024-09-12T12:25:04.116460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:52.370650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840843+0000","last_change":"2024-09-12T12:22:51.854456+0000","last_active":"2024-09-12T12:24:35.840843+0000","last_peered":"2024-09-12T12:24:35.840843+0000","last_clean":"2024-09-12T12:24:35.840843+0000","last_became_active":"2024-09-12T12:22:51.854092+0000","last_became_peered":"2024-09-12T12:22:51.854092+0000","last_unstale":"2024-09-12T12:24:35.840843+0000","last_undegraded":"2024-09-12T12:24:35.840843+0000","last_fullsized":"2024-09-12T12:24:35.840843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:57.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846546+0000","last_change":"2024-09-12T12:23:03.390443+0000","last_active":"2024-09-12T12:24:35.846546+0000","last_peered":"2024-09-12T12:24:35.846546+0000","last_clean":"2024-09-12T12:24:35.846546+0000","last_became_active":"2024-09-12T12:23:03.389825+0000","last_became_peered":"2024-09-12T12:23:03.389825+0000","last_unstale":"2024-09-12T12:24:35.846546+0000","last_undegraded":"2024-09-12T12:24:35.846546+0000","last_fullsized":"2024-09-12T12:24:35.846546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.711075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.112283+0000","last_change":"2024-09-12T12:22:54.311694+0000","last_active":"2024-09-12T12:25:04.112283+0000","last_peered":"2024-09-12T12:25:04.112283+0000","last_clean":"2024-09-12T12:25:04.112283+0000","last_became_active":"2024-09-12T12:22:54.311381+0000","last_became_peered":"2024-09-12T12:22:54.311381+0000","last_unstale":"2024-09-12T12:25:04.112283+0000","last_undegraded":"2024-09-12T12:25:04.112283+0000","last_fullsized":"2024-09-12T12:25:04.112283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.378495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.264726+0000","last_change":"2024-09-12T12:22:51.852126+0000","last_active":"2024-09-12T12:24:36.264726+0000","last_peered":"2024-09-12T12:24:36.264726+0000","last_clean":"2024-09-12T12:24:36.264726+0000","last_became_active":"2024-09-12T12:22:51.851766+0000","last_became_peered":"2024-09-12T12:22:51.851766+0000","last_unstale":"2024-09-12T12:24:36.264726+0000","last_undegraded":"2024-09-12T12:24:36.264726+0000","last_fullsized":"2024-09-12T12:24:36.264726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:37.263329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840007+0000","last_change":"2024-09-12T12:23:03.375569+0000","last_active":"2024-09-12T12:24:35.840007+0000","last_peered":"2024-09-12T12:24:35.840007+0000","last_clean":"2024-09-12T12:24:35.840007+0000","last_became_active":"2024-09-12T12:23:03.375136+0000","last_became_peered":"2024-09-12T12:23:03.375136+0000","last_unstale":"2024-09-12T12:24:35.840007+0000","last_undegraded":"2024-09-12T12:24:35.840007+0000","last_fullsized":"2024-09-12T12:24:35.840007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:05.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.108357+0000","last_change":"2024-09-12T12:22:54.304943+0000","last_active":"2024-09-12T12:25:04.108357+0000","last_peered":"2024-09-12T12:25:04.108357+0000","last_clean":"2024-09-12T12:25:04.108357+0000","last_became_active":"2024-09-12T12:22:54.304573+0000","last_became_peered":"2024-09-12T12:22:54.304573+0000","last_unstale":"2024-09-12T12:25:04.108357+0000","last_undegraded":"2024-09-12T12:25:04.108357+0000","last_fullsized":"2024-09-12T12:25:04.108357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844624+0000","last_change":"2024-09-12T12:22:51.846998+0000","last_active":"2024-09-12T12:24:35.844624+0000","last_peered":"2024-09-12T12:24:35.844624+0000","last_clean":"2024-09-12T12:24:35.844624+0000","last_became_active":"2024-09-12T12:22:51.846617+0000","last_became_peered":"2024-09-12T12:22:51.846617+0000","last_unstale":"2024-09-12T12:24:35.844624+0000","last_undegraded":"2024-09-12T12:24:35.844624+0000","last_fullsized":"2024-09-12T12:24:35.844624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.428244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840084+0000","last_change":"2024-09-12T12:23:03.383519+0000","last_active":"2024-09-12T12:24:35.840084+0000","last_peered":"2024-09-12T12:24:35.840084+0000","last_clean":"2024-09-12T12:24:35.840084+0000","last_became_active":"2024-09-12T12:23:03.383131+0000","last_became_peered":"2024-09-12T12:23:03.383131+0000","last_unstale":"2024-09-12T12:24:35.840084+0000","last_undegraded":"2024-09-12T12:24:35.840084+0000","last_fullsized":"2024-09-12T12:24:35.840084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:59.602027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107058+0000","last_change":"2024-09-12T12:22:54.312418+0000","last_active":"2024-09-12T12:25:04.107058+0000","last_peered":"2024-09-12T12:25:04.107058+0000","last_clean":"2024-09-12T12:25:04.107058+0000","last_became_active":"2024-09-12T12:22:54.311932+0000","last_became_peered":"2024-09-12T12:22:54.311932+0000","last_unstale":"2024-09-12T12:25:04.107058+0000","last_undegraded":"2024-09-12T12:25:04.107058+0000","last_fullsized":"2024-09-12T12:25:04.107058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:48.395607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843747+0000","last_change":"2024-09-12T12:22:51.993506+0000","last_active":"2024-09-12T12:24:35.843747+0000","last_peered":"2024-09-12T12:24:35.843747+0000","last_clean":"2024-09-12T12:24:35.843747+0000","last_became_active":"2024-09-12T12:22:51.993204+0000","last_became_peered":"2024-09-12T12:22:51.993204+0000","last_unstale":"2024-09-12T12:24:35.843747+0000","last_undegraded":"2024-09-12T12:24:35.843747+0000","last_fullsized":"2024-09-12T12:24:35.843747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:34.670023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265433+0000","last_change":"2024-09-12T12:23:03.388552+0000","last_active":"2024-09-12T12:24:36.265433+0000","last_peered":"2024-09-12T12:24:36.265433+0000","last_clean":"2024-09-12T12:24:36.265433+0000","last_became_active":"2024-09-12T12:23:03.388105+0000","last_became_peered":"2024-09-12T12:23:03.388105+0000","last_unstale":"2024-09-12T12:24:36.265433+0000","last_undegraded":"2024-09-12T12:24:36.265433+0000","last_fullsized":"2024-09-12T12:24:36.265433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:08.927714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106325+0000","last_change":"2024-09-12T12:23:35.081015+0000","last_active":"2024-09-12T12:25:04.106325+0000","last_peered":"2024-09-12T12:25:04.106325+0000","last_clean":"2024-09-12T12:25:04.106325+0000","last_became_active":"2024-09-12T12:23:35.080609+0000","last_became_peered":"2024-09-12T12:23:35.080609+0000","last_unstale":"2024-09-12T12:25:04.106325+0000","last_undegraded":"2024-09-12T12:25:04.106325+0000","last_fullsized":"2024-09-12T12:25:04.106325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:26.700031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:46.361952+0000","last_change":"2024-09-12T12:22:51.848784+0000","last_active":"2024-09-12T12:25:46.361952+0000","last_peered":"2024-09-12T12:25:46.361952+0000","last_clean":"2024-09-12T12:25:46.361952+0000","last_became_active":"2024-09-12T12:22:51.848255+0000","last_became_peered":"2024-09-12T12:22:51.848255+0000","last_unstale":"2024-09-12T12:25:46.361952+0000","last_undegraded":"2024-09-12T12:25:46.361952+0000","last_fullsized":"2024-09-12T12:25:46.361952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:00.680332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841265+0000","last_change":"2024-09-12T12:23:03.386046+0000","last_active":"2024-09-12T12:24:35.841265+0000","last_peered":"2024-09-12T12:24:35.841265+0000","last_clean":"2024-09-12T12:24:35.841265+0000","last_became_active":"2024-09-12T12:23:03.384264+0000","last_became_peered":"2024-09-12T12:23:03.384264+0000","last_unstale":"2024-09-12T12:24:35.841265+0000","last_undegraded":"2024-09-12T12:24:35.841265+0000","last_fullsized":"2024-09-12T12:24:35.841265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:23.605769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125553+0000","last_change":"2024-09-12T12:22:54.315588+0000","last_active":"2024-09-12T12:25:04.125553+0000","last_peered":"2024-09-12T12:25:04.125553+0000","last_clean":"2024-09-12T12:25:04.125553+0000","last_became_active":"2024-09-12T12:22:54.315216+0000","last_became_peered":"2024-09-12T12:22:54.315216+0000","last_unstale":"2024-09-12T12:25:04.125553+0000","last_undegraded":"2024-09-12T12:25:04.125553+0000","last_fullsized":"2024-09-12T12:25:04.125553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:06.556373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840444+0000","last_change":"2024-09-12T12:22:51.851246+0000","last_active":"2024-09-12T12:24:35.840444+0000","last_peered":"2024-09-12T12:24:35.840444+0000","last_clean":"2024-09-12T12:24:35.840444+0000","last_became_active":"2024-09-12T12:22:51.850963+0000","last_became_peered":"2024-09-12T12:22:51.850963+0000","last_unstale":"2024-09-12T12:24:35.840444+0000","last_undegraded":"2024-09-12T12:24:35.840444+0000","last_fullsized":"2024-09-12T12:24:35.840444+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:12.032126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843036+0000","last_change":"2024-09-12T12:23:03.382950+0000","last_active":"2024-09-12T12:24:35.843036+0000","last_peered":"2024-09-12T12:24:35.843036+0000","last_clean":"2024-09-12T12:24:35.843036+0000","last_became_active":"2024-09-12T12:23:03.382503+0000","last_became_peered":"2024-09-12T12:23:03.382503+0000","last_unstale":"2024-09-12T12:24:35.843036+0000","last_undegraded":"2024-09-12T12:24:35.843036+0000","last_fullsized":"2024-09-12T12:24:35.843036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:03.991304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123029+0000","last_change":"2024-09-12T12:22:54.315788+0000","last_active":"2024-09-12T12:25:04.123029+0000","last_peered":"2024-09-12T12:25:04.123029+0000","last_clean":"2024-09-12T12:25:04.123029+0000","last_became_active":"2024-09-12T12:22:54.315343+0000","last_became_peered":"2024-09-12T12:22:54.315343+0000","last_unstale":"2024-09-12T12:25:04.123029+0000","last_undegraded":"2024-09-12T12:25:04.123029+0000","last_fullsized":"2024-09-12T12:25:04.123029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:22.549415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845915+0000","last_change":"2024-09-12T12:22:51.854532+0000","last_active":"2024-09-12T12:24:35.845915+0000","last_peered":"2024-09-12T12:24:35.845915+0000","last_clean":"2024-09-12T12:24:35.845915+0000","last_became_active":"2024-09-12T12:22:51.854206+0000","last_became_peered":"2024-09-12T12:22:51.854206+0000","last_unstale":"2024-09-12T12:24:35.845915+0000","last_undegraded":"2024-09-12T12:24:35.845915+0000","last_fullsized":"2024-09-12T12:24:35.845915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:46.908917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840512+0000","last_change":"2024-09-12T12:23:03.383647+0000","last_active":"2024-09-12T12:24:35.840512+0000","last_peered":"2024-09-12T12:24:35.840512+0000","last_clean":"2024-09-12T12:24:35.840512+0000","last_became_active":"2024-09-12T12:23:03.383094+0000","last_became_peered":"2024-09-12T12:23:03.383094+0000","last_unstale":"2024-09-12T12:24:35.840512+0000","last_undegraded":"2024-09-12T12:24:35.840512+0000","last_fullsized":"2024-09-12T12:24:35.840512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:03.754250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.091694+0000","last_change":"2024-09-12T12:22:54.310717+0000","last_active":"2024-09-12T12:25:04.091694+0000","last_peered":"2024-09-12T12:25:04.091694+0000","last_clean":"2024-09-12T12:25:04.091694+0000","last_became_active":"2024-09-12T12:22:54.309485+0000","last_became_peered":"2024-09-12T12:22:54.309485+0000","last_unstale":"2024-09-12T12:25:04.091694+0000","last_undegraded":"2024-09-12T12:25:04.091694+0000","last_fullsized":"2024-09-12T12:25:04.091694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:10.293726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'39","reported_seq":323,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.973111+0000","last_change":"2024-09-12T12:22:51.856735+0000","last_active":"2024-09-12T12:25:45.973111+0000","last_peered":"2024-09-12T12:25:45.973111+0000","last_clean":"2024-09-12T12:25:45.973111+0000","last_became_active":"2024-09-12T12:22:51.856340+0000","last_became_peered":"2024-09-12T12:22:51.856340+0000","last_unstale":"2024-09-12T12:25:45.973111+0000","last_undegraded":"2024-09-12T12:25:45.973111+0000","last_fullsized":"2024-09-12T12:25:45.973111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:40.727645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64071,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":244,"num_read_kb":184,"num_write":41,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840936+0000","last_change":"2024-09-12T12:23:03.379726+0000","last_active":"2024-09-12T12:24:35.840936+0000","last_peered":"2024-09-12T12:24:35.840936+0000","last_clean":"2024-09-12T12:24:35.840936+0000","last_became_active":"2024-09-12T12:23:03.378168+0000","last_became_peered":"2024-09-12T12:23:03.378168+0000","last_unstale":"2024-09-12T12:24:35.840936+0000","last_undegraded":"2024-09-12T12:24:35.840936+0000","last_fullsized":"2024-09-12T12:24:35.840936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125522+0000","last_change":"2024-09-12T12:23:35.083119+0000","last_active":"2024-09-12T12:25:04.125522+0000","last_peered":"2024-09-12T12:25:04.125522+0000","last_clean":"2024-09-12T12:25:04.125522+0000","last_became_active":"2024-09-12T12:23:35.082800+0000","last_became_peered":"2024-09-12T12:23:35.082800+0000","last_unstale":"2024-09-12T12:25:04.125522+0000","last_undegraded":"2024-09-12T12:25:04.125522+0000","last_fullsized":"2024-09-12T12:25:04.125522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.717540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840793+0000","last_change":"2024-09-12T12:22:51.989886+0000","last_active":"2024-09-12T12:24:35.840793+0000","last_peered":"2024-09-12T12:24:35.840793+0000","last_clean":"2024-09-12T12:24:35.840793+0000","last_became_active":"2024-09-12T12:22:51.989524+0000","last_became_peered":"2024-09-12T12:22:51.989524+0000","last_unstale":"2024-09-12T12:24:35.840793+0000","last_undegraded":"2024-09-12T12:24:35.840793+0000","last_fullsized":"2024-09-12T12:24:35.840793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:26.409342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268030+0000","last_change":"2024-09-12T12:23:03.384583+0000","last_active":"2024-09-12T12:24:36.268030+0000","last_peered":"2024-09-12T12:24:36.268030+0000","last_clean":"2024-09-12T12:24:36.268030+0000","last_became_active":"2024-09-12T12:23:03.383639+0000","last_became_peered":"2024-09-12T12:23:03.383639+0000","last_unstale":"2024-09-12T12:24:36.268030+0000","last_undegraded":"2024-09-12T12:24:36.268030+0000","last_fullsized":"2024-09-12T12:24:36.268030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:09.755052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116744+0000","last_change":"2024-09-12T12:22:54.309874+0000","last_active":"2024-09-12T12:25:04.116744+0000","last_peered":"2024-09-12T12:25:04.116744+0000","last_clean":"2024-09-12T12:25:04.116744+0000","last_became_active":"2024-09-12T12:22:54.309294+0000","last_became_peered":"2024-09-12T12:22:54.309294+0000","last_unstale":"2024-09-12T12:25:04.116744+0000","last_undegraded":"2024-09-12T12:25:04.116744+0000","last_fullsized":"2024-09-12T12:25:04.116744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:50.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847221+0000","last_change":"2024-09-12T12:22:51.849467+0000","last_active":"2024-09-12T12:24:35.847221+0000","last_peered":"2024-09-12T12:24:35.847221+0000","last_clean":"2024-09-12T12:24:35.847221+0000","last_became_active":"2024-09-12T12:22:51.849076+0000","last_became_peered":"2024-09-12T12:22:51.849076+0000","last_unstale":"2024-09-12T12:24:35.847221+0000","last_undegraded":"2024-09-12T12:24:35.847221+0000","last_fullsized":"2024-09-12T12:24:35.847221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:04.821105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843557+0000","last_change":"2024-09-12T12:23:35.083542+0000","last_active":"2024-09-12T12:24:35.843557+0000","last_peered":"2024-09-12T12:24:35.843557+0000","last_clean":"2024-09-12T12:24:35.843557+0000","last_became_active":"2024-09-12T12:23:35.083095+0000","last_became_peered":"2024-09-12T12:23:35.083095+0000","last_unstale":"2024-09-12T12:24:35.843557+0000","last_undegraded":"2024-09-12T12:24:35.843557+0000","last_fullsized":"2024-09-12T12:24:35.843557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:06.750223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.121933+0000","last_change":"2024-09-12T12:22:54.315215+0000","last_active":"2024-09-12T12:25:04.121933+0000","last_peered":"2024-09-12T12:25:04.121933+0000","last_clean":"2024-09-12T12:25:04.121933+0000","last_became_active":"2024-09-12T12:22:54.314879+0000","last_became_peered":"2024-09-12T12:22:54.314879+0000","last_unstale":"2024-09-12T12:25:04.121933+0000","last_undegraded":"2024-09-12T12:25:04.121933+0000","last_fullsized":"2024-09-12T12:25:04.121933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:35.501376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'6","reported_seq":282,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.360940+0000","last_change":"2024-09-12T12:22:51.851461+0000","last_active":"2024-09-12T12:25:45.360940+0000","last_peered":"2024-09-12T12:25:45.360940+0000","last_clean":"2024-09-12T12:25:45.360940+0000","last_became_active":"2024-09-12T12:22:51.851105+0000","last_became_peered":"2024-09-12T12:22:51.851105+0000","last_unstale":"2024-09-12T12:25:45.360940+0000","last_undegraded":"2024-09-12T12:25:45.360940+0000","last_fullsized":"2024-09-12T12:25:45.360940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:42.604983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":236,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845020+0000","last_change":"2024-09-12T12:23:03.383308+0000","last_active":"2024-09-12T12:24:35.845020+0000","last_peered":"2024-09-12T12:24:35.845020+0000","last_clean":"2024-09-12T12:24:35.845020+0000","last_became_active":"2024-09-12T12:23:03.382294+0000","last_became_peered":"2024-09-12T12:23:03.382294+0000","last_unstale":"2024-09-12T12:24:35.845020+0000","last_undegraded":"2024-09-12T12:24:35.845020+0000","last_fullsized":"2024-09-12T12:24:35.845020+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:43.920306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846769+0000","last_change":"2024-09-12T12:23:03.386850+0000","last_active":"2024-09-12T12:24:35.846769+0000","last_peered":"2024-09-12T12:24:35.846769+0000","last_clean":"2024-09-12T12:24:35.846769+0000","last_became_active":"2024-09-12T12:23:03.386350+0000","last_became_peered":"2024-09-12T12:23:03.386350+0000","last_unstale":"2024-09-12T12:24:35.846769+0000","last_undegraded":"2024-09-12T12:24:35.846769+0000","last_fullsized":"2024-09-12T12:24:35.846769+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.295745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116408+0000","last_change":"2024-09-12T12:22:54.320709+0000","last_active":"2024-09-12T12:25:04.116408+0000","last_peered":"2024-09-12T12:25:04.116408+0000","last_clean":"2024-09-12T12:25:04.116408+0000","last_became_active":"2024-09-12T12:22:54.320208+0000","last_became_peered":"2024-09-12T12:22:54.320208+0000","last_unstale":"2024-09-12T12:25:04.116408+0000","last_undegraded":"2024-09-12T12:25:04.116408+0000","last_fullsized":"2024-09-12T12:25:04.116408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:45.452449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840308+0000","last_change":"2024-09-12T12:22:51.853047+0000","last_active":"2024-09-12T12:24:35.840308+0000","last_peered":"2024-09-12T12:24:35.840308+0000","last_clean":"2024-09-12T12:24:35.840308+0000","last_became_active":"2024-09-12T12:22:51.852653+0000","last_became_peered":"2024-09-12T12:22:51.852653+0000","last_unstale":"2024-09-12T12:24:35.840308+0000","last_undegraded":"2024-09-12T12:24:35.840308+0000","last_fullsized":"2024-09-12T12:24:35.840308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:39.035009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843207+0000","last_change":"2024-09-12T12:23:03.382997+0000","last_active":"2024-09-12T12:24:35.843207+0000","last_peered":"2024-09-12T12:24:35.843207+0000","last_clean":"2024-09-12T12:24:35.843207+0000","last_became_active":"2024-09-12T12:23:03.382594+0000","last_became_peered":"2024-09-12T12:23:03.382594+0000","last_unstale":"2024-09-12T12:24:35.843207+0000","last_undegraded":"2024-09-12T12:24:35.843207+0000","last_fullsized":"2024-09-12T12:24:35.843207+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:25.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.122806+0000","last_change":"2024-09-12T12:22:54.322595+0000","last_active":"2024-09-12T12:25:04.122806+0000","last_peered":"2024-09-12T12:25:04.122806+0000","last_clean":"2024-09-12T12:25:04.122806+0000","last_became_active":"2024-09-12T12:22:54.320182+0000","last_became_peered":"2024-09-12T12:22:54.320182+0000","last_unstale":"2024-09-12T12:25:04.122806+0000","last_undegraded":"2024-09-12T12:25:04.122806+0000","last_fullsized":"2024-09-12T12:25:04.122806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265174+0000","last_change":"2024-09-12T12:22:51.850045+0000","last_active":"2024-09-12T12:24:36.265174+0000","last_peered":"2024-09-12T12:24:36.265174+0000","last_clean":"2024-09-12T12:24:36.265174+0000","last_became_active":"2024-09-12T12:22:51.849643+0000","last_became_peered":"2024-09-12T12:22:51.849643+0000","last_unstale":"2024-09-12T12:24:36.265174+0000","last_undegraded":"2024-09-12T12:24:36.265174+0000","last_fullsized":"2024-09-12T12:24:36.265174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:18.255368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840542+0000","last_change":"2024-09-12T12:22:51.852692+0000","last_active":"2024-09-12T12:24:35.840542+0000","last_peered":"2024-09-12T12:24:35.840542+0000","last_clean":"2024-09-12T12:24:35.840542+0000","last_became_active":"2024-09-12T12:22:51.852265+0000","last_became_peered":"2024-09-12T12:22:51.852265+0000","last_unstale":"2024-09-12T12:24:35.840542+0000","last_undegraded":"2024-09-12T12:24:35.840542+0000","last_fullsized":"2024-09-12T12:24:35.840542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:55.853073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111746+0000","last_change":"2024-09-12T12:22:54.315519+0000","last_active":"2024-09-12T12:25:04.111746+0000","last_peered":"2024-09-12T12:25:04.111746+0000","last_clean":"2024-09-12T12:25:04.111746+0000","last_became_active":"2024-09-12T12:22:54.315158+0000","last_became_peered":"2024-09-12T12:22:54.315158+0000","last_unstale":"2024-09-12T12:25:04.111746+0000","last_undegraded":"2024-09-12T12:25:04.111746+0000","last_fullsized":"2024-09-12T12:25:04.111746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845873+0000","last_change":"2024-09-12T12:23:03.383443+0000","last_active":"2024-09-12T12:24:35.845873+0000","last_peered":"2024-09-12T12:24:35.845873+0000","last_clean":"2024-09-12T12:24:35.845873+0000","last_became_active":"2024-09-12T12:23:03.382865+0000","last_became_peered":"2024-09-12T12:23:03.382865+0000","last_unstale":"2024-09-12T12:24:35.845873+0000","last_undegraded":"2024-09-12T12:24:35.845873+0000","last_fullsized":"2024-09-12T12:24:35.845873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:26.339910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:46.363863+0000","last_change":"2024-09-12T12:22:51.849963+0000","last_active":"2024-09-12T12:25:46.363863+0000","last_peered":"2024-09-12T12:25:46.363863+0000","last_clean":"2024-09-12T12:25:46.363863+0000","last_became_active":"2024-09-12T12:22:51.849596+0000","last_became_peered":"2024-09-12T12:22:51.849596+0000","last_unstale":"2024-09-12T12:25:46.363863+0000","last_undegraded":"2024-09-12T12:25:46.363863+0000","last_fullsized":"2024-09-12T12:25:46.363863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:48.695657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104951+0000","last_change":"2024-09-12T12:22:54.312543+0000","last_active":"2024-09-12T12:25:04.104951+0000","last_peered":"2024-09-12T12:25:04.104951+0000","last_clean":"2024-09-12T12:25:04.104951+0000","last_became_active":"2024-09-12T12:22:54.312154+0000","last_became_peered":"2024-09-12T12:22:54.312154+0000","last_unstale":"2024-09-12T12:25:04.104951+0000","last_undegraded":"2024-09-12T12:25:04.104951+0000","last_fullsized":"2024-09-12T12:25:04.104951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:28.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846443+0000","last_change":"2024-09-12T12:23:03.376938+0000","last_active":"2024-09-12T12:24:35.846443+0000","last_peered":"2024-09-12T12:24:35.846443+0000","last_clean":"2024-09-12T12:24:35.846443+0000","last_became_active":"2024-09-12T12:23:03.376450+0000","last_became_peered":"2024-09-12T12:23:03.376450+0000","last_unstale":"2024-09-12T12:24:35.846443+0000","last_undegraded":"2024-09-12T12:24:35.846443+0000","last_fullsized":"2024-09-12T12:24:35.846443+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:35.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106500+0000","last_change":"2024-09-12T12:22:54.305562+0000","last_active":"2024-09-12T12:25:04.106500+0000","last_peered":"2024-09-12T12:25:04.106500+0000","last_clean":"2024-09-12T12:25:04.106500+0000","last_became_active":"2024-09-12T12:22:54.305208+0000","last_became_peered":"2024-09-12T12:22:54.305208+0000","last_unstale":"2024-09-12T12:25:04.106500+0000","last_undegraded":"2024-09-12T12:25:04.106500+0000","last_fullsized":"2024-09-12T12:25:04.106500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:46.643949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106018+0000","last_change":"2024-09-12T12:22:54.310634+0000","last_active":"2024-09-12T12:25:04.106018+0000","last_peered":"2024-09-12T12:25:04.106018+0000","last_clean":"2024-09-12T12:25:04.106018+0000","last_became_active":"2024-09-12T12:22:54.310194+0000","last_became_peered":"2024-09-12T12:22:54.310194+0000","last_unstale":"2024-09-12T12:25:04.106018+0000","last_undegraded":"2024-09-12T12:25:04.106018+0000","last_fullsized":"2024-09-12T12:25:04.106018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:05.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.112065+0000","last_change":"2024-09-12T12:22:54.315119+0000","last_active":"2024-09-12T12:25:04.112065+0000","last_peered":"2024-09-12T12:25:04.112065+0000","last_clean":"2024-09-12T12:25:04.112065+0000","last_became_active":"2024-09-12T12:22:54.314729+0000","last_became_peered":"2024-09-12T12:22:54.314729+0000","last_unstale":"2024-09-12T12:25:04.112065+0000","last_undegraded":"2024-09-12T12:25:04.112065+0000","last_fullsized":"2024-09-12T12:25:04.112065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:07.888005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123993+0000","last_change":"2024-09-12T12:23:35.083672+0000","last_active":"2024-09-12T12:25:04.123993+0000","last_peered":"2024-09-12T12:25:04.123993+0000","last_clean":"2024-09-12T12:25:04.123993+0000","last_became_active":"2024-09-12T12:23:35.083222+0000","last_became_peered":"2024-09-12T12:23:35.083222+0000","last_unstale":"2024-09-12T12:25:04.123993+0000","last_undegraded":"2024-09-12T12:25:04.123993+0000","last_fullsized":"2024-09-12T12:25:04.123993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124802+0000","last_change":"2024-09-12T12:22:54.321649+0000","last_active":"2024-09-12T12:25:04.124802+0000","last_peered":"2024-09-12T12:25:04.124802+0000","last_clean":"2024-09-12T12:25:04.124802+0000","last_became_active":"2024-09-12T12:22:54.320859+0000","last_became_peered":"2024-09-12T12:22:54.320859+0000","last_unstale":"2024-09-12T12:25:04.124802+0000","last_undegraded":"2024-09-12T12:25:04.124802+0000","last_fullsized":"2024-09-12T12:25:04.124802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:49.706632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104517+0000","last_change":"2024-09-12T12:22:54.306900+0000","last_active":"2024-09-12T12:25:04.104517+0000","last_peered":"2024-09-12T12:25:04.104517+0000","last_clean":"2024-09-12T12:25:04.104517+0000","last_became_active":"2024-09-12T12:22:54.306432+0000","last_became_peered":"2024-09-12T12:22:54.306432+0000","last_unstale":"2024-09-12T12:25:04.104517+0000","last_undegraded":"2024-09-12T12:25:04.104517+0000","last_fullsized":"2024-09-12T12:25:04.104517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:07.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.110181+0000","last_change":"2024-09-12T12:22:54.318123+0000","last_active":"2024-09-12T12:25:04.110181+0000","last_peered":"2024-09-12T12:25:04.110181+0000","last_clean":"2024-09-12T12:25:04.110181+0000","last_became_active":"2024-09-12T12:22:54.317820+0000","last_became_peered":"2024-09-12T12:22:54.317820+0000","last_unstale":"2024-09-12T12:25:04.110181+0000","last_undegraded":"2024-09-12T12:25:04.110181+0000","last_fullsized":"2024-09-12T12:25:04.110181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:19.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107607+0000","last_change":"2024-09-12T12:22:54.318029+0000","last_active":"2024-09-12T12:25:04.107607+0000","last_peered":"2024-09-12T12:25:04.107607+0000","last_clean":"2024-09-12T12:25:04.107607+0000","last_became_active":"2024-09-12T12:22:54.316015+0000","last_became_peered":"2024-09-12T12:22:54.316015+0000","last_unstale":"2024-09-12T12:25:04.107607+0000","last_undegraded":"2024-09-12T12:25:04.107607+0000","last_fullsized":"2024-09-12T12:25:04.107607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118186+0000","last_change":"2024-09-12T12:22:54.325688+0000","last_active":"2024-09-12T12:25:04.118186+0000","last_peered":"2024-09-12T12:25:04.118186+0000","last_clean":"2024-09-12T12:25:04.118186+0000","last_became_active":"2024-09-12T12:22:54.325375+0000","last_became_peered":"2024-09-12T12:22:54.325375+0000","last_unstale":"2024-09-12T12:25:04.118186+0000","last_undegraded":"2024-09-12T12:25:04.118186+0000","last_fullsized":"2024-09-12T12:25:04.118186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:43.971575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109830+0000","last_change":"2024-09-12T12:22:54.315713+0000","last_active":"2024-09-12T12:25:04.109830+0000","last_peered":"2024-09-12T12:25:04.109830+0000","last_clean":"2024-09-12T12:25:04.109830+0000","last_became_active":"2024-09-12T12:22:54.315401+0000","last_became_peered":"2024-09-12T12:22:54.315401+0000","last_unstale":"2024-09-12T12:25:04.109830+0000","last_undegraded":"2024-09-12T12:25:04.109830+0000","last_fullsized":"2024-09-12T12:25:04.109830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:35:31.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118235+0000","last_change":"2024-09-12T12:22:54.314543+0000","last_active":"2024-09-12T12:25:04.118235+0000","last_peered":"2024-09-12T12:25:04.118235+0000","last_clean":"2024-09-12T12:25:04.118235+0000","last_became_active":"2024-09-12T12:22:54.314216+0000","last_became_peered":"2024-09-12T12:22:54.314216+0000","last_unstale":"2024-09-12T12:25:04.118235+0000","last_undegraded":"2024-09-12T12:25:04.118235+0000","last_fullsized":"2024-09-12T12:25:04.118235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:12.180355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124305+0000","last_change":"2024-09-12T12:22:54.313637+0000","last_active":"2024-09-12T12:25:04.124305+0000","last_peered":"2024-09-12T12:25:04.124305+0000","last_clean":"2024-09-12T12:25:04.124305+0000","last_became_active":"2024-09-12T12:22:54.313327+0000","last_became_peered":"2024-09-12T12:22:54.313327+0000","last_unstale":"2024-09-12T12:25:04.124305+0000","last_undegraded":"2024-09-12T12:25:04.124305+0000","last_fullsized":"2024-09-12T12:25:04.124305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:24.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109135+0000","last_change":"2024-09-12T12:22:54.306018+0000","last_active":"2024-09-12T12:25:04.109135+0000","last_peered":"2024-09-12T12:25:04.109135+0000","last_clean":"2024-09-12T12:25:04.109135+0000","last_became_active":"2024-09-12T12:22:54.305683+0000","last_became_peered":"2024-09-12T12:22:54.305683+0000","last_unstale":"2024-09-12T12:25:04.109135+0000","last_undegraded":"2024-09-12T12:25:04.109135+0000","last_fullsized":"2024-09-12T12:25:04.109135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:00.464765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123634+0000","last_change":"2024-09-12T12:22:54.319169+0000","last_active":"2024-09-12T12:25:04.123634+0000","last_peered":"2024-09-12T12:25:04.123634+0000","last_clean":"2024-09-12T12:25:04.123634+0000","last_became_active":"2024-09-12T12:22:54.318831+0000","last_became_peered":"2024-09-12T12:22:54.318831+0000","last_unstale":"2024-09-12T12:25:04.123634+0000","last_undegraded":"2024-09-12T12:25:04.123634+0000","last_fullsized":"2024-09-12T12:25:04.123634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:42.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.120814+0000","last_change":"2024-09-12T12:22:54.305760+0000","last_active":"2024-09-12T12:25:04.120814+0000","last_peered":"2024-09-12T12:25:04.120814+0000","last_clean":"2024-09-12T12:25:04.120814+0000","last_became_active":"2024-09-12T12:22:54.305455+0000","last_became_peered":"2024-09-12T12:22:54.305455+0000","last_unstale":"2024-09-12T12:25:04.120814+0000","last_undegraded":"2024-09-12T12:25:04.120814+0000","last_fullsized":"2024-09-12T12:25:04.120814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:54.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114429+0000","last_change":"2024-09-12T12:22:54.311420+0000","last_active":"2024-09-12T12:25:04.114429+0000","last_peered":"2024-09-12T12:25:04.114429+0000","last_clean":"2024-09-12T12:25:04.114429+0000","last_became_active":"2024-09-12T12:22:54.311072+0000","last_became_peered":"2024-09-12T12:22:54.311072+0000","last_unstale":"2024-09-12T12:25:04.114429+0000","last_undegraded":"2024-09-12T12:25:04.114429+0000","last_fullsized":"2024-09-12T12:25:04.114429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:54.476587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118981+0000","last_change":"2024-09-12T12:22:54.313093+0000","last_active":"2024-09-12T12:25:04.118981+0000","last_peered":"2024-09-12T12:25:04.118981+0000","last_clean":"2024-09-12T12:25:04.118981+0000","last_became_active":"2024-09-12T12:22:54.312220+0000","last_became_peered":"2024-09-12T12:22:54.312220+0000","last_unstale":"2024-09-12T12:25:04.118981+0000","last_undegraded":"2024-09-12T12:25:04.118981+0000","last_fullsized":"2024-09-12T12:25:04.118981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:33.241798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109467+0000","last_change":"2024-09-12T12:22:54.310536+0000","last_active":"2024-09-12T12:25:04.109467+0000","last_peered":"2024-09-12T12:25:04.109467+0000","last_clean":"2024-09-12T12:25:04.109467+0000","last_became_active":"2024-09-12T12:22:54.310203+0000","last_became_peered":"2024-09-12T12:22:54.310203+0000","last_unstale":"2024-09-12T12:25:04.109467+0000","last_undegraded":"2024-09-12T12:25:04.109467+0000","last_fullsized":"2024-09-12T12:25:04.109467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:40.957367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116751+0000","last_change":"2024-09-12T12:22:54.312898+0000","last_active":"2024-09-12T12:25:04.116751+0000","last_peered":"2024-09-12T12:25:04.116751+0000","last_clean":"2024-09-12T12:25:04.116751+0000","last_became_active":"2024-09-12T12:22:54.312449+0000","last_became_peered":"2024-09-12T12:22:54.312449+0000","last_unstale":"2024-09-12T12:25:04.116751+0000","last_undegraded":"2024-09-12T12:25:04.116751+0000","last_fullsized":"2024-09-12T12:25:04.116751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:57.384949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124720+0000","last_change":"2024-09-12T12:22:54.312206+0000","last_active":"2024-09-12T12:25:04.124720+0000","last_peered":"2024-09-12T12:25:04.124720+0000","last_clean":"2024-09-12T12:25:04.124720+0000","last_became_active":"2024-09-12T12:22:54.311187+0000","last_became_peered":"2024-09-12T12:22:54.311187+0000","last_unstale":"2024-09-12T12:25:04.124720+0000","last_undegraded":"2024-09-12T12:25:04.124720+0000","last_fullsized":"2024-09-12T12:25:04.124720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:22.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.097156+0000","last_change":"2024-09-12T12:22:54.312083+0000","last_active":"2024-09-12T12:25:04.097156+0000","last_peered":"2024-09-12T12:25:04.097156+0000","last_clean":"2024-09-12T12:25:04.097156+0000","last_became_active":"2024-09-12T12:22:54.310716+0000","last_became_peered":"2024-09-12T12:22:54.310716+0000","last_unstale":"2024-09-12T12:25:04.097156+0000","last_undegraded":"2024-09-12T12:25:04.097156+0000","last_fullsized":"2024-09-12T12:25:04.097156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:22.717416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.117943+0000","last_change":"2024-09-12T12:22:54.315088+0000","last_active":"2024-09-12T12:25:04.117943+0000","last_peered":"2024-09-12T12:25:04.117943+0000","last_clean":"2024-09-12T12:25:04.117943+0000","last_became_active":"2024-09-12T12:22:54.314601+0000","last_became_peered":"2024-09-12T12:22:54.314601+0000","last_unstale":"2024-09-12T12:25:04.117943+0000","last_undegraded":"2024-09-12T12:25:04.117943+0000","last_fullsized":"2024-09-12T12:25:04.117943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:35.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.103569+0000","last_change":"2024-09-12T12:22:54.305332+0000","last_active":"2024-09-12T12:25:04.103569+0000","last_peered":"2024-09-12T12:25:04.103569+0000","last_clean":"2024-09-12T12:25:04.103569+0000","last_became_active":"2024-09-12T12:22:54.305017+0000","last_became_peered":"2024-09-12T12:22:54.305017+0000","last_unstale":"2024-09-12T12:25:04.103569+0000","last_undegraded":"2024-09-12T12:25:04.103569+0000","last_fullsized":"2024-09-12T12:25:04.103569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:16.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114402+0000","last_change":"2024-09-12T12:22:54.319768+0000","last_active":"2024-09-12T12:25:04.114402+0000","last_peered":"2024-09-12T12:25:04.114402+0000","last_clean":"2024-09-12T12:25:04.114402+0000","last_became_active":"2024-09-12T12:22:54.319451+0000","last_became_peered":"2024-09-12T12:22:54.319451+0000","last_unstale":"2024-09-12T12:25:04.114402+0000","last_undegraded":"2024-09-12T12:25:04.114402+0000","last_fullsized":"2024-09-12T12:25:04.114402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:56.368891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.108893+0000","last_change":"2024-09-12T12:22:54.323162+0000","last_active":"2024-09-12T12:25:04.108893+0000","last_peered":"2024-09-12T12:25:04.108893+0000","last_clean":"2024-09-12T12:25:04.108893+0000","last_became_active":"2024-09-12T12:22:54.322068+0000","last_became_peered":"2024-09-12T12:22:54.322068+0000","last_unstale":"2024-09-12T12:25:04.108893+0000","last_undegraded":"2024-09-12T12:25:04.108893+0000","last_fullsized":"2024-09-12T12:25:04.108893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:54.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118082+0000","last_change":"2024-09-12T12:22:54.306125+0000","last_active":"2024-09-12T12:25:04.118082+0000","last_peered":"2024-09-12T12:25:04.118082+0000","last_clean":"2024-09-12T12:25:04.118082+0000","last_became_active":"2024-09-12T12:22:54.305790+0000","last_became_peered":"2024-09-12T12:22:54.305790+0000","last_unstale":"2024-09-12T12:25:04.118082+0000","last_undegraded":"2024-09-12T12:25:04.118082+0000","last_fullsized":"2024-09-12T12:25:04.118082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:36.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106172+0000","last_change":"2024-09-12T12:22:54.305099+0000","last_active":"2024-09-12T12:25:04.106172+0000","last_peered":"2024-09-12T12:25:04.106172+0000","last_clean":"2024-09-12T12:25:04.106172+0000","last_became_active":"2024-09-12T12:22:54.304649+0000","last_became_peered":"2024-09-12T12:22:54.304649+0000","last_unstale":"2024-09-12T12:25:04.106172+0000","last_undegraded":"2024-09-12T12:25:04.106172+0000","last_fullsized":"2024-09-12T12:25:04.106172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:05.771434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119410+0000","last_change":"2024-09-12T12:22:54.319247+0000","last_active":"2024-09-12T12:25:04.119410+0000","last_peered":"2024-09-12T12:25:04.119410+0000","last_clean":"2024-09-12T12:25:04.119410+0000","last_became_active":"2024-09-12T12:22:54.318894+0000","last_became_peered":"2024-09-12T12:22:54.318894+0000","last_unstale":"2024-09-12T12:25:04.119410+0000","last_undegraded":"2024-09-12T12:25:04.119410+0000","last_fullsized":"2024-09-12T12:25:04.119410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:55.692071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104860+0000","last_change":"2024-09-12T12:23:35.076997+0000","last_active":"2024-09-12T12:25:04.104860+0000","last_peered":"2024-09-12T12:25:04.104860+0000","last_clean":"2024-09-12T12:25:04.104860+0000","last_became_active":"2024-09-12T12:23:35.076506+0000","last_became_peered":"2024-09-12T12:23:35.076506+0000","last_unstale":"2024-09-12T12:25:04.104860+0000","last_undegraded":"2024-09-12T12:25:04.104860+0000","last_fullsized":"2024-09-12T12:25:04.104860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111898+0000","last_change":"2024-09-12T12:22:54.314298+0000","last_active":"2024-09-12T12:25:04.111898+0000","last_peered":"2024-09-12T12:25:04.111898+0000","last_clean":"2024-09-12T12:25:04.111898+0000","last_became_active":"2024-09-12T12:22:54.311726+0000","last_became_peered":"2024-09-12T12:22:54.311726+0000","last_unstale":"2024-09-12T12:25:04.111898+0000","last_undegraded":"2024-09-12T12:25:04.111898+0000","last_fullsized":"2024-09-12T12:25:04.111898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:13.298082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109460+0000","last_change":"2024-09-12T12:22:54.304397+0000","last_active":"2024-09-12T12:25:04.109460+0000","last_peered":"2024-09-12T12:25:04.109460+0000","last_clean":"2024-09-12T12:25:04.109460+0000","last_became_active":"2024-09-12T12:22:54.304048+0000","last_became_peered":"2024-09-12T12:22:54.304048+0000","last_unstale":"2024-09-12T12:25:04.109460+0000","last_undegraded":"2024-09-12T12:25:04.109460+0000","last_fullsized":"2024-09-12T12:25:04.109460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:13.518433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114189+0000","last_change":"2024-09-12T12:22:54.312229+0000","last_active":"2024-09-12T12:25:04.114189+0000","last_peered":"2024-09-12T12:25:04.114189+0000","last_clean":"2024-09-12T12:25:04.114189+0000","last_became_active":"2024-09-12T12:22:54.311806+0000","last_became_peered":"2024-09-12T12:22:54.311806+0000","last_unstale":"2024-09-12T12:25:04.114189+0000","last_undegraded":"2024-09-12T12:25:04.114189+0000","last_fullsized":"2024-09-12T12:25:04.114189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:28.865595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71338,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1228,"num_read_kb":690,"num_write":259,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":214014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514545,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":533258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743477,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28760,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716392,"statfs":{"total":95995035648,"available":95965585408,"internally_reserved":0,"allocated":1777664,"data_stored":1187284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877907003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":532542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135938,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":532808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397574,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37000,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708152,"statfs":{"total":95995035648,"available":95957147648,"internally_reserved":0,"allocated":1695744,"data_stored":1129337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561100,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":528046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822736,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37008,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708144,"statfs":{"total":95995035648,"available":95957139456,"internally_reserved":0,"allocated":1703936,"data_stored":1124919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953559,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":532120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182491,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":527754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36484,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708668,"statfs":{"total":95995035648,"available":95957676032,"internally_reserved":0,"allocated":1167360,"data_stored":594212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1146880,"data_stored":593147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":530036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:25:52.068 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T12:25:52.068 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 -- 172.21.15.38:0/1446545596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c1023e0 msgr2=0x7f2b3c1047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 --2- 172.21.15.38:0/1446545596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c1023e0 0x7f2b3c1047d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009900 tx=0x7f2b2c02a410 comp rx=0 tx=0).stop 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 -- 172.21.15.38:0/1446545596 shutdown_connections 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 --2- 172.21.15.38:0/1446545596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3c107640 0x7f2b3c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 --2- 172.21.15.38:0/1446545596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b3c104d10 0x7f2b3c107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 --2- 172.21.15.38:0/1446545596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c1023e0 0x7f2b3c1047d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 -- 172.21.15.38:0/1446545596 >> 172.21.15.38:0/1446545596 conn(0x7f2b3c0fc000 msgr2=0x7f2b3c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 -- 172.21.15.38:0/1446545596 shutdown_connections 2024-09-12T12:25:52.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.267+0000 7f2b3be00640 1 -- 172.21.15.38:0/1446545596 wait complete. 2024-09-12T12:25:52.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.268+0000 7f2b3be00640 1 Processor -- start 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.268+0000 7f2b3be00640 1 -- start start 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.268+0000 7f2b3be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b3c1023e0 0x7f2b3c197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.268+0000 7f2b3be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c104d10 0x7f2b3c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.268+0000 7f2b3be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3c107640 0x7f2b3c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b3be00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c10d6a0 con 0x7f2b3c104d10 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b3be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c10d520 con 0x7f2b3c1023e0 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b3be00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c10d820 con 0x7f2b3c107640 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c104d10 0x7f2b3c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c104d10 0x7f2b3c198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41128/0 (socket says 172.21.15.38:41128) 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 -- 172.21.15.38:0/238843595 learned_addr learned my addr 172.21.15.38:0/238843595 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b3b400640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3c107640 0x7f2b3c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b3aa00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b3c1023e0 0x7f2b3c197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 -- 172.21.15.38:0/238843595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3c107640 msgr2=0x7f2b3c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3c107640 0x7f2b3c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 -- 172.21.15.38:0/238843595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b3c1023e0 msgr2=0x7f2b3c197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b3c1023e0 0x7f2b3c197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.269+0000 7f2b32000640 1 -- 172.21.15.38:0/238843595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3c19f920 con 0x7f2b3c104d10 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.270+0000 7f2b32000640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c104d10 0x7f2b3c198250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400e9c0 tx=0x7f2b2400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.270+0000 7f2b33e00640 1 -- 172.21.15.38:0/238843595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400cd80 con 0x7f2b3c104d10 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.270+0000 7f2b33e00640 1 -- 172.21.15.38:0/238843595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b24005500 con 0x7f2b3c104d10 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.270+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3c19fc10 con 0x7f2b3c104d10 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.270+0000 7f2b33e00640 1 -- 172.21.15.38:0/238843595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24010690 con 0x7f2b3c104d10 2024-09-12T12:25:52.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.270+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3c1a0180 con 0x7f2b3c104d10 2024-09-12T12:25:52.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.271+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3c0fdaf0 con 0x7f2b3c104d10 2024-09-12T12:25:52.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.273+0000 7f2b33e00640 1 -- 172.21.15.38:0/238843595 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2b240046c0 con 0x7f2b3c104d10 2024-09-12T12:25:52.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.274+0000 7f2b33e00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b200a2c10 0x7f2b200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.274+0000 7f2b33e00640 1 -- 172.21.15.38:0/238843595 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2b240cf800 con 0x7f2b3c104d10 2024-09-12T12:25:52.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.274+0000 7f2b3aa00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b200a2c10 0x7f2b200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.275+0000 7f2b3aa00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b200a2c10 0x7f2b200a50d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c031440 tx=0x7f2b2c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:52.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.278+0000 7f2b33e00640 1 -- 172.21.15.38:0/238843595 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b2409c350 con 0x7f2b3c104d10 2024-09-12T12:25:52.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.462+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 --> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b3c062630 con 0x7f2b200a2c10 2024-09-12T12:25:52.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:52 smithi038 ceph-mon[30810]: from='client.25271 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:52.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:52 smithi038 ceph-mon[30810]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:52.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.471+0000 7f2b33e00640 1 -- 172.21.15.38:0/238843595 <== mgr.14150 v2:172.21.15.38:6800/1234723065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340551 (secure 0 0 0) 0x7f2b3c062630 con 0x7f2b200a2c10 2024-09-12T12:25:52.475 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:52.482 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-12T12:25:52.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b200a2c10 msgr2=0x7f2b200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b200a2c10 0x7f2b200a50d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c031440 tx=0x7f2b2c0315b0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c104d10 msgr2=0x7f2b3c198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c104d10 0x7f2b3c198250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400e9c0 tx=0x7f2b2400ee80 comp rx=0 tx=0).stop 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 shutdown_connections 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2b200a2c10 0x7f2b200a50d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3c107640 0x7f2b3c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b3c104d10 0x7f2b3c198250 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 --2- 172.21.15.38:0/238843595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b3c1023e0 0x7f2b3c197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.475+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 >> 172.21.15.38:0/238843595 conn(0x7f2b3c0fc000 msgr2=0x7f2b3c102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.476+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 shutdown_connections 2024-09-12T12:25:52.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:52.476+0000 7f2b3be00640 1 -- 172.21.15.38:0/238843595 wait complete. 2024-09-12T12:25:52.491 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2024-09-12T12:25:52.119339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666254,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1391,"num_read_kb":830,"num_write":443,"num_write_kb":3096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388984,"kb_used_data":14776,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552840,"statfs":{"total":1151940427776,"available":1151542108160,"internally_reserved":0,"allocated":15130624,"data_stored":8354402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4936,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":82,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003203"},"pg_stats":[{"pgid":"2.1f","version":"91'13","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:50.367076+0000","last_change":"2024-09-12T12:22:51.847865+0000","last_active":"2024-09-12T12:25:50.367076+0000","last_peered":"2024-09-12T12:25:50.367076+0000","last_clean":"2024-09-12T12:25:50.367076+0000","last_became_active":"2024-09-12T12:22:51.847437+0000","last_became_peered":"2024-09-12T12:22:51.847437+0000","last_unstale":"2024-09-12T12:25:50.367076+0000","last_undegraded":"2024-09-12T12:25:50.367076+0000","last_fullsized":"2024-09-12T12:25:50.367076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:49:34.486264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.095342+0000","last_change":"2024-09-12T12:22:54.316759+0000","last_active":"2024-09-12T12:25:04.095342+0000","last_peered":"2024-09-12T12:25:04.095342+0000","last_clean":"2024-09-12T12:25:04.095342+0000","last_became_active":"2024-09-12T12:22:54.315906+0000","last_became_peered":"2024-09-12T12:22:54.315906+0000","last_unstale":"2024-09-12T12:25:04.095342+0000","last_undegraded":"2024-09-12T12:25:04.095342+0000","last_fullsized":"2024-09-12T12:25:04.095342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:54.465835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845553+0000","last_change":"2024-09-12T12:23:03.387327+0000","last_active":"2024-09-12T12:24:35.845553+0000","last_peered":"2024-09-12T12:24:35.845553+0000","last_clean":"2024-09-12T12:24:35.845553+0000","last_became_active":"2024-09-12T12:23:03.386929+0000","last_became_peered":"2024-09-12T12:23:03.386929+0000","last_unstale":"2024-09-12T12:24:35.845553+0000","last_undegraded":"2024-09-12T12:24:35.845553+0000","last_fullsized":"2024-09-12T12:24:35.845553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.033999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845672+0000","last_change":"2024-09-12T12:22:51.990331+0000","last_active":"2024-09-12T12:24:35.845672+0000","last_peered":"2024-09-12T12:24:35.845672+0000","last_clean":"2024-09-12T12:24:35.845672+0000","last_became_active":"2024-09-12T12:22:51.989844+0000","last_became_peered":"2024-09-12T12:22:51.989844+0000","last_unstale":"2024-09-12T12:24:35.845672+0000","last_undegraded":"2024-09-12T12:24:35.845672+0000","last_fullsized":"2024-09-12T12:24:35.845672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:47.773447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115744+0000","last_change":"2024-09-12T12:22:54.317141+0000","last_active":"2024-09-12T12:25:04.115744+0000","last_peered":"2024-09-12T12:25:04.115744+0000","last_clean":"2024-09-12T12:25:04.115744+0000","last_became_active":"2024-09-12T12:22:54.312292+0000","last_became_peered":"2024-09-12T12:22:54.312292+0000","last_unstale":"2024-09-12T12:25:04.115744+0000","last_undegraded":"2024-09-12T12:25:04.115744+0000","last_fullsized":"2024-09-12T12:25:04.115744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:05.943100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267584+0000","last_change":"2024-09-12T12:23:03.379532+0000","last_active":"2024-09-12T12:24:36.267584+0000","last_peered":"2024-09-12T12:24:36.267584+0000","last_clean":"2024-09-12T12:24:36.267584+0000","last_became_active":"2024-09-12T12:23:03.379087+0000","last_became_peered":"2024-09-12T12:23:03.379087+0000","last_unstale":"2024-09-12T12:24:36.267584+0000","last_undegraded":"2024-09-12T12:24:36.267584+0000","last_fullsized":"2024-09-12T12:24:36.267584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.971474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.279148+0000","last_change":"2024-09-12T12:24:36.278754+0000","last_active":"2024-09-12T12:24:36.279148+0000","last_peered":"2024-09-12T12:24:36.279148+0000","last_clean":"2024-09-12T12:24:36.279148+0000","last_became_active":"2024-09-12T12:24:36.269065+0000","last_became_peered":"2024-09-12T12:24:36.269065+0000","last_unstale":"2024-09-12T12:24:36.279148+0000","last_undegraded":"2024-09-12T12:24:36.279148+0000","last_fullsized":"2024-09-12T12:24:36.279148+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:12.224802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125655+0000","last_change":"2024-09-12T12:22:54.315178+0000","last_active":"2024-09-12T12:25:04.125655+0000","last_peered":"2024-09-12T12:25:04.125655+0000","last_clean":"2024-09-12T12:25:04.125655+0000","last_became_active":"2024-09-12T12:22:54.314408+0000","last_became_peered":"2024-09-12T12:22:54.314408+0000","last_unstale":"2024-09-12T12:25:04.125655+0000","last_undegraded":"2024-09-12T12:25:04.125655+0000","last_fullsized":"2024-09-12T12:25:04.125655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268083+0000","last_change":"2024-09-12T12:23:03.384629+0000","last_active":"2024-09-12T12:24:36.268083+0000","last_peered":"2024-09-12T12:24:36.268083+0000","last_clean":"2024-09-12T12:24:36.268083+0000","last_became_active":"2024-09-12T12:23:03.383750+0000","last_became_peered":"2024-09-12T12:23:03.383750+0000","last_unstale":"2024-09-12T12:24:36.268083+0000","last_undegraded":"2024-09-12T12:24:36.268083+0000","last_fullsized":"2024-09-12T12:24:36.268083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:24.377269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844538+0000","last_change":"2024-09-12T12:22:51.847561+0000","last_active":"2024-09-12T12:24:35.844538+0000","last_peered":"2024-09-12T12:24:35.844538+0000","last_clean":"2024-09-12T12:24:35.844538+0000","last_became_active":"2024-09-12T12:22:51.846862+0000","last_became_peered":"2024-09-12T12:22:51.846862+0000","last_unstale":"2024-09-12T12:24:35.844538+0000","last_undegraded":"2024-09-12T12:24:35.844538+0000","last_fullsized":"2024-09-12T12:24:35.844538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:37.907652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107286+0000","last_change":"2024-09-12T12:22:54.313493+0000","last_active":"2024-09-12T12:25:04.107286+0000","last_peered":"2024-09-12T12:25:04.107286+0000","last_clean":"2024-09-12T12:25:04.107286+0000","last_became_active":"2024-09-12T12:22:54.313115+0000","last_became_peered":"2024-09-12T12:22:54.313115+0000","last_unstale":"2024-09-12T12:25:04.107286+0000","last_undegraded":"2024-09-12T12:25:04.107286+0000","last_fullsized":"2024-09-12T12:25:04.107286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:39.631537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267750+0000","last_change":"2024-09-12T12:23:03.383997+0000","last_active":"2024-09-12T12:24:36.267750+0000","last_peered":"2024-09-12T12:24:36.267750+0000","last_clean":"2024-09-12T12:24:36.267750+0000","last_became_active":"2024-09-12T12:23:03.382952+0000","last_became_peered":"2024-09-12T12:23:03.382952+0000","last_unstale":"2024-09-12T12:24:36.267750+0000","last_undegraded":"2024-09-12T12:24:36.267750+0000","last_fullsized":"2024-09-12T12:24:36.267750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:37.949848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124206+0000","last_change":"2024-09-12T12:22:54.311875+0000","last_active":"2024-09-12T12:25:04.124206+0000","last_peered":"2024-09-12T12:25:04.124206+0000","last_clean":"2024-09-12T12:25:04.124206+0000","last_became_active":"2024-09-12T12:22:54.311301+0000","last_became_peered":"2024-09-12T12:22:54.311301+0000","last_unstale":"2024-09-12T12:25:04.124206+0000","last_undegraded":"2024-09-12T12:25:04.124206+0000","last_fullsized":"2024-09-12T12:25:04.124206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:47.022563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844056+0000","last_change":"2024-09-12T12:22:51.849400+0000","last_active":"2024-09-12T12:24:35.844056+0000","last_peered":"2024-09-12T12:24:35.844056+0000","last_clean":"2024-09-12T12:24:35.844056+0000","last_became_active":"2024-09-12T12:22:51.848295+0000","last_became_peered":"2024-09-12T12:22:51.848295+0000","last_unstale":"2024-09-12T12:24:35.844056+0000","last_undegraded":"2024-09-12T12:24:35.844056+0000","last_fullsized":"2024-09-12T12:24:35.844056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268139+0000","last_change":"2024-09-12T12:23:03.779217+0000","last_active":"2024-09-12T12:24:36.268139+0000","last_peered":"2024-09-12T12:24:36.268139+0000","last_clean":"2024-09-12T12:24:36.268139+0000","last_became_active":"2024-09-12T12:23:03.778732+0000","last_became_peered":"2024-09-12T12:23:03.778732+0000","last_unstale":"2024-09-12T12:24:36.268139+0000","last_undegraded":"2024-09-12T12:24:36.268139+0000","last_fullsized":"2024-09-12T12:24:36.268139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:49.676157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119742+0000","last_change":"2024-09-12T12:22:54.323222+0000","last_active":"2024-09-12T12:25:04.119742+0000","last_peered":"2024-09-12T12:25:04.119742+0000","last_clean":"2024-09-12T12:25:04.119742+0000","last_became_active":"2024-09-12T12:22:54.321035+0000","last_became_peered":"2024-09-12T12:22:54.321035+0000","last_unstale":"2024-09-12T12:25:04.119742+0000","last_undegraded":"2024-09-12T12:25:04.119742+0000","last_fullsized":"2024-09-12T12:25:04.119742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:04.533418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:37.742255+0000","last_change":"2024-09-12T12:24:35.850509+0000","last_active":"2024-09-12T12:24:37.742255+0000","last_peered":"2024-09-12T12:24:37.742255+0000","last_clean":"2024-09-12T12:24:37.742255+0000","last_became_active":"2024-09-12T12:24:35.846578+0000","last_became_peered":"2024-09-12T12:24:35.846578+0000","last_unstale":"2024-09-12T12:24:37.742255+0000","last_undegraded":"2024-09-12T12:24:37.742255+0000","last_fullsized":"2024-09-12T12:24:37.742255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:10.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267896+0000","last_change":"2024-09-12T12:23:35.079820+0000","last_active":"2024-09-12T12:24:36.267896+0000","last_peered":"2024-09-12T12:24:36.267896+0000","last_clean":"2024-09-12T12:24:36.267896+0000","last_became_active":"2024-09-12T12:23:35.079362+0000","last_became_peered":"2024-09-12T12:23:35.079362+0000","last_unstale":"2024-09-12T12:24:36.267896+0000","last_undegraded":"2024-09-12T12:24:36.267896+0000","last_fullsized":"2024-09-12T12:24:36.267896+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:22.713646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.113669+0000","last_change":"2024-09-12T12:22:54.307950+0000","last_active":"2024-09-12T12:25:04.113669+0000","last_peered":"2024-09-12T12:25:04.113669+0000","last_clean":"2024-09-12T12:25:04.113669+0000","last_became_active":"2024-09-12T12:22:54.307595+0000","last_became_peered":"2024-09-12T12:22:54.307595+0000","last_unstale":"2024-09-12T12:25:04.113669+0000","last_undegraded":"2024-09-12T12:25:04.113669+0000","last_fullsized":"2024-09-12T12:25:04.113669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:11.150312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845284+0000","last_change":"2024-09-12T12:22:51.851424+0000","last_active":"2024-09-12T12:24:35.845284+0000","last_peered":"2024-09-12T12:24:35.845284+0000","last_clean":"2024-09-12T12:24:35.845284+0000","last_became_active":"2024-09-12T12:22:51.851043+0000","last_became_peered":"2024-09-12T12:22:51.851043+0000","last_unstale":"2024-09-12T12:24:35.845284+0000","last_undegraded":"2024-09-12T12:24:35.845284+0000","last_fullsized":"2024-09-12T12:24:35.845284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841205+0000","last_change":"2024-09-12T12:23:03.381773+0000","last_active":"2024-09-12T12:24:35.841205+0000","last_peered":"2024-09-12T12:24:35.841205+0000","last_clean":"2024-09-12T12:24:35.841205+0000","last_became_active":"2024-09-12T12:23:03.378442+0000","last_became_peered":"2024-09-12T12:23:03.378442+0000","last_unstale":"2024-09-12T12:24:35.841205+0000","last_undegraded":"2024-09-12T12:24:35.841205+0000","last_fullsized":"2024-09-12T12:24:35.841205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.570787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.085994+0000","last_change":"2024-09-12T12:22:54.310010+0000","last_active":"2024-09-12T12:25:04.085994+0000","last_peered":"2024-09-12T12:25:04.085994+0000","last_clean":"2024-09-12T12:25:04.085994+0000","last_became_active":"2024-09-12T12:22:54.309499+0000","last_became_peered":"2024-09-12T12:22:54.309499+0000","last_unstale":"2024-09-12T12:25:04.085994+0000","last_undegraded":"2024-09-12T12:25:04.085994+0000","last_fullsized":"2024-09-12T12:25:04.085994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.456842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.453985+0000","last_change":"2024-09-12T12:22:51.990294+0000","last_active":"2024-09-12T12:24:36.453985+0000","last_peered":"2024-09-12T12:24:36.453985+0000","last_clean":"2024-09-12T12:24:36.453985+0000","last_became_active":"2024-09-12T12:22:51.989925+0000","last_became_peered":"2024-09-12T12:22:51.989925+0000","last_unstale":"2024-09-12T12:24:36.453985+0000","last_undegraded":"2024-09-12T12:24:36.453985+0000","last_fullsized":"2024-09-12T12:24:36.453985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:56.754802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267961+0000","last_change":"2024-09-12T12:23:03.780256+0000","last_active":"2024-09-12T12:24:36.267961+0000","last_peered":"2024-09-12T12:24:36.267961+0000","last_clean":"2024-09-12T12:24:36.267961+0000","last_became_active":"2024-09-12T12:23:03.779808+0000","last_became_peered":"2024-09-12T12:23:03.779808+0000","last_unstale":"2024-09-12T12:24:36.267961+0000","last_undegraded":"2024-09-12T12:24:36.267961+0000","last_fullsized":"2024-09-12T12:24:36.267961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:58.236749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115819+0000","last_change":"2024-09-12T12:23:35.084287+0000","last_active":"2024-09-12T12:25:04.115819+0000","last_peered":"2024-09-12T12:25:04.115819+0000","last_clean":"2024-09-12T12:25:04.115819+0000","last_became_active":"2024-09-12T12:23:35.083828+0000","last_became_peered":"2024-09-12T12:23:35.083828+0000","last_unstale":"2024-09-12T12:25:04.115819+0000","last_undegraded":"2024-09-12T12:25:04.115819+0000","last_fullsized":"2024-09-12T12:25:04.115819+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:36.183575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268345+0000","last_change":"2024-09-12T12:22:52.557264+0000","last_active":"2024-09-12T12:24:36.268345+0000","last_peered":"2024-09-12T12:24:36.268345+0000","last_clean":"2024-09-12T12:24:36.268345+0000","last_became_active":"2024-09-12T12:22:52.556783+0000","last_became_peered":"2024-09-12T12:22:52.556783+0000","last_unstale":"2024-09-12T12:24:36.268345+0000","last_undegraded":"2024-09-12T12:24:36.268345+0000","last_fullsized":"2024-09-12T12:24:36.268345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:08.815983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845595+0000","last_change":"2024-09-12T12:23:03.376129+0000","last_active":"2024-09-12T12:24:35.845595+0000","last_peered":"2024-09-12T12:24:35.845595+0000","last_clean":"2024-09-12T12:24:35.845595+0000","last_became_active":"2024-09-12T12:23:03.375200+0000","last_became_peered":"2024-09-12T12:23:03.375200+0000","last_unstale":"2024-09-12T12:24:35.845595+0000","last_undegraded":"2024-09-12T12:24:35.845595+0000","last_fullsized":"2024-09-12T12:24:35.845595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.418366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111408+0000","last_change":"2024-09-12T12:22:54.314708+0000","last_active":"2024-09-12T12:25:04.111408+0000","last_peered":"2024-09-12T12:25:04.111408+0000","last_clean":"2024-09-12T12:25:04.111408+0000","last_became_active":"2024-09-12T12:22:54.314304+0000","last_became_peered":"2024-09-12T12:22:54.314304+0000","last_unstale":"2024-09-12T12:25:04.111408+0000","last_undegraded":"2024-09-12T12:25:04.111408+0000","last_fullsized":"2024-09-12T12:25:04.111408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:52.198831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'16","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.327501+0000","last_change":"2024-09-12T12:22:51.846753+0000","last_active":"2024-09-12T12:25:04.327501+0000","last_peered":"2024-09-12T12:25:04.327501+0000","last_clean":"2024-09-12T12:25:04.327501+0000","last_became_active":"2024-09-12T12:22:51.846388+0000","last_became_peered":"2024-09-12T12:22:51.846388+0000","last_unstale":"2024-09-12T12:25:04.327501+0000","last_undegraded":"2024-09-12T12:25:04.327501+0000","last_fullsized":"2024-09-12T12:25:04.327501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:34.511644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844866+0000","last_change":"2024-09-12T12:23:03.779254+0000","last_active":"2024-09-12T12:24:35.844866+0000","last_peered":"2024-09-12T12:24:35.844866+0000","last_clean":"2024-09-12T12:24:35.844866+0000","last_became_active":"2024-09-12T12:23:03.778801+0000","last_became_peered":"2024-09-12T12:23:03.778801+0000","last_unstale":"2024-09-12T12:24:35.844866+0000","last_undegraded":"2024-09-12T12:24:35.844866+0000","last_fullsized":"2024-09-12T12:24:35.844866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.121722+0000","last_change":"2024-09-12T12:22:54.312002+0000","last_active":"2024-09-12T12:25:04.121722+0000","last_peered":"2024-09-12T12:25:04.121722+0000","last_clean":"2024-09-12T12:25:04.121722+0000","last_became_active":"2024-09-12T12:22:54.311670+0000","last_became_peered":"2024-09-12T12:22:54.311670+0000","last_unstale":"2024-09-12T12:25:04.121722+0000","last_undegraded":"2024-09-12T12:25:04.121722+0000","last_fullsized":"2024-09-12T12:25:04.121722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:08.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.856791+0000","last_change":"2024-09-12T12:24:35.856332+0000","last_active":"2024-09-12T12:24:35.856791+0000","last_peered":"2024-09-12T12:24:35.856791+0000","last_clean":"2024-09-12T12:24:35.856791+0000","last_became_active":"2024-09-12T12:24:35.846638+0000","last_became_peered":"2024-09-12T12:24:35.846638+0000","last_unstale":"2024-09-12T12:24:35.856791+0000","last_undegraded":"2024-09-12T12:24:35.856791+0000","last_fullsized":"2024-09-12T12:24:35.856791+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.181686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.842993+0000","last_change":"2024-09-12T12:23:03.379901+0000","last_active":"2024-09-12T12:24:35.842993+0000","last_peered":"2024-09-12T12:24:35.842993+0000","last_clean":"2024-09-12T12:24:35.842993+0000","last_became_active":"2024-09-12T12:23:03.379385+0000","last_became_peered":"2024-09-12T12:23:03.379385+0000","last_unstale":"2024-09-12T12:24:35.842993+0000","last_undegraded":"2024-09-12T12:24:35.842993+0000","last_fullsized":"2024-09-12T12:24:35.842993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:47.939223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123208+0000","last_change":"2024-09-12T12:22:54.316450+0000","last_active":"2024-09-12T12:25:04.123208+0000","last_peered":"2024-09-12T12:25:04.123208+0000","last_clean":"2024-09-12T12:25:04.123208+0000","last_became_active":"2024-09-12T12:22:54.316058+0000","last_became_peered":"2024-09-12T12:22:54.316058+0000","last_unstale":"2024-09-12T12:25:04.123208+0000","last_undegraded":"2024-09-12T12:25:04.123208+0000","last_fullsized":"2024-09-12T12:25:04.123208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:38.830408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841156+0000","last_change":"2024-09-12T12:22:51.992564+0000","last_active":"2024-09-12T12:24:35.841156+0000","last_peered":"2024-09-12T12:24:35.841156+0000","last_clean":"2024-09-12T12:24:35.841156+0000","last_became_active":"2024-09-12T12:22:51.992012+0000","last_became_peered":"2024-09-12T12:22:51.992012+0000","last_unstale":"2024-09-12T12:24:35.841156+0000","last_undegraded":"2024-09-12T12:24:35.841156+0000","last_fullsized":"2024-09-12T12:24:35.841156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:26.190486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843880+0000","last_change":"2024-09-12T12:23:03.779309+0000","last_active":"2024-09-12T12:24:35.843880+0000","last_peered":"2024-09-12T12:24:35.843880+0000","last_clean":"2024-09-12T12:24:35.843880+0000","last_became_active":"2024-09-12T12:23:03.778812+0000","last_became_peered":"2024-09-12T12:23:03.778812+0000","last_unstale":"2024-09-12T12:24:35.843880+0000","last_undegraded":"2024-09-12T12:24:35.843880+0000","last_fullsized":"2024-09-12T12:24:35.843880+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:56.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.115436+0000","last_change":"2024-09-12T12:22:54.309745+0000","last_active":"2024-09-12T12:25:04.115436+0000","last_peered":"2024-09-12T12:25:04.115436+0000","last_clean":"2024-09-12T12:25:04.115436+0000","last_became_active":"2024-09-12T12:22:54.309388+0000","last_became_peered":"2024-09-12T12:22:54.309388+0000","last_unstale":"2024-09-12T12:25:04.115436+0000","last_undegraded":"2024-09-12T12:25:04.115436+0000","last_fullsized":"2024-09-12T12:25:04.115436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.268141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:45.360609+0000","last_change":"2024-09-12T12:22:51.850494+0000","last_active":"2024-09-12T12:25:45.360609+0000","last_peered":"2024-09-12T12:25:45.360609+0000","last_clean":"2024-09-12T12:25:45.360609+0000","last_became_active":"2024-09-12T12:22:51.849071+0000","last_became_peered":"2024-09-12T12:22:51.849071+0000","last_unstale":"2024-09-12T12:25:45.360609+0000","last_undegraded":"2024-09-12T12:25:45.360609+0000","last_fullsized":"2024-09-12T12:25:45.360609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:19.203267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265150+0000","last_change":"2024-09-12T12:23:03.383096+0000","last_active":"2024-09-12T12:24:36.265150+0000","last_peered":"2024-09-12T12:24:36.265150+0000","last_clean":"2024-09-12T12:24:36.265150+0000","last_became_active":"2024-09-12T12:23:03.382261+0000","last_became_peered":"2024-09-12T12:23:03.382261+0000","last_unstale":"2024-09-12T12:24:36.265150+0000","last_undegraded":"2024-09-12T12:24:36.265150+0000","last_fullsized":"2024-09-12T12:24:36.265150+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:08.976679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.103037+0000","last_change":"2024-09-12T12:23:35.079333+0000","last_active":"2024-09-12T12:25:04.103037+0000","last_peered":"2024-09-12T12:25:04.103037+0000","last_clean":"2024-09-12T12:25:04.103037+0000","last_became_active":"2024-09-12T12:23:35.078908+0000","last_became_peered":"2024-09-12T12:23:35.078908+0000","last_unstale":"2024-09-12T12:25:04.103037+0000","last_undegraded":"2024-09-12T12:25:04.103037+0000","last_fullsized":"2024-09-12T12:25:04.103037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:55:59.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:50.367135+0000","last_change":"2024-09-12T12:22:51.990322+0000","last_active":"2024-09-12T12:25:50.367135+0000","last_peered":"2024-09-12T12:25:50.367135+0000","last_clean":"2024-09-12T12:25:50.367135+0000","last_became_active":"2024-09-12T12:22:51.989970+0000","last_became_peered":"2024-09-12T12:22:51.989970+0000","last_unstale":"2024-09-12T12:25:50.367135+0000","last_undegraded":"2024-09-12T12:25:50.367135+0000","last_fullsized":"2024-09-12T12:25:50.367135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:46:14.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265419+0000","last_change":"2024-09-12T12:23:35.083806+0000","last_active":"2024-09-12T12:24:36.265419+0000","last_peered":"2024-09-12T12:24:36.265419+0000","last_clean":"2024-09-12T12:24:36.265419+0000","last_became_active":"2024-09-12T12:23:35.083379+0000","last_became_peered":"2024-09-12T12:23:35.083379+0000","last_unstale":"2024-09-12T12:24:36.265419+0000","last_undegraded":"2024-09-12T12:24:36.265419+0000","last_fullsized":"2024-09-12T12:24:36.265419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:54.146429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119046+0000","last_change":"2024-09-12T12:22:54.305747+0000","last_active":"2024-09-12T12:25:04.119046+0000","last_peered":"2024-09-12T12:25:04.119046+0000","last_clean":"2024-09-12T12:25:04.119046+0000","last_became_active":"2024-09-12T12:22:54.305423+0000","last_became_peered":"2024-09-12T12:22:54.305423+0000","last_unstale":"2024-09-12T12:25:04.119046+0000","last_undegraded":"2024-09-12T12:25:04.119046+0000","last_fullsized":"2024-09-12T12:25:04.119046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.463661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846664+0000","last_change":"2024-09-12T12:22:51.852216+0000","last_active":"2024-09-12T12:24:35.846664+0000","last_peered":"2024-09-12T12:24:35.846664+0000","last_clean":"2024-09-12T12:24:35.846664+0000","last_became_active":"2024-09-12T12:22:51.850495+0000","last_became_peered":"2024-09-12T12:22:51.850495+0000","last_unstale":"2024-09-12T12:24:35.846664+0000","last_undegraded":"2024-09-12T12:24:35.846664+0000","last_fullsized":"2024-09-12T12:24:35.846664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:51.711697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840677+0000","last_change":"2024-09-12T12:23:35.118914+0000","last_active":"2024-09-12T12:24:35.840677+0000","last_peered":"2024-09-12T12:24:35.840677+0000","last_clean":"2024-09-12T12:24:35.840677+0000","last_became_active":"2024-09-12T12:23:35.118411+0000","last_became_peered":"2024-09-12T12:23:35.118411+0000","last_unstale":"2024-09-12T12:24:35.840677+0000","last_undegraded":"2024-09-12T12:24:35.840677+0000","last_fullsized":"2024-09-12T12:24:35.840677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:08.350538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109066+0000","last_change":"2024-09-12T12:22:54.320573+0000","last_active":"2024-09-12T12:25:04.109066+0000","last_peered":"2024-09-12T12:25:04.109066+0000","last_clean":"2024-09-12T12:25:04.109066+0000","last_became_active":"2024-09-12T12:22:54.320120+0000","last_became_peered":"2024-09-12T12:22:54.320120+0000","last_unstale":"2024-09-12T12:25:04.109066+0000","last_undegraded":"2024-09-12T12:25:04.109066+0000","last_fullsized":"2024-09-12T12:25:04.109066+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:35.490584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.267023+0000","last_change":"2024-09-12T12:22:51.851098+0000","last_active":"2024-09-12T12:24:36.267023+0000","last_peered":"2024-09-12T12:24:36.267023+0000","last_clean":"2024-09-12T12:24:36.267023+0000","last_became_active":"2024-09-12T12:22:51.850725+0000","last_became_peered":"2024-09-12T12:22:51.850725+0000","last_unstale":"2024-09-12T12:24:36.267023+0000","last_undegraded":"2024-09-12T12:24:36.267023+0000","last_fullsized":"2024-09-12T12:24:36.267023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:18.308742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846840+0000","last_change":"2024-09-12T12:21:34.312000+0000","last_active":"2024-09-12T12:24:35.846840+0000","last_peered":"2024-09-12T12:24:35.846840+0000","last_clean":"2024-09-12T12:24:35.846840+0000","last_became_active":"2024-09-12T12:21:34.311472+0000","last_became_peered":"2024-09-12T12:21:34.311472+0000","last_unstale":"2024-09-12T12:24:35.846840+0000","last_undegraded":"2024-09-12T12:24:35.846840+0000","last_fullsized":"2024-09-12T12:24:35.846840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:58.852566+0000","last_clean_scrub_stamp":"2024-09-12T12:17:58.852566+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847001+0000","last_change":"2024-09-12T12:23:03.387802+0000","last_active":"2024-09-12T12:24:35.847001+0000","last_peered":"2024-09-12T12:24:35.847001+0000","last_clean":"2024-09-12T12:24:35.847001+0000","last_became_active":"2024-09-12T12:23:03.387391+0000","last_became_peered":"2024-09-12T12:23:03.387391+0000","last_unstale":"2024-09-12T12:24:35.847001+0000","last_undegraded":"2024-09-12T12:24:35.847001+0000","last_fullsized":"2024-09-12T12:24:35.847001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:24.741915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118292+0000","last_change":"2024-09-12T12:22:54.314326+0000","last_active":"2024-09-12T12:25:04.118292+0000","last_peered":"2024-09-12T12:25:04.118292+0000","last_clean":"2024-09-12T12:25:04.118292+0000","last_became_active":"2024-09-12T12:22:54.313892+0000","last_became_peered":"2024-09-12T12:22:54.313892+0000","last_unstale":"2024-09-12T12:25:04.118292+0000","last_undegraded":"2024-09-12T12:25:04.118292+0000","last_fullsized":"2024-09-12T12:25:04.118292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:50.980891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'7","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:50.368266+0000","last_change":"2024-09-12T12:22:52.557126+0000","last_active":"2024-09-12T12:25:50.368266+0000","last_peered":"2024-09-12T12:25:50.368266+0000","last_clean":"2024-09-12T12:25:50.368266+0000","last_became_active":"2024-09-12T12:22:52.556736+0000","last_became_peered":"2024-09-12T12:22:52.556736+0000","last_unstale":"2024-09-12T12:25:50.368266+0000","last_undegraded":"2024-09-12T12:25:50.368266+0000","last_fullsized":"2024-09-12T12:25:50.368266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:09.199871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.454196+0000","last_change":"2024-09-12T12:23:03.380117+0000","last_active":"2024-09-12T12:24:36.454196+0000","last_peered":"2024-09-12T12:24:36.454196+0000","last_clean":"2024-09-12T12:24:36.454196+0000","last_became_active":"2024-09-12T12:23:03.379635+0000","last_became_peered":"2024-09-12T12:23:03.379635+0000","last_unstale":"2024-09-12T12:24:36.454196+0000","last_undegraded":"2024-09-12T12:24:36.454196+0000","last_fullsized":"2024-09-12T12:24:36.454196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:23.227681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116460+0000","last_change":"2024-09-12T12:22:54.316010+0000","last_active":"2024-09-12T12:25:04.116460+0000","last_peered":"2024-09-12T12:25:04.116460+0000","last_clean":"2024-09-12T12:25:04.116460+0000","last_became_active":"2024-09-12T12:22:54.315702+0000","last_became_peered":"2024-09-12T12:22:54.315702+0000","last_unstale":"2024-09-12T12:25:04.116460+0000","last_undegraded":"2024-09-12T12:25:04.116460+0000","last_fullsized":"2024-09-12T12:25:04.116460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:52.370650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840843+0000","last_change":"2024-09-12T12:22:51.854456+0000","last_active":"2024-09-12T12:24:35.840843+0000","last_peered":"2024-09-12T12:24:35.840843+0000","last_clean":"2024-09-12T12:24:35.840843+0000","last_became_active":"2024-09-12T12:22:51.854092+0000","last_became_peered":"2024-09-12T12:22:51.854092+0000","last_unstale":"2024-09-12T12:24:35.840843+0000","last_undegraded":"2024-09-12T12:24:35.840843+0000","last_fullsized":"2024-09-12T12:24:35.840843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:57.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846546+0000","last_change":"2024-09-12T12:23:03.390443+0000","last_active":"2024-09-12T12:24:35.846546+0000","last_peered":"2024-09-12T12:24:35.846546+0000","last_clean":"2024-09-12T12:24:35.846546+0000","last_became_active":"2024-09-12T12:23:03.389825+0000","last_became_peered":"2024-09-12T12:23:03.389825+0000","last_unstale":"2024-09-12T12:24:35.846546+0000","last_undegraded":"2024-09-12T12:24:35.846546+0000","last_fullsized":"2024-09-12T12:24:35.846546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.711075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.112283+0000","last_change":"2024-09-12T12:22:54.311694+0000","last_active":"2024-09-12T12:25:04.112283+0000","last_peered":"2024-09-12T12:25:04.112283+0000","last_clean":"2024-09-12T12:25:04.112283+0000","last_became_active":"2024-09-12T12:22:54.311381+0000","last_became_peered":"2024-09-12T12:22:54.311381+0000","last_unstale":"2024-09-12T12:25:04.112283+0000","last_undegraded":"2024-09-12T12:25:04.112283+0000","last_fullsized":"2024-09-12T12:25:04.112283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.378495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.264726+0000","last_change":"2024-09-12T12:22:51.852126+0000","last_active":"2024-09-12T12:24:36.264726+0000","last_peered":"2024-09-12T12:24:36.264726+0000","last_clean":"2024-09-12T12:24:36.264726+0000","last_became_active":"2024-09-12T12:22:51.851766+0000","last_became_peered":"2024-09-12T12:22:51.851766+0000","last_unstale":"2024-09-12T12:24:36.264726+0000","last_undegraded":"2024-09-12T12:24:36.264726+0000","last_fullsized":"2024-09-12T12:24:36.264726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:37.263329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840007+0000","last_change":"2024-09-12T12:23:03.375569+0000","last_active":"2024-09-12T12:24:35.840007+0000","last_peered":"2024-09-12T12:24:35.840007+0000","last_clean":"2024-09-12T12:24:35.840007+0000","last_became_active":"2024-09-12T12:23:03.375136+0000","last_became_peered":"2024-09-12T12:23:03.375136+0000","last_unstale":"2024-09-12T12:24:35.840007+0000","last_undegraded":"2024-09-12T12:24:35.840007+0000","last_fullsized":"2024-09-12T12:24:35.840007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:05.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.108357+0000","last_change":"2024-09-12T12:22:54.304943+0000","last_active":"2024-09-12T12:25:04.108357+0000","last_peered":"2024-09-12T12:25:04.108357+0000","last_clean":"2024-09-12T12:25:04.108357+0000","last_became_active":"2024-09-12T12:22:54.304573+0000","last_became_peered":"2024-09-12T12:22:54.304573+0000","last_unstale":"2024-09-12T12:25:04.108357+0000","last_undegraded":"2024-09-12T12:25:04.108357+0000","last_fullsized":"2024-09-12T12:25:04.108357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:20.220093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.844624+0000","last_change":"2024-09-12T12:22:51.846998+0000","last_active":"2024-09-12T12:24:35.844624+0000","last_peered":"2024-09-12T12:24:35.844624+0000","last_clean":"2024-09-12T12:24:35.844624+0000","last_became_active":"2024-09-12T12:22:51.846617+0000","last_became_peered":"2024-09-12T12:22:51.846617+0000","last_unstale":"2024-09-12T12:24:35.844624+0000","last_undegraded":"2024-09-12T12:24:35.844624+0000","last_fullsized":"2024-09-12T12:24:35.844624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.428244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840084+0000","last_change":"2024-09-12T12:23:03.383519+0000","last_active":"2024-09-12T12:24:35.840084+0000","last_peered":"2024-09-12T12:24:35.840084+0000","last_clean":"2024-09-12T12:24:35.840084+0000","last_became_active":"2024-09-12T12:23:03.383131+0000","last_became_peered":"2024-09-12T12:23:03.383131+0000","last_unstale":"2024-09-12T12:24:35.840084+0000","last_undegraded":"2024-09-12T12:24:35.840084+0000","last_fullsized":"2024-09-12T12:24:35.840084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:59.602027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107058+0000","last_change":"2024-09-12T12:22:54.312418+0000","last_active":"2024-09-12T12:25:04.107058+0000","last_peered":"2024-09-12T12:25:04.107058+0000","last_clean":"2024-09-12T12:25:04.107058+0000","last_became_active":"2024-09-12T12:22:54.311932+0000","last_became_peered":"2024-09-12T12:22:54.311932+0000","last_unstale":"2024-09-12T12:25:04.107058+0000","last_undegraded":"2024-09-12T12:25:04.107058+0000","last_fullsized":"2024-09-12T12:25:04.107058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:48.395607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843747+0000","last_change":"2024-09-12T12:22:51.993506+0000","last_active":"2024-09-12T12:24:35.843747+0000","last_peered":"2024-09-12T12:24:35.843747+0000","last_clean":"2024-09-12T12:24:35.843747+0000","last_became_active":"2024-09-12T12:22:51.993204+0000","last_became_peered":"2024-09-12T12:22:51.993204+0000","last_unstale":"2024-09-12T12:24:35.843747+0000","last_undegraded":"2024-09-12T12:24:35.843747+0000","last_fullsized":"2024-09-12T12:24:35.843747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:34.670023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265433+0000","last_change":"2024-09-12T12:23:03.388552+0000","last_active":"2024-09-12T12:24:36.265433+0000","last_peered":"2024-09-12T12:24:36.265433+0000","last_clean":"2024-09-12T12:24:36.265433+0000","last_became_active":"2024-09-12T12:23:03.388105+0000","last_became_peered":"2024-09-12T12:23:03.388105+0000","last_unstale":"2024-09-12T12:24:36.265433+0000","last_undegraded":"2024-09-12T12:24:36.265433+0000","last_fullsized":"2024-09-12T12:24:36.265433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:08.927714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106325+0000","last_change":"2024-09-12T12:23:35.081015+0000","last_active":"2024-09-12T12:25:04.106325+0000","last_peered":"2024-09-12T12:25:04.106325+0000","last_clean":"2024-09-12T12:25:04.106325+0000","last_became_active":"2024-09-12T12:23:35.080609+0000","last_became_peered":"2024-09-12T12:23:35.080609+0000","last_unstale":"2024-09-12T12:25:04.106325+0000","last_undegraded":"2024-09-12T12:25:04.106325+0000","last_fullsized":"2024-09-12T12:25:04.106325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:26.700031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:46.361952+0000","last_change":"2024-09-12T12:22:51.848784+0000","last_active":"2024-09-12T12:25:46.361952+0000","last_peered":"2024-09-12T12:25:46.361952+0000","last_clean":"2024-09-12T12:25:46.361952+0000","last_became_active":"2024-09-12T12:22:51.848255+0000","last_became_peered":"2024-09-12T12:22:51.848255+0000","last_unstale":"2024-09-12T12:25:46.361952+0000","last_undegraded":"2024-09-12T12:25:46.361952+0000","last_fullsized":"2024-09-12T12:25:46.361952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:00.680332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.841265+0000","last_change":"2024-09-12T12:23:03.386046+0000","last_active":"2024-09-12T12:24:35.841265+0000","last_peered":"2024-09-12T12:24:35.841265+0000","last_clean":"2024-09-12T12:24:35.841265+0000","last_became_active":"2024-09-12T12:23:03.384264+0000","last_became_peered":"2024-09-12T12:23:03.384264+0000","last_unstale":"2024-09-12T12:24:35.841265+0000","last_undegraded":"2024-09-12T12:24:35.841265+0000","last_fullsized":"2024-09-12T12:24:35.841265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:23.605769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125553+0000","last_change":"2024-09-12T12:22:54.315588+0000","last_active":"2024-09-12T12:25:04.125553+0000","last_peered":"2024-09-12T12:25:04.125553+0000","last_clean":"2024-09-12T12:25:04.125553+0000","last_became_active":"2024-09-12T12:22:54.315216+0000","last_became_peered":"2024-09-12T12:22:54.315216+0000","last_unstale":"2024-09-12T12:25:04.125553+0000","last_undegraded":"2024-09-12T12:25:04.125553+0000","last_fullsized":"2024-09-12T12:25:04.125553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:06.556373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840444+0000","last_change":"2024-09-12T12:22:51.851246+0000","last_active":"2024-09-12T12:24:35.840444+0000","last_peered":"2024-09-12T12:24:35.840444+0000","last_clean":"2024-09-12T12:24:35.840444+0000","last_became_active":"2024-09-12T12:22:51.850963+0000","last_became_peered":"2024-09-12T12:22:51.850963+0000","last_unstale":"2024-09-12T12:24:35.840444+0000","last_undegraded":"2024-09-12T12:24:35.840444+0000","last_fullsized":"2024-09-12T12:24:35.840444+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:12.032126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843036+0000","last_change":"2024-09-12T12:23:03.382950+0000","last_active":"2024-09-12T12:24:35.843036+0000","last_peered":"2024-09-12T12:24:35.843036+0000","last_clean":"2024-09-12T12:24:35.843036+0000","last_became_active":"2024-09-12T12:23:03.382503+0000","last_became_peered":"2024-09-12T12:23:03.382503+0000","last_unstale":"2024-09-12T12:24:35.843036+0000","last_undegraded":"2024-09-12T12:24:35.843036+0000","last_fullsized":"2024-09-12T12:24:35.843036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:03.991304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123029+0000","last_change":"2024-09-12T12:22:54.315788+0000","last_active":"2024-09-12T12:25:04.123029+0000","last_peered":"2024-09-12T12:25:04.123029+0000","last_clean":"2024-09-12T12:25:04.123029+0000","last_became_active":"2024-09-12T12:22:54.315343+0000","last_became_peered":"2024-09-12T12:22:54.315343+0000","last_unstale":"2024-09-12T12:25:04.123029+0000","last_undegraded":"2024-09-12T12:25:04.123029+0000","last_fullsized":"2024-09-12T12:25:04.123029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:22.549415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845915+0000","last_change":"2024-09-12T12:22:51.854532+0000","last_active":"2024-09-12T12:24:35.845915+0000","last_peered":"2024-09-12T12:24:35.845915+0000","last_clean":"2024-09-12T12:24:35.845915+0000","last_became_active":"2024-09-12T12:22:51.854206+0000","last_became_peered":"2024-09-12T12:22:51.854206+0000","last_unstale":"2024-09-12T12:24:35.845915+0000","last_undegraded":"2024-09-12T12:24:35.845915+0000","last_fullsized":"2024-09-12T12:24:35.845915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:46.908917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840512+0000","last_change":"2024-09-12T12:23:03.383647+0000","last_active":"2024-09-12T12:24:35.840512+0000","last_peered":"2024-09-12T12:24:35.840512+0000","last_clean":"2024-09-12T12:24:35.840512+0000","last_became_active":"2024-09-12T12:23:03.383094+0000","last_became_peered":"2024-09-12T12:23:03.383094+0000","last_unstale":"2024-09-12T12:24:35.840512+0000","last_undegraded":"2024-09-12T12:24:35.840512+0000","last_fullsized":"2024-09-12T12:24:35.840512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:59:03.754250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.091694+0000","last_change":"2024-09-12T12:22:54.310717+0000","last_active":"2024-09-12T12:25:04.091694+0000","last_peered":"2024-09-12T12:25:04.091694+0000","last_clean":"2024-09-12T12:25:04.091694+0000","last_became_active":"2024-09-12T12:22:54.309485+0000","last_became_peered":"2024-09-12T12:22:54.309485+0000","last_unstale":"2024-09-12T12:25:04.091694+0000","last_undegraded":"2024-09-12T12:25:04.091694+0000","last_fullsized":"2024-09-12T12:25:04.091694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:10.293726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'40","reported_seq":336,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:50.367931+0000","last_change":"2024-09-12T12:22:51.856735+0000","last_active":"2024-09-12T12:25:50.367931+0000","last_peered":"2024-09-12T12:25:50.367931+0000","last_clean":"2024-09-12T12:25:50.367931+0000","last_became_active":"2024-09-12T12:22:51.856340+0000","last_became_peered":"2024-09-12T12:22:51.856340+0000","last_unstale":"2024-09-12T12:25:50.367931+0000","last_undegraded":"2024-09-12T12:25:50.367931+0000","last_fullsized":"2024-09-12T12:25:50.367931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:40.727645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":256,"num_read_kb":195,"num_write":42,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840936+0000","last_change":"2024-09-12T12:23:03.379726+0000","last_active":"2024-09-12T12:24:35.840936+0000","last_peered":"2024-09-12T12:24:35.840936+0000","last_clean":"2024-09-12T12:24:35.840936+0000","last_became_active":"2024-09-12T12:23:03.378168+0000","last_became_peered":"2024-09-12T12:23:03.378168+0000","last_unstale":"2024-09-12T12:24:35.840936+0000","last_undegraded":"2024-09-12T12:24:35.840936+0000","last_fullsized":"2024-09-12T12:24:35.840936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.125522+0000","last_change":"2024-09-12T12:23:35.083119+0000","last_active":"2024-09-12T12:25:04.125522+0000","last_peered":"2024-09-12T12:25:04.125522+0000","last_clean":"2024-09-12T12:25:04.125522+0000","last_became_active":"2024-09-12T12:23:35.082800+0000","last_became_peered":"2024-09-12T12:23:35.082800+0000","last_unstale":"2024-09-12T12:25:04.125522+0000","last_undegraded":"2024-09-12T12:25:04.125522+0000","last_fullsized":"2024-09-12T12:25:04.125522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.717540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840793+0000","last_change":"2024-09-12T12:22:51.989886+0000","last_active":"2024-09-12T12:24:35.840793+0000","last_peered":"2024-09-12T12:24:35.840793+0000","last_clean":"2024-09-12T12:24:35.840793+0000","last_became_active":"2024-09-12T12:22:51.989524+0000","last_became_peered":"2024-09-12T12:22:51.989524+0000","last_unstale":"2024-09-12T12:24:35.840793+0000","last_undegraded":"2024-09-12T12:24:35.840793+0000","last_fullsized":"2024-09-12T12:24:35.840793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:26.409342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.268030+0000","last_change":"2024-09-12T12:23:03.384583+0000","last_active":"2024-09-12T12:24:36.268030+0000","last_peered":"2024-09-12T12:24:36.268030+0000","last_clean":"2024-09-12T12:24:36.268030+0000","last_became_active":"2024-09-12T12:23:03.383639+0000","last_became_peered":"2024-09-12T12:23:03.383639+0000","last_unstale":"2024-09-12T12:24:36.268030+0000","last_undegraded":"2024-09-12T12:24:36.268030+0000","last_fullsized":"2024-09-12T12:24:36.268030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:09.755052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116744+0000","last_change":"2024-09-12T12:22:54.309874+0000","last_active":"2024-09-12T12:25:04.116744+0000","last_peered":"2024-09-12T12:25:04.116744+0000","last_clean":"2024-09-12T12:25:04.116744+0000","last_became_active":"2024-09-12T12:22:54.309294+0000","last_became_peered":"2024-09-12T12:22:54.309294+0000","last_unstale":"2024-09-12T12:25:04.116744+0000","last_undegraded":"2024-09-12T12:25:04.116744+0000","last_fullsized":"2024-09-12T12:25:04.116744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:50.067812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.847221+0000","last_change":"2024-09-12T12:22:51.849467+0000","last_active":"2024-09-12T12:24:35.847221+0000","last_peered":"2024-09-12T12:24:35.847221+0000","last_clean":"2024-09-12T12:24:35.847221+0000","last_became_active":"2024-09-12T12:22:51.849076+0000","last_became_peered":"2024-09-12T12:22:51.849076+0000","last_unstale":"2024-09-12T12:24:35.847221+0000","last_undegraded":"2024-09-12T12:24:35.847221+0000","last_fullsized":"2024-09-12T12:24:35.847221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:04.821105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843557+0000","last_change":"2024-09-12T12:23:35.083542+0000","last_active":"2024-09-12T12:24:35.843557+0000","last_peered":"2024-09-12T12:24:35.843557+0000","last_clean":"2024-09-12T12:24:35.843557+0000","last_became_active":"2024-09-12T12:23:35.083095+0000","last_became_peered":"2024-09-12T12:23:35.083095+0000","last_unstale":"2024-09-12T12:24:35.843557+0000","last_undegraded":"2024-09-12T12:24:35.843557+0000","last_fullsized":"2024-09-12T12:24:35.843557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:06.750223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.121933+0000","last_change":"2024-09-12T12:22:54.315215+0000","last_active":"2024-09-12T12:25:04.121933+0000","last_peered":"2024-09-12T12:25:04.121933+0000","last_clean":"2024-09-12T12:25:04.121933+0000","last_became_active":"2024-09-12T12:22:54.314879+0000","last_became_peered":"2024-09-12T12:22:54.314879+0000","last_unstale":"2024-09-12T12:25:04.121933+0000","last_undegraded":"2024-09-12T12:25:04.121933+0000","last_fullsized":"2024-09-12T12:25:04.121933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:35.501376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'6","reported_seq":292,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:50.367731+0000","last_change":"2024-09-12T12:22:51.851461+0000","last_active":"2024-09-12T12:25:50.367731+0000","last_peered":"2024-09-12T12:25:50.367731+0000","last_clean":"2024-09-12T12:25:50.367731+0000","last_became_active":"2024-09-12T12:22:51.851105+0000","last_became_peered":"2024-09-12T12:22:51.851105+0000","last_unstale":"2024-09-12T12:25:50.367731+0000","last_undegraded":"2024-09-12T12:25:50.367731+0000","last_fullsized":"2024-09-12T12:25:50.367731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:42.604983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":246,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845020+0000","last_change":"2024-09-12T12:23:03.383308+0000","last_active":"2024-09-12T12:24:35.845020+0000","last_peered":"2024-09-12T12:24:35.845020+0000","last_clean":"2024-09-12T12:24:35.845020+0000","last_became_active":"2024-09-12T12:23:03.382294+0000","last_became_peered":"2024-09-12T12:23:03.382294+0000","last_unstale":"2024-09-12T12:24:35.845020+0000","last_undegraded":"2024-09-12T12:24:35.845020+0000","last_fullsized":"2024-09-12T12:24:35.845020+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:43.920306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846769+0000","last_change":"2024-09-12T12:23:03.386850+0000","last_active":"2024-09-12T12:24:35.846769+0000","last_peered":"2024-09-12T12:24:35.846769+0000","last_clean":"2024-09-12T12:24:35.846769+0000","last_became_active":"2024-09-12T12:23:03.386350+0000","last_became_peered":"2024-09-12T12:23:03.386350+0000","last_unstale":"2024-09-12T12:24:35.846769+0000","last_undegraded":"2024-09-12T12:24:35.846769+0000","last_fullsized":"2024-09-12T12:24:35.846769+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:36.295745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116408+0000","last_change":"2024-09-12T12:22:54.320709+0000","last_active":"2024-09-12T12:25:04.116408+0000","last_peered":"2024-09-12T12:25:04.116408+0000","last_clean":"2024-09-12T12:25:04.116408+0000","last_became_active":"2024-09-12T12:22:54.320208+0000","last_became_peered":"2024-09-12T12:22:54.320208+0000","last_unstale":"2024-09-12T12:25:04.116408+0000","last_undegraded":"2024-09-12T12:25:04.116408+0000","last_fullsized":"2024-09-12T12:25:04.116408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:45.452449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840308+0000","last_change":"2024-09-12T12:22:51.853047+0000","last_active":"2024-09-12T12:24:35.840308+0000","last_peered":"2024-09-12T12:24:35.840308+0000","last_clean":"2024-09-12T12:24:35.840308+0000","last_became_active":"2024-09-12T12:22:51.852653+0000","last_became_peered":"2024-09-12T12:22:51.852653+0000","last_unstale":"2024-09-12T12:24:35.840308+0000","last_undegraded":"2024-09-12T12:24:35.840308+0000","last_fullsized":"2024-09-12T12:24:35.840308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:39.035009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.843207+0000","last_change":"2024-09-12T12:23:03.382997+0000","last_active":"2024-09-12T12:24:35.843207+0000","last_peered":"2024-09-12T12:24:35.843207+0000","last_clean":"2024-09-12T12:24:35.843207+0000","last_became_active":"2024-09-12T12:23:03.382594+0000","last_became_peered":"2024-09-12T12:23:03.382594+0000","last_unstale":"2024-09-12T12:24:35.843207+0000","last_undegraded":"2024-09-12T12:24:35.843207+0000","last_fullsized":"2024-09-12T12:24:35.843207+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:25.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.122806+0000","last_change":"2024-09-12T12:22:54.322595+0000","last_active":"2024-09-12T12:25:04.122806+0000","last_peered":"2024-09-12T12:25:04.122806+0000","last_clean":"2024-09-12T12:25:04.122806+0000","last_became_active":"2024-09-12T12:22:54.320182+0000","last_became_peered":"2024-09-12T12:22:54.320182+0000","last_unstale":"2024-09-12T12:25:04.122806+0000","last_undegraded":"2024-09-12T12:25:04.122806+0000","last_fullsized":"2024-09-12T12:25:04.122806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:36.265174+0000","last_change":"2024-09-12T12:22:51.850045+0000","last_active":"2024-09-12T12:24:36.265174+0000","last_peered":"2024-09-12T12:24:36.265174+0000","last_clean":"2024-09-12T12:24:36.265174+0000","last_became_active":"2024-09-12T12:22:51.849643+0000","last_became_peered":"2024-09-12T12:22:51.849643+0000","last_unstale":"2024-09-12T12:24:36.265174+0000","last_undegraded":"2024-09-12T12:24:36.265174+0000","last_fullsized":"2024-09-12T12:24:36.265174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:18.255368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.840542+0000","last_change":"2024-09-12T12:22:51.852692+0000","last_active":"2024-09-12T12:24:35.840542+0000","last_peered":"2024-09-12T12:24:35.840542+0000","last_clean":"2024-09-12T12:24:35.840542+0000","last_became_active":"2024-09-12T12:22:51.852265+0000","last_became_peered":"2024-09-12T12:22:51.852265+0000","last_unstale":"2024-09-12T12:24:35.840542+0000","last_undegraded":"2024-09-12T12:24:35.840542+0000","last_fullsized":"2024-09-12T12:24:35.840542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:55.853073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111746+0000","last_change":"2024-09-12T12:22:54.315519+0000","last_active":"2024-09-12T12:25:04.111746+0000","last_peered":"2024-09-12T12:25:04.111746+0000","last_clean":"2024-09-12T12:25:04.111746+0000","last_became_active":"2024-09-12T12:22:54.315158+0000","last_became_peered":"2024-09-12T12:22:54.315158+0000","last_unstale":"2024-09-12T12:25:04.111746+0000","last_undegraded":"2024-09-12T12:25:04.111746+0000","last_fullsized":"2024-09-12T12:25:04.111746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.845873+0000","last_change":"2024-09-12T12:23:03.383443+0000","last_active":"2024-09-12T12:24:35.845873+0000","last_peered":"2024-09-12T12:24:35.845873+0000","last_clean":"2024-09-12T12:24:35.845873+0000","last_became_active":"2024-09-12T12:23:03.382865+0000","last_became_peered":"2024-09-12T12:23:03.382865+0000","last_unstale":"2024-09-12T12:24:35.845873+0000","last_undegraded":"2024-09-12T12:24:35.845873+0000","last_fullsized":"2024-09-12T12:24:35.845873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:26.339910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:46.363863+0000","last_change":"2024-09-12T12:22:51.849963+0000","last_active":"2024-09-12T12:25:46.363863+0000","last_peered":"2024-09-12T12:25:46.363863+0000","last_clean":"2024-09-12T12:25:46.363863+0000","last_became_active":"2024-09-12T12:22:51.849596+0000","last_became_peered":"2024-09-12T12:22:51.849596+0000","last_unstale":"2024-09-12T12:25:46.363863+0000","last_undegraded":"2024-09-12T12:25:46.363863+0000","last_fullsized":"2024-09-12T12:25:46.363863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:50.832735+0000","last_clean_scrub_stamp":"2024-09-12T12:22:50.832735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:48.695657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104951+0000","last_change":"2024-09-12T12:22:54.312543+0000","last_active":"2024-09-12T12:25:04.104951+0000","last_peered":"2024-09-12T12:25:04.104951+0000","last_clean":"2024-09-12T12:25:04.104951+0000","last_became_active":"2024-09-12T12:22:54.312154+0000","last_became_peered":"2024-09-12T12:22:54.312154+0000","last_unstale":"2024-09-12T12:25:04.104951+0000","last_undegraded":"2024-09-12T12:25:04.104951+0000","last_fullsized":"2024-09-12T12:25:04.104951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:15:28.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:24:35.846443+0000","last_change":"2024-09-12T12:23:03.376938+0000","last_active":"2024-09-12T12:24:35.846443+0000","last_peered":"2024-09-12T12:24:35.846443+0000","last_clean":"2024-09-12T12:24:35.846443+0000","last_became_active":"2024-09-12T12:23:03.376450+0000","last_became_peered":"2024-09-12T12:23:03.376450+0000","last_unstale":"2024-09-12T12:24:35.846443+0000","last_undegraded":"2024-09-12T12:24:35.846443+0000","last_fullsized":"2024-09-12T12:24:35.846443+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.351403+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.351403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:35.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106500+0000","last_change":"2024-09-12T12:22:54.305562+0000","last_active":"2024-09-12T12:25:04.106500+0000","last_peered":"2024-09-12T12:25:04.106500+0000","last_clean":"2024-09-12T12:25:04.106500+0000","last_became_active":"2024-09-12T12:22:54.305208+0000","last_became_peered":"2024-09-12T12:22:54.305208+0000","last_unstale":"2024-09-12T12:25:04.106500+0000","last_undegraded":"2024-09-12T12:25:04.106500+0000","last_fullsized":"2024-09-12T12:25:04.106500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:46.643949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106018+0000","last_change":"2024-09-12T12:22:54.310634+0000","last_active":"2024-09-12T12:25:04.106018+0000","last_peered":"2024-09-12T12:25:04.106018+0000","last_clean":"2024-09-12T12:25:04.106018+0000","last_became_active":"2024-09-12T12:22:54.310194+0000","last_became_peered":"2024-09-12T12:22:54.310194+0000","last_unstale":"2024-09-12T12:25:04.106018+0000","last_undegraded":"2024-09-12T12:25:04.106018+0000","last_fullsized":"2024-09-12T12:25:04.106018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:05.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.112065+0000","last_change":"2024-09-12T12:22:54.315119+0000","last_active":"2024-09-12T12:25:04.112065+0000","last_peered":"2024-09-12T12:25:04.112065+0000","last_clean":"2024-09-12T12:25:04.112065+0000","last_became_active":"2024-09-12T12:22:54.314729+0000","last_became_peered":"2024-09-12T12:22:54.314729+0000","last_unstale":"2024-09-12T12:25:04.112065+0000","last_undegraded":"2024-09-12T12:25:04.112065+0000","last_fullsized":"2024-09-12T12:25:04.112065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:07.888005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123993+0000","last_change":"2024-09-12T12:23:35.083672+0000","last_active":"2024-09-12T12:25:04.123993+0000","last_peered":"2024-09-12T12:25:04.123993+0000","last_clean":"2024-09-12T12:25:04.123993+0000","last_became_active":"2024-09-12T12:23:35.083222+0000","last_became_peered":"2024-09-12T12:23:35.083222+0000","last_unstale":"2024-09-12T12:25:04.123993+0000","last_undegraded":"2024-09-12T12:25:04.123993+0000","last_fullsized":"2024-09-12T12:25:04.123993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124802+0000","last_change":"2024-09-12T12:22:54.321649+0000","last_active":"2024-09-12T12:25:04.124802+0000","last_peered":"2024-09-12T12:25:04.124802+0000","last_clean":"2024-09-12T12:25:04.124802+0000","last_became_active":"2024-09-12T12:22:54.320859+0000","last_became_peered":"2024-09-12T12:22:54.320859+0000","last_unstale":"2024-09-12T12:25:04.124802+0000","last_undegraded":"2024-09-12T12:25:04.124802+0000","last_fullsized":"2024-09-12T12:25:04.124802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:49.706632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104517+0000","last_change":"2024-09-12T12:22:54.306900+0000","last_active":"2024-09-12T12:25:04.104517+0000","last_peered":"2024-09-12T12:25:04.104517+0000","last_clean":"2024-09-12T12:25:04.104517+0000","last_became_active":"2024-09-12T12:22:54.306432+0000","last_became_peered":"2024-09-12T12:22:54.306432+0000","last_unstale":"2024-09-12T12:25:04.104517+0000","last_undegraded":"2024-09-12T12:25:04.104517+0000","last_fullsized":"2024-09-12T12:25:04.104517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:07.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.110181+0000","last_change":"2024-09-12T12:22:54.318123+0000","last_active":"2024-09-12T12:25:04.110181+0000","last_peered":"2024-09-12T12:25:04.110181+0000","last_clean":"2024-09-12T12:25:04.110181+0000","last_became_active":"2024-09-12T12:22:54.317820+0000","last_became_peered":"2024-09-12T12:22:54.317820+0000","last_unstale":"2024-09-12T12:25:04.110181+0000","last_undegraded":"2024-09-12T12:25:04.110181+0000","last_fullsized":"2024-09-12T12:25:04.110181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:19.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.107607+0000","last_change":"2024-09-12T12:22:54.318029+0000","last_active":"2024-09-12T12:25:04.107607+0000","last_peered":"2024-09-12T12:25:04.107607+0000","last_clean":"2024-09-12T12:25:04.107607+0000","last_became_active":"2024-09-12T12:22:54.316015+0000","last_became_peered":"2024-09-12T12:22:54.316015+0000","last_unstale":"2024-09-12T12:25:04.107607+0000","last_undegraded":"2024-09-12T12:25:04.107607+0000","last_fullsized":"2024-09-12T12:25:04.107607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118186+0000","last_change":"2024-09-12T12:22:54.325688+0000","last_active":"2024-09-12T12:25:04.118186+0000","last_peered":"2024-09-12T12:25:04.118186+0000","last_clean":"2024-09-12T12:25:04.118186+0000","last_became_active":"2024-09-12T12:22:54.325375+0000","last_became_peered":"2024-09-12T12:22:54.325375+0000","last_unstale":"2024-09-12T12:25:04.118186+0000","last_undegraded":"2024-09-12T12:25:04.118186+0000","last_fullsized":"2024-09-12T12:25:04.118186+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:43.971575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109830+0000","last_change":"2024-09-12T12:22:54.315713+0000","last_active":"2024-09-12T12:25:04.109830+0000","last_peered":"2024-09-12T12:25:04.109830+0000","last_clean":"2024-09-12T12:25:04.109830+0000","last_became_active":"2024-09-12T12:22:54.315401+0000","last_became_peered":"2024-09-12T12:22:54.315401+0000","last_unstale":"2024-09-12T12:25:04.109830+0000","last_undegraded":"2024-09-12T12:25:04.109830+0000","last_fullsized":"2024-09-12T12:25:04.109830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:35:31.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118235+0000","last_change":"2024-09-12T12:22:54.314543+0000","last_active":"2024-09-12T12:25:04.118235+0000","last_peered":"2024-09-12T12:25:04.118235+0000","last_clean":"2024-09-12T12:25:04.118235+0000","last_became_active":"2024-09-12T12:22:54.314216+0000","last_became_peered":"2024-09-12T12:22:54.314216+0000","last_unstale":"2024-09-12T12:25:04.118235+0000","last_undegraded":"2024-09-12T12:25:04.118235+0000","last_fullsized":"2024-09-12T12:25:04.118235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:12.180355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124305+0000","last_change":"2024-09-12T12:22:54.313637+0000","last_active":"2024-09-12T12:25:04.124305+0000","last_peered":"2024-09-12T12:25:04.124305+0000","last_clean":"2024-09-12T12:25:04.124305+0000","last_became_active":"2024-09-12T12:22:54.313327+0000","last_became_peered":"2024-09-12T12:22:54.313327+0000","last_unstale":"2024-09-12T12:25:04.124305+0000","last_undegraded":"2024-09-12T12:25:04.124305+0000","last_fullsized":"2024-09-12T12:25:04.124305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:24.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109135+0000","last_change":"2024-09-12T12:22:54.306018+0000","last_active":"2024-09-12T12:25:04.109135+0000","last_peered":"2024-09-12T12:25:04.109135+0000","last_clean":"2024-09-12T12:25:04.109135+0000","last_became_active":"2024-09-12T12:22:54.305683+0000","last_became_peered":"2024-09-12T12:22:54.305683+0000","last_unstale":"2024-09-12T12:25:04.109135+0000","last_undegraded":"2024-09-12T12:25:04.109135+0000","last_fullsized":"2024-09-12T12:25:04.109135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:00.464765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.123634+0000","last_change":"2024-09-12T12:22:54.319169+0000","last_active":"2024-09-12T12:25:04.123634+0000","last_peered":"2024-09-12T12:25:04.123634+0000","last_clean":"2024-09-12T12:25:04.123634+0000","last_became_active":"2024-09-12T12:22:54.318831+0000","last_became_peered":"2024-09-12T12:22:54.318831+0000","last_unstale":"2024-09-12T12:25:04.123634+0000","last_undegraded":"2024-09-12T12:25:04.123634+0000","last_fullsized":"2024-09-12T12:25:04.123634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:42.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.120814+0000","last_change":"2024-09-12T12:22:54.305760+0000","last_active":"2024-09-12T12:25:04.120814+0000","last_peered":"2024-09-12T12:25:04.120814+0000","last_clean":"2024-09-12T12:25:04.120814+0000","last_became_active":"2024-09-12T12:22:54.305455+0000","last_became_peered":"2024-09-12T12:22:54.305455+0000","last_unstale":"2024-09-12T12:25:04.120814+0000","last_undegraded":"2024-09-12T12:25:04.120814+0000","last_fullsized":"2024-09-12T12:25:04.120814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:54.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114429+0000","last_change":"2024-09-12T12:22:54.311420+0000","last_active":"2024-09-12T12:25:04.114429+0000","last_peered":"2024-09-12T12:25:04.114429+0000","last_clean":"2024-09-12T12:25:04.114429+0000","last_became_active":"2024-09-12T12:22:54.311072+0000","last_became_peered":"2024-09-12T12:22:54.311072+0000","last_unstale":"2024-09-12T12:25:04.114429+0000","last_undegraded":"2024-09-12T12:25:04.114429+0000","last_fullsized":"2024-09-12T12:25:04.114429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:54.476587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118981+0000","last_change":"2024-09-12T12:22:54.313093+0000","last_active":"2024-09-12T12:25:04.118981+0000","last_peered":"2024-09-12T12:25:04.118981+0000","last_clean":"2024-09-12T12:25:04.118981+0000","last_became_active":"2024-09-12T12:22:54.312220+0000","last_became_peered":"2024-09-12T12:22:54.312220+0000","last_unstale":"2024-09-12T12:25:04.118981+0000","last_undegraded":"2024-09-12T12:25:04.118981+0000","last_fullsized":"2024-09-12T12:25:04.118981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:33.241798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109467+0000","last_change":"2024-09-12T12:22:54.310536+0000","last_active":"2024-09-12T12:25:04.109467+0000","last_peered":"2024-09-12T12:25:04.109467+0000","last_clean":"2024-09-12T12:25:04.109467+0000","last_became_active":"2024-09-12T12:22:54.310203+0000","last_became_peered":"2024-09-12T12:22:54.310203+0000","last_unstale":"2024-09-12T12:25:04.109467+0000","last_undegraded":"2024-09-12T12:25:04.109467+0000","last_fullsized":"2024-09-12T12:25:04.109467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:40.957367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.116751+0000","last_change":"2024-09-12T12:22:54.312898+0000","last_active":"2024-09-12T12:25:04.116751+0000","last_peered":"2024-09-12T12:25:04.116751+0000","last_clean":"2024-09-12T12:25:04.116751+0000","last_became_active":"2024-09-12T12:22:54.312449+0000","last_became_peered":"2024-09-12T12:22:54.312449+0000","last_unstale":"2024-09-12T12:25:04.116751+0000","last_undegraded":"2024-09-12T12:25:04.116751+0000","last_fullsized":"2024-09-12T12:25:04.116751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:57.384949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.124720+0000","last_change":"2024-09-12T12:22:54.312206+0000","last_active":"2024-09-12T12:25:04.124720+0000","last_peered":"2024-09-12T12:25:04.124720+0000","last_clean":"2024-09-12T12:25:04.124720+0000","last_became_active":"2024-09-12T12:22:54.311187+0000","last_became_peered":"2024-09-12T12:22:54.311187+0000","last_unstale":"2024-09-12T12:25:04.124720+0000","last_undegraded":"2024-09-12T12:25:04.124720+0000","last_fullsized":"2024-09-12T12:25:04.124720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:22.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.097156+0000","last_change":"2024-09-12T12:22:54.312083+0000","last_active":"2024-09-12T12:25:04.097156+0000","last_peered":"2024-09-12T12:25:04.097156+0000","last_clean":"2024-09-12T12:25:04.097156+0000","last_became_active":"2024-09-12T12:22:54.310716+0000","last_became_peered":"2024-09-12T12:22:54.310716+0000","last_unstale":"2024-09-12T12:25:04.097156+0000","last_undegraded":"2024-09-12T12:25:04.097156+0000","last_fullsized":"2024-09-12T12:25:04.097156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:22.717416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.117943+0000","last_change":"2024-09-12T12:22:54.315088+0000","last_active":"2024-09-12T12:25:04.117943+0000","last_peered":"2024-09-12T12:25:04.117943+0000","last_clean":"2024-09-12T12:25:04.117943+0000","last_became_active":"2024-09-12T12:22:54.314601+0000","last_became_peered":"2024-09-12T12:22:54.314601+0000","last_unstale":"2024-09-12T12:25:04.117943+0000","last_undegraded":"2024-09-12T12:25:04.117943+0000","last_fullsized":"2024-09-12T12:25:04.117943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:35.207407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.103569+0000","last_change":"2024-09-12T12:22:54.305332+0000","last_active":"2024-09-12T12:25:04.103569+0000","last_peered":"2024-09-12T12:25:04.103569+0000","last_clean":"2024-09-12T12:25:04.103569+0000","last_became_active":"2024-09-12T12:22:54.305017+0000","last_became_peered":"2024-09-12T12:22:54.305017+0000","last_unstale":"2024-09-12T12:25:04.103569+0000","last_undegraded":"2024-09-12T12:25:04.103569+0000","last_fullsized":"2024-09-12T12:25:04.103569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:16.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114402+0000","last_change":"2024-09-12T12:22:54.319768+0000","last_active":"2024-09-12T12:25:04.114402+0000","last_peered":"2024-09-12T12:25:04.114402+0000","last_clean":"2024-09-12T12:25:04.114402+0000","last_became_active":"2024-09-12T12:22:54.319451+0000","last_became_peered":"2024-09-12T12:22:54.319451+0000","last_unstale":"2024-09-12T12:25:04.114402+0000","last_undegraded":"2024-09-12T12:25:04.114402+0000","last_fullsized":"2024-09-12T12:25:04.114402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:56.368891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.108893+0000","last_change":"2024-09-12T12:22:54.323162+0000","last_active":"2024-09-12T12:25:04.108893+0000","last_peered":"2024-09-12T12:25:04.108893+0000","last_clean":"2024-09-12T12:25:04.108893+0000","last_became_active":"2024-09-12T12:22:54.322068+0000","last_became_peered":"2024-09-12T12:22:54.322068+0000","last_unstale":"2024-09-12T12:25:04.108893+0000","last_undegraded":"2024-09-12T12:25:04.108893+0000","last_fullsized":"2024-09-12T12:25:04.108893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:54.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.118082+0000","last_change":"2024-09-12T12:22:54.306125+0000","last_active":"2024-09-12T12:25:04.118082+0000","last_peered":"2024-09-12T12:25:04.118082+0000","last_clean":"2024-09-12T12:25:04.118082+0000","last_became_active":"2024-09-12T12:22:54.305790+0000","last_became_peered":"2024-09-12T12:22:54.305790+0000","last_unstale":"2024-09-12T12:25:04.118082+0000","last_undegraded":"2024-09-12T12:25:04.118082+0000","last_fullsized":"2024-09-12T12:25:04.118082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:36.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.106172+0000","last_change":"2024-09-12T12:22:54.305099+0000","last_active":"2024-09-12T12:25:04.106172+0000","last_peered":"2024-09-12T12:25:04.106172+0000","last_clean":"2024-09-12T12:25:04.106172+0000","last_became_active":"2024-09-12T12:22:54.304649+0000","last_became_peered":"2024-09-12T12:22:54.304649+0000","last_unstale":"2024-09-12T12:25:04.106172+0000","last_undegraded":"2024-09-12T12:25:04.106172+0000","last_fullsized":"2024-09-12T12:25:04.106172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:05.771434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.119410+0000","last_change":"2024-09-12T12:22:54.319247+0000","last_active":"2024-09-12T12:25:04.119410+0000","last_peered":"2024-09-12T12:25:04.119410+0000","last_clean":"2024-09-12T12:25:04.119410+0000","last_became_active":"2024-09-12T12:22:54.318894+0000","last_became_peered":"2024-09-12T12:22:54.318894+0000","last_unstale":"2024-09-12T12:25:04.119410+0000","last_undegraded":"2024-09-12T12:25:04.119410+0000","last_fullsized":"2024-09-12T12:25:04.119410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:55.692071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.104860+0000","last_change":"2024-09-12T12:23:35.076997+0000","last_active":"2024-09-12T12:25:04.104860+0000","last_peered":"2024-09-12T12:25:04.104860+0000","last_clean":"2024-09-12T12:25:04.104860+0000","last_became_active":"2024-09-12T12:23:35.076506+0000","last_became_peered":"2024-09-12T12:23:35.076506+0000","last_unstale":"2024-09-12T12:25:04.104860+0000","last_undegraded":"2024-09-12T12:25:04.104860+0000","last_fullsized":"2024-09-12T12:25:04.104860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.111898+0000","last_change":"2024-09-12T12:22:54.314298+0000","last_active":"2024-09-12T12:25:04.111898+0000","last_peered":"2024-09-12T12:25:04.111898+0000","last_clean":"2024-09-12T12:25:04.111898+0000","last_became_active":"2024-09-12T12:22:54.311726+0000","last_became_peered":"2024-09-12T12:22:54.311726+0000","last_unstale":"2024-09-12T12:25:04.111898+0000","last_undegraded":"2024-09-12T12:25:04.111898+0000","last_fullsized":"2024-09-12T12:25:04.111898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:13.298082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.109460+0000","last_change":"2024-09-12T12:22:54.304397+0000","last_active":"2024-09-12T12:25:04.109460+0000","last_peered":"2024-09-12T12:25:04.109460+0000","last_clean":"2024-09-12T12:25:04.109460+0000","last_became_active":"2024-09-12T12:22:54.304048+0000","last_became_peered":"2024-09-12T12:22:54.304048+0000","last_unstale":"2024-09-12T12:25:04.109460+0000","last_undegraded":"2024-09-12T12:25:04.109460+0000","last_fullsized":"2024-09-12T12:25:04.109460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:13.518433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"93'8","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T12:25:04.114189+0000","last_change":"2024-09-12T12:22:54.312229+0000","last_active":"2024-09-12T12:25:04.114189+0000","last_peered":"2024-09-12T12:25:04.114189+0000","last_clean":"2024-09-12T12:25:04.114189+0000","last_became_active":"2024-09-12T12:22:54.311806+0000","last_became_peered":"2024-09-12T12:22:54.311806+0000","last_unstale":"2024-09-12T12:25:04.114189+0000","last_undegraded":"2024-09-12T12:25:04.114189+0000","last_fullsized":"2024-09-12T12:25:04.114189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:53.282440+0000","last_clean_scrub_stamp":"2024-09-12T12:22:53.282440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:28.865595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75652,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1265,"num_read_kb":721,"num_write":260,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":222642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514545,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":533258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743478,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28764,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716388,"statfs":{"total":95995035648,"available":95965581312,"internally_reserved":0,"allocated":1781760,"data_stored":1191909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877907004,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":532542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135938,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":532808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397574,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37000,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708152,"statfs":{"total":95995035648,"available":95957147648,"internally_reserved":0,"allocated":1695744,"data_stored":1129337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561101,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":528046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822736,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37008,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708144,"statfs":{"total":95995035648,"available":95957139456,"internally_reserved":0,"allocated":1703936,"data_stored":1124919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953559,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":532120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182492,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":527754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36488,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708664,"statfs":{"total":95995035648,"available":95957671936,"internally_reserved":0,"allocated":1171456,"data_stored":598526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1146880,"data_stored":593147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":530036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:25:52.497 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:52.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:52 smithi071 ceph-mon[34859]: from='client.25271 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:52.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:52 smithi071 ceph-mon[34859]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:52.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:52 smithi154 ceph-mon[35578]: from='client.25271 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:52.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:52 smithi154 ceph-mon[35578]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:52.910 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:53.345 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:53 smithi038 ceph-mon[30810]: pgmap v392: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T12:25:53.345 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:53 smithi038 ceph-mon[30810]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 -- 172.21.15.38:0/3518321788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f94109140 msgr2=0x7f7f94110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 --2- 172.21.15.38:0/3518321788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f94109140 0x7f7f94110cc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009ca0 tx=0x7f7f8c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 -- 172.21.15.38:0/3518321788 shutdown_connections 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 --2- 172.21.15.38:0/3518321788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f94109140 0x7f7f94110cc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 --2- 172.21.15.38:0/3518321788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f941049c0 0x7f7f94108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 --2- 172.21.15.38:0/3518321788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f94104010 0x7f7f941043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 -- 172.21.15.38:0/3518321788 >> 172.21.15.38:0/3518321788 conn(0x7f7f940ffa50 msgr2=0x7f7f94101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 -- 172.21.15.38:0/3518321788 shutdown_connections 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.459+0000 7f7f98a00640 1 -- 172.21.15.38:0/3518321788 wait complete. 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.460+0000 7f7f98a00640 1 Processor -- start 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.460+0000 7f7f98a00640 1 -- start start 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.460+0000 7f7f98a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f94104010 0x7f7f9419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f98a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f941049c0 0x7f7f9419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f98a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f94109140 0x7f7f9419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f98a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941141c0 con 0x7f7f941049c0 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f98a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94114040 con 0x7f7f94104010 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f98a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94114340 con 0x7f7f94109140 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f8be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f941049c0 0x7f7f9419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f8be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f941049c0 0x7f7f9419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41144/0 (socket says 172.21.15.38:41144) 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f8be00640 1 -- 172.21.15.38:0/1495367489 learned_addr learned my addr 172.21.15.38:0/1495367489 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f91e00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f94104010 0x7f7f9419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f92800640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f94109140 0x7f7f9419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f91e00640 1 -- 172.21.15.38:0/1495367489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f94109140 msgr2=0x7f7f9419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f91e00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f94109140 0x7f7f9419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f91e00640 1 -- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f941049c0 msgr2=0x7f7f9419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f91e00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f941049c0 0x7f7f9419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.461+0000 7f7f91e00640 1 -- 172.21.15.38:0/1495367489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9419f670 con 0x7f7f94104010 2024-09-12T12:25:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.462+0000 7f7f91e00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f94104010 0x7f7f9419a6c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400e9f0 tx=0x7f7f8400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.462+0000 7f7f8aa00640 1 -- 172.21.15.38:0/1495367489 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400ccc0 con 0x7f7f94104010 2024-09-12T12:25:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.462+0000 7f7f8aa00640 1 -- 172.21.15.38:0/1495367489 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f84010910 con 0x7f7f94104010 2024-09-12T12:25:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.462+0000 7f7f8aa00640 1 -- 172.21.15.38:0/1495367489 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84018960 con 0x7f7f94104010 2024-09-12T12:25:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.462+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9419f960 con 0x7f7f94104010 2024-09-12T12:25:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.462+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f941a7240 con 0x7f7f94104010 2024-09-12T12:25:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.463+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f941043f0 con 0x7f7f94104010 2024-09-12T12:25:53.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.465+0000 7f7f8aa00640 1 -- 172.21.15.38:0/1495367489 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f84010ac0 con 0x7f7f94104010 2024-09-12T12:25:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.466+0000 7f7f8aa00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7f780a2b80 0x7f7f780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.467+0000 7f7f8aa00640 1 -- 172.21.15.38:0/1495367489 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7f840cfb60 con 0x7f7f94104010 2024-09-12T12:25:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.467+0000 7f7f8be00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7f780a2b80 0x7f7f780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.467+0000 7f7f8be00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7f780a2b80 0x7f7f780a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7f940ffe70 tx=0x7f7f7c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.468+0000 7f7f8aa00640 1 -- 172.21.15.38:0/1495367489 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f8409c060 con 0x7f7f94104010 2024-09-12T12:25:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:53 smithi071 ceph-mon[34859]: pgmap v392: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T12:25:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:53 smithi071 ceph-mon[34859]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:53.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:53 smithi154 ceph-mon[35578]: pgmap v392: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T12:25:53.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:53 smithi154 ceph-mon[35578]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:53.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.693+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f9410c380 con 0x7f7f94104010 2024-09-12T12:25:53.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.694+0000 7f7f8aa00640 1 -- 172.21.15.38:0/1495367489 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7f7f840a0360 con 0x7f7f94104010 2024-09-12T12:25:53.694 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:53.694 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:25:53.694 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7f780a2b80 msgr2=0x7f7f780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7f780a2b80 0x7f7f780a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7f940ffe70 tx=0x7f7f7c005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f94104010 msgr2=0x7f7f9419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f94104010 0x7f7f9419a6c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400e9f0 tx=0x7f7f8400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 shutdown_connections 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7f780a2b80 0x7f7f780a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f94109140 0x7f7f9419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f941049c0 0x7f7f9419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 --2- 172.21.15.38:0/1495367489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f94104010 0x7f7f9419a6c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.697+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 >> 172.21.15.38:0/1495367489 conn(0x7f7f940ffa50 msgr2=0x7f7f94100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.698+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 shutdown_connections 2024-09-12T12:25:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:53.698+0000 7f7f98a00640 1 -- 172.21.15.38:0/1495367489 wait complete. 2024-09-12T12:25:54.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:54 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1495367489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:54.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:25:54.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:54 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1495367489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:54.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:54 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1495367489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:54.930 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:55.407 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:55 smithi038 ceph-mon[30810]: pgmap v393: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T12:25:55.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf79600640 1 -- 172.21.15.38:0/2970923369 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0319b0 con 0x7faf7c101de0 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 -- 172.21.15.38:0/2970923369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c101de0 msgr2=0x7faf7c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 --2- 172.21.15.38:0/2970923369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c101de0 0x7faf7c1021c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009900 tx=0x7faf6c02a410 comp rx=0 tx=0).stop 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 -- 172.21.15.38:0/2970923369 shutdown_connections 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 --2- 172.21.15.38:0/2970923369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf7c106f10 0x7faf7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 --2- 172.21.15.38:0/2970923369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c102790 0x7faf7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 --2- 172.21.15.38:0/2970923369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c101de0 0x7faf7c1021c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 -- 172.21.15.38:0/2970923369 >> 172.21.15.38:0/2970923369 conn(0x7faf7c0fd8c0 msgr2=0x7faf7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 -- 172.21.15.38:0/2970923369 shutdown_connections 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.519+0000 7faf81a00640 1 -- 172.21.15.38:0/2970923369 wait complete. 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 Processor -- start 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 -- start start 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf7c101de0 0x7faf7c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c102790 0x7faf7c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c106f10 0x7faf7c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c111f30 con 0x7faf7c102790 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c111db0 con 0x7faf7c101de0 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.521+0000 7faf81a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c1120b0 con 0x7faf7c106f10 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf7c101de0 0x7faf7c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7b400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c106f10 0x7faf7c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7a000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c102790 0x7faf7c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf7c101de0 0x7faf7c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:43572/0 (socket says 172.21.15.38:43572) 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7aa00640 1 -- 172.21.15.38:0/393381698 learned_addr learned my addr 172.21.15.38:0/393381698 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7b400640 1 -- 172.21.15.38:0/393381698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf7c101de0 msgr2=0x7faf7c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7b400640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf7c101de0 0x7faf7c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7b400640 1 -- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c102790 msgr2=0x7faf7c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7b400640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c102790 0x7faf7c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7b400640 1 -- 172.21.15.38:0/393381698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c19f5e0 con 0x7faf7c106f10 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.522+0000 7faf7b400640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c106f10 0x7faf7c19ef00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf74009fd0 tx=0x7faf7400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.523+0000 7faf73400640 1 -- 172.21.15.38:0/393381698 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400ce20 con 0x7faf7c106f10 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.523+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c19f8d0 con 0x7faf7c106f10 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.523+0000 7faf73400640 1 -- 172.21.15.38:0/393381698 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf74005020 con 0x7faf7c106f10 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.523+0000 7faf73400640 1 -- 172.21.15.38:0/393381698 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74010720 con 0x7faf7c106f10 2024-09-12T12:25:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.523+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c1a71b0 con 0x7faf7c106f10 2024-09-12T12:25:55.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.524+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c1021c0 con 0x7faf7c106f10 2024-09-12T12:25:55.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.526+0000 7faf73400640 1 -- 172.21.15.38:0/393381698 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faf74005540 con 0x7faf7c106f10 2024-09-12T12:25:55.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.527+0000 7faf73400640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf600a2b80 0x7faf600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.527+0000 7faf73400640 1 -- 172.21.15.38:0/393381698 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faf740cfad0 con 0x7faf7c106f10 2024-09-12T12:25:55.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.527+0000 7faf7aa00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf600a2b80 0x7faf600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.528+0000 7faf7aa00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf600a2b80 0x7faf600a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0096c0 tx=0x7faf6c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:55.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.532+0000 7faf73400640 1 -- 172.21.15.38:0/393381698 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf7409c620 con 0x7faf7c106f10 2024-09-12T12:25:55.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:55 smithi154 ceph-mon[35578]: pgmap v393: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T12:25:55.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.722+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf7c1a7450 con 0x7faf7c106f10 2024-09-12T12:25:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.724+0000 7faf73400640 1 -- 172.21.15.38:0/393381698 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24865 (secure 0 0 0) 0x7faf7409bf20 con 0x7faf7c106f10 2024-09-12T12:25:55.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:25:55.725 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:24:35.829591+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf600a2b80 msgr2=0x7faf600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf600a2b80 0x7faf600a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0096c0 tx=0x7faf6c005a20 comp rx=0 tx=0).stop 2024-09-12T12:25:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c106f10 msgr2=0x7faf7c19ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c106f10 0x7faf7c19ef00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf74009fd0 tx=0x7faf7400ef10 comp rx=0 tx=0).stop 2024-09-12T12:25:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 shutdown_connections 2024-09-12T12:25:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf600a2b80 0x7faf600a5040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c106f10 0x7faf7c19ef00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf7c102790 0x7faf7c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 --2- 172.21.15.38:0/393381698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf7c101de0 0x7faf7c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.726+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 >> 172.21.15.38:0/393381698 conn(0x7faf7c0fd8c0 msgr2=0x7faf7c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.727+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 shutdown_connections 2024-09-12T12:25:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:55.727+0000 7faf81a00640 1 -- 172.21.15.38:0/393381698 wait complete. 2024-09-12T12:25:55.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:55 smithi071 ceph-mon[34859]: pgmap v393: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T12:25:56.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:56 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/393381698' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:56.635 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T12:25:56.635 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T12:25:56.649 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T12:25:56.649 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T12:25:56.650 INFO:tasks.workunit:timeout=3h 2024-09-12T12:25:56.650 INFO:tasks.workunit:cleanup=True 2024-09-12T12:25:56.650 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:56.650 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T12:25:56.651 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:25:56.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:25:56.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:56 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/393381698' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:56.687 INFO:teuthology.orchestra.run.smithi038.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:56.687 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T12:25:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T12:25:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:25:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T12:25:56.687 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-12 12:23:57.736241292 +0000 2024-09-12T12:25:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-12 12:23:57.736241292 +0000 2024-09-12T12:25:56.688 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-12 12:25:45.968172101 +0000 2024-09-12T12:25:56.688 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-12 12:23:57.736241292 +0000 2024-09-12T12:25:56.688 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:56.688 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T12:25:56.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:56 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/393381698' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:56.801 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T12:25:56.839 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T12:25:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:57.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:57 smithi038 ceph-mon[30810]: pgmap v394: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T12:25:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 -- 172.21.15.38:0/125469621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9524108f60 msgr2=0x7f9524110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 --2- 172.21.15.38:0/125469621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9524108f60 0x7f9524110ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f951c009860 tx=0x7f951c02a340 comp rx=0 tx=0).stop 2024-09-12T12:25:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 -- 172.21.15.38:0/125469621 shutdown_connections 2024-09-12T12:25:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 --2- 172.21.15.38:0/125469621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9524108f60 0x7f9524110ae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 --2- 172.21.15.38:0/125469621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95241047e0 0x7f9524108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 --2- 172.21.15.38:0/125469621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524103e30 0x7f9524104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 -- 172.21.15.38:0/125469621 >> 172.21.15.38:0/125469621 conn(0x7f95240ff910 msgr2=0x7f9524101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 -- 172.21.15.38:0/125469621 shutdown_connections 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.638+0000 7f9529800640 1 -- 172.21.15.38:0/125469621 wait complete. 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.639+0000 7f9529800640 1 Processor -- start 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9529800640 1 -- start start 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9529800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9524103e30 0x7f952419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9529800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95241047e0 0x7f952419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9529800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524108f60 0x7f952419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9529800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9524113fc0 con 0x7f9524108f60 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9529800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9524113e40 con 0x7f95241047e0 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9529800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9524114140 con 0x7f9524103e30 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9528e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524108f60 0x7f952419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9523e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9524103e30 0x7f952419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9528e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524108f60 0x7f952419ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36644/0 (socket says 172.21.15.38:36644) 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f9528e00640 1 -- 172.21.15.38:0/1090701366 learned_addr learned my addr 172.21.15.38:0/1090701366 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.640+0000 7f951b400640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95241047e0 0x7f952419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f9528e00640 1 -- 172.21.15.38:0/1090701366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9524103e30 msgr2=0x7f952419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f9528e00640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9524103e30 0x7f952419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f9528e00640 1 -- 172.21.15.38:0/1090701366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95241047e0 msgr2=0x7f952419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f9528e00640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95241047e0 0x7f952419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f9528e00640 1 -- 172.21.15.38:0/1090701366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952419f450 con 0x7f9524108f60 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f9523e00640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9524103e30 0x7f952419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f951b400640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95241047e0 0x7f952419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.641+0000 7f9528e00640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524108f60 0x7f952419ed70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f951c02a930 tx=0x7f951c033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.642+0000 7f9521600640 1 -- 172.21.15.38:0/1090701366 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c037040 con 0x7f9524108f60 2024-09-12T12:25:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.642+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952419f6e0 con 0x7f9524108f60 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.642+0000 7f9521600640 1 -- 172.21.15.38:0/1090701366 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f951c032770 con 0x7f9524108f60 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.642+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95241a7020 con 0x7f9524108f60 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.642+0000 7f9521600640 1 -- 172.21.15.38:0/1090701366 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c005580 con 0x7f9524108f60 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.645+0000 7f9521600640 1 -- 172.21.15.38:0/1090701366 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f951c004370 con 0x7f9524108f60 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.646+0000 7f9521600640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f95080a2d20 0x7f95080a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.646+0000 7f952da67740 1 Processor -- start 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.646+0000 7f9521600640 1 -- 172.21.15.38:0/1090701366 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f951c0ef210 con 0x7f9524108f60 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.646+0000 7f952da67740 1 -- start start 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f9523e00640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f95080a2d20 0x7f95080a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f952da67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d26039fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f952da67740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d2604d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f952da67740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d2604fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f952da67740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563d25fa0290 con 0x563d2604d6a0 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f952da67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d25f47b40 con 0x563d26039bd0 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f952da67740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563d25f9c250 con 0x563d2603a4f0 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.647+0000 7f9528e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d2604fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f951b400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d2604d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d2604fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36654/0 (socket says 172.21.15.38:36654) 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 -- 172.21.15.38:0/3949482430 learned_addr learned my addr 172.21.15.38:0/3949482430 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9523e00640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f95080a2d20 0x7f95080a51e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9514005fd0 tx=0x7f9514010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9523e00640 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d26039fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 -- 172.21.15.38:0/3949482430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 msgr2=0x563d2604d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d2604d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 -- 172.21.15.38:0/3949482430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 msgr2=0x563d26039fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d26039fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 -- 172.21.15.38:0/3949482430 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d25d116a0 con 0x563d2604d6a0 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f951b400640 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d2604d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9523e00640 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d26039fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.648+0000 7f9528e00640 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d2604fa90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f951c0c3da0 tx=0x7f951c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f1d52ec001160a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f9519600640 1 -- 172.21.15.38:0/3949482430 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c0bbd60 con 0x563d2604d6a0 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f9519600640 1 -- 172.21.15.38:0/3949482430 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f951c0bb660 con 0x563d2604d6a0 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f9519600640 1 -- 172.21.15.38:0/3949482430 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c0afe90 con 0x563d2604d6a0 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f952da67740 1 -- 172.21.15.38:0/3949482430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 msgr2=0x563d2604fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f952da67740 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d2604fa90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f951c0c3da0 tx=0x7f951c005030 comp rx=0 tx=0).stop 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f952da67740 1 -- 172.21.15.38:0/3949482430 shutdown_connections 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f952da67740 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d2604fa90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f952da67740 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d2604d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f952da67740 1 --2- 172.21.15.38:0/3949482430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d26039fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.649+0000 7f952da67740 1 -- 172.21.15.38:0/3949482430 >> 172.21.15.38:0/3949482430 conn(0x563d26036240 msgr2=0x563d26036620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.650+0000 7f952da67740 1 -- 172.21.15.38:0/3949482430 shutdown_connections 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.650+0000 7f952da67740 1 -- 172.21.15.38:0/3949482430 wait complete. 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.650+0000 7f952da67740 1 -- start start 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 1 Processor -- start 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d2604d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2603a4f0 0x563d2604a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2604d6a0 0x563d2604a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563d2604ffd0 con 0x563d2603a4f0 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d25f5afa0 con 0x563d26039bd0 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563d26050150 con 0x563d2604d6a0 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.651+0000 7f952da67740 10 client.0 _ll_register_callbacks cb 0x563d25caeba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9523e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d2604d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2604d6a0 0x563d2604a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f951b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2603a4f0 0x563d2604a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2604d6a0 0x563d2604a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:50398/0 (socket says 172.21.15.38:50398) 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9523e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d2604d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:44040/0 (socket says 172.21.15.38:44040) 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 -- 172.21.15.38:0/3773036006 learned_addr learned my addr 172.21.15.38:0/3773036006 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 -- 172.21.15.38:0/3773036006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 msgr2=0x563d2604d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d2604d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 -- 172.21.15.38:0/3773036006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2603a4f0 msgr2=0x563d2604a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2603a4f0 0x563d2604a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 -- 172.21.15.38:0/3773036006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d2604b170 con 0x563d2604d6a0 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9528e00640 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2604d6a0 0x563d2604a940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f951c004320 tx=0x7f951c0c42d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b5fb58ae391ff81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.652+0000 7f9512000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:25:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f9512000640 1 -- 172.21.15.38:0/3773036006 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c0d3070 con 0x563d2604d6a0 2024-09-12T12:25:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f951c0bb660 con 0x563d2604d6a0 2024-09-12T12:25:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f9512000640 1 -- 172.21.15.38:0/3773036006 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f951c0c3e40 con 0x563d2604d6a0 2024-09-12T12:25:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f9512000640 1 -- 172.21.15.38:0/3773036006 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f951c0bbd60 con 0x563d2604d6a0 2024-09-12T12:25:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f952da67740 10 client.25288 fetch_fsmap learned FSMap version 30 2024-09-12T12:25:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563d2604ffd0 con 0x563d2604d6a0 2024-09-12T12:25:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f9512000640 1 -- 172.21.15.38:0/3773036006 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f951c0bb660 con 0x563d2604d6a0 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f9512000640 1 -- 172.21.15.38:0/3773036006 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f951c03a070 con 0x563d2604d6a0 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f952da67740 10 client.25288 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.653+0000 7f952da67740 10 client.25288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.654+0000 7f952da67740 20 client.25288 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.654+0000 7f952da67740 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d2605d190 0x563d2605f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.654+0000 7f952da67740 4 client.25288 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.654+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d25fad800 con 0x563d2605d190 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.654+0000 7f9523e00640 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d2605d190 0x563d2605f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.655+0000 7f9523e00640 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d2605d190 0x563d2605f5b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=667fb58b7ad28e35 server_cookie=7594e3012d3523ca in_seq=0 out_seq=0 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.655+0000 7f9512000640 10 client.25288 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.655+0000 7f9512000640 1 -- 172.21.15.38:0/3773036006 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d25fad800 con 0x563d2605d190 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.655+0000 7f9512000640 10 client.25288 handle_command_reply: tid=0 2024-09-12T12:25:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 client.25288 shutdown 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2604d6a0 msgr2=0x563d2604a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2604d6a0 0x563d2604a940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f951c004320 tx=0x7f951c0c42d0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 shutdown_connections 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d2605d190 0x563d2605f5b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2604d6a0 0x563d2604a940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2603a4f0 0x563d2604a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 --2- 172.21.15.38:0/3773036006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d26039bd0 0x563d2604d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 >> 172.21.15.38:0/3773036006 conn(0x563d26036240 msgr2=0x563d2603bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f9512000640 0 client.25288 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 shutdown_connections 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 1 -- 172.21.15.38:0/3773036006 wait complete. 2024-09-12T12:25:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.656+0000 7f952da67740 20 client.25288 trim_cache size 0 max 16384 2024-09-12T12:25:57.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:57 smithi154 ceph-mon[35578]: pgmap v394: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.687+0000 7f952da67740 1 Processor -- start 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.687+0000 7f952da67740 1 -- start start 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f952da67740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d26039bd0 0x563d2604c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f952da67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2603a4f0 0x563d26064e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f952da67740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d260653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f952da67740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f95241ac9d0 con 0x563d2604d6a0 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f952da67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95241ae510 con 0x563d2603a4f0 2024-09-12T12:25:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f952da67740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95241ad0a0 con 0x563d26039bd0 2024-09-12T12:25:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f9528e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d260653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f9528e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d260653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36674/0 (socket says 172.21.15.38:36674) 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f9528e00640 1 -- 172.21.15.38:0/1359381824 learned_addr learned my addr 172.21.15.38:0/1359381824 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f9523e00640 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d26039bd0 0x563d2604c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.688+0000 7f951b400640 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2603a4f0 0x563d26064e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f951b400640 1 -- 172.21.15.38:0/1359381824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d26039bd0 msgr2=0x563d2604c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f951b400640 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d26039bd0 0x563d2604c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f951b400640 1 -- 172.21.15.38:0/1359381824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 msgr2=0x563d260653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f951b400640 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d260653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f951b400640 1 -- 172.21.15.38:0/1359381824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d26059230 con 0x563d2603a4f0 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f951b400640 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2603a4f0 0x563d26064e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x563d2604b990 tx=0x7f950c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43d648afc3241d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f9518c00640 1 -- 172.21.15.38:0/1359381824 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c012e40 con 0x563d2603a4f0 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f9518c00640 1 -- 172.21.15.38:0/1359381824 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950c00f870 con 0x563d2603a4f0 2024-09-12T12:25:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.689+0000 7f9518c00640 1 -- 172.21.15.38:0/1359381824 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c003850 con 0x563d2603a4f0 2024-09-12T12:25:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 -- 172.21.15.38:0/1359381824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2603a4f0 msgr2=0x563d26064e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2603a4f0 0x563d26064e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x563d2604b990 tx=0x7f950c005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 -- 172.21.15.38:0/1359381824 shutdown_connections 2024-09-12T12:25:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d2604d6a0 0x563d260653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2603a4f0 0x563d26064e80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 --2- 172.21.15.38:0/1359381824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d26039bd0 0x563d2604c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 -- 172.21.15.38:0/1359381824 >> 172.21.15.38:0/1359381824 conn(0x563d26036240 msgr2=0x563d26049310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 -- 172.21.15.38:0/1359381824 shutdown_connections 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.690+0000 7f952da67740 1 -- 172.21.15.38:0/1359381824 wait complete. 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 -- start start 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 Processor -- start 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d26039bd0 0x563d26051820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d26051d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2604d6a0 0x563d260c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f95241ade40 con 0x563d26039bd0 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95241ad770 con 0x563d2604d6a0 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95241aa9b0 con 0x563d2603a4f0 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.691+0000 7f952da67740 10 client.0 _ll_register_callbacks cb 0x7f950c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d26039bd0 0x563d26051820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d26039bd0 0x563d26051820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36690/0 (socket says 172.21.15.38:36690) 2024-09-12T12:25:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 -- 172.21.15.38:0/1236864732 learned_addr learned my addr 172.21.15.38:0/1236864732 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f951b400640 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d26051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9528e00640 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2604d6a0 0x563d260c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 -- 172.21.15.38:0/1236864732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 msgr2=0x563d26051d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d26051d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 -- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2604d6a0 msgr2=0x563d260c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2604d6a0 0x563d260c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 -- 172.21.15.38:0/1236864732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d260c7390 con 0x563d26039bd0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9523e00640 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d26039bd0 0x563d26051820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x563d2605fdc0 tx=0x7f9514004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552c206e335b4968 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.692+0000 7f9512000640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.693+0000 7f9512000640 1 -- 172.21.15.38:0/1236864732 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514029d30 con 0x563d26039bd0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.693+0000 7f9512000640 1 -- 172.21.15.38:0/1236864732 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f9514004b20 con 0x563d26039bd0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.693+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950c00f870 con 0x563d26039bd0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.693+0000 7f9512000640 1 -- 172.21.15.38:0/1236864732 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f951403d050 con 0x563d26039bd0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.693+0000 7f952da67740 10 client.15306 fetch_fsmap learned FSMap version 30 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.693+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563d260c8700 con 0x563d26039bd0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.693+0000 7f9512000640 1 -- 172.21.15.38:0/1236864732 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950c00f870 con 0x563d26039bd0 2024-09-12T12:25:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f9512000640 1 -- 172.21.15.38:0/1236864732 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f951400b040 con 0x563d26039bd0 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f952da67740 10 client.15306 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f952da67740 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f952da67740 20 client.15306 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f952da67740 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d260c8e50 0x563d260cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f952da67740 4 client.15306 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563d25fa7d10 con 0x563d260c8e50 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.694+0000 7f951b400640 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d260c8e50 0x563d260cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.695+0000 7f951b400640 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d260c8e50 0x563d260cb270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6653738e4842c240 server_cookie=146f824af7e8614b in_seq=0 out_seq=0 2024-09-12T12:25:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.695+0000 7f9512000640 10 client.15306 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f9512000640 1 -- 172.21.15.38:0/1236864732 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d25fa7d10 con 0x563d260c8e50 2024-09-12T12:25:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f9512000640 10 client.15306 handle_command_reply: tid=0 2024-09-12T12:25:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 client.15306 shutdown 2024-09-12T12:25:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d26039bd0 msgr2=0x563d26051820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d26039bd0 0x563d26051820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x563d2605fdc0 tx=0x7f9514004a40 comp rx=0 tx=0).stop 2024-09-12T12:25:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 shutdown_connections 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x563d260c8e50 0x563d260cb270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d2604d6a0 0x563d260c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d2603a4f0 0x563d26051d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 --2- 172.21.15.38:0/1236864732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563d26039bd0 0x563d26051820 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 >> 172.21.15.38:0/1236864732 conn(0x563d26036240 msgr2=0x563d26034a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f9512000640 0 client.15306 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 shutdown_connections 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.696+0000 7f952da67740 1 -- 172.21.15.38:0/1236864732 wait complete. 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.697+0000 7f952da67740 20 client.15306 trim_cache size 0 max 16384 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:57.699 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-12T12:25:57.700 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "fd648094-6eae-46a3-8ae2-0908c8a0a4d7", 2024-09-12T12:25:57.700 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-12T12:25:57.700 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.697+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f95080a2d20 msgr2=0x7f95080a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.697+0000 7f9529800640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f95080a2d20 0x7f95080a51e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9514005fd0 tx=0x7f9514010040 comp rx=0 tx=0).stop 2024-09-12T12:25:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.697+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524108f60 msgr2=0x7f952419ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.697+0000 7f9529800640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524108f60 0x7f952419ed70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f951c02a930 tx=0x7f951c033d10 comp rx=0 tx=0).stop 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 shutdown_connections 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f95080a2d20 0x7f95080a51e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9524108f60 0x7f952419ed70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95241047e0 0x7f952419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 --2- 172.21.15.38:0/1090701366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9524103e30 0x7f952419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 >> 172.21.15.38:0/1090701366 conn(0x7f95240ff910 msgr2=0x7f9524100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 shutdown_connections 2024-09-12T12:25:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:57.698+0000 7f9529800640 1 -- 172.21.15.38:0/1090701366 wait complete. 2024-09-12T12:25:57.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:57 smithi071 ceph-mon[34859]: pgmap v394: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T12:25:58.529 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:25:58.619 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:58 smithi038 ceph-mon[30810]: scrub queued for path: / 2024-09-12T12:25:58.619 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:58 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:25:58.619 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:58 smithi038 ceph-mon[30810]: scrub summary: active paths [/] 2024-09-12T12:25:58.619 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:58 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:25:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:58 smithi154 ceph-mon[35578]: scrub queued for path: / 2024-09-12T12:25:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:58 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:25:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:58 smithi154 ceph-mon[35578]: scrub summary: active paths [/] 2024-09-12T12:25:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:58 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:25:58.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:58 smithi071 ceph-mon[34859]: scrub queued for path: / 2024-09-12T12:25:58.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:58 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:25:58.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:58 smithi071 ceph-mon[34859]: scrub summary: active paths [/] 2024-09-12T12:25:58.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:58 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:25:58.947 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:59.429 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:25:59 smithi038 ceph-mon[30810]: pgmap v395: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-12T12:25:59.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 -- 172.21.15.38:0/1100285732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981079c0 msgr2=0x7f8298107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 --2- 172.21.15.38:0/1100285732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981079c0 0x7f8298107da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8288009930 tx=0x7f828802a420 comp rx=0 tx=0).stop 2024-09-12T12:25:59.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 -- 172.21.15.38:0/1100285732 shutdown_connections 2024-09-12T12:25:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 --2- 172.21.15.38:0/1100285732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 0x7f829810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 --2- 172.21.15.38:0/1100285732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82981019c0 0x7f8298101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 --2- 172.21.15.38:0/1100285732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981079c0 0x7f8298107da0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 -- 172.21.15.38:0/1100285732 >> 172.21.15.38:0/1100285732 conn(0x7f82980fd740 msgr2=0x7f82980ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 -- 172.21.15.38:0/1100285732 shutdown_connections 2024-09-12T12:25:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.545+0000 7f8297200640 1 -- 172.21.15.38:0/1100285732 wait complete. 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 Processor -- start 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 -- start start 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981019c0 0x7f829819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 0x7f829819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82981079c0 0x7f829819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8298111e10 con 0x7f82981019c0 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8298111c90 con 0x7f8298102360 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8297200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8298111f90 con 0x7f82981079c0 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.547+0000 7f8295e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981019c0 0x7f829819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 0x7f829819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 0x7f829819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:44070/0 (socket says 172.21.15.38:44070) 2024-09-12T12:25:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 -- 172.21.15.38:0/4168752779 learned_addr learned my addr 172.21.15.38:0/4168752779 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8296800640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82981079c0 0x7f829819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 -- 172.21.15.38:0/4168752779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82981079c0 msgr2=0x7f829819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82981079c0 0x7f829819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 -- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981019c0 msgr2=0x7f829819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981019c0 0x7f829819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 -- 172.21.15.38:0/4168752779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829819f4b0 con 0x7f8298102360 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.548+0000 7f8295400640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 0x7f829819aa40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f828400e9f0 tx=0x7f828400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.549+0000 7f828ea00640 1 -- 172.21.15.38:0/4168752779 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828400ccc0 con 0x7f8298102360 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.549+0000 7f828ea00640 1 -- 172.21.15.38:0/4168752779 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f828400ce60 con 0x7f8298102360 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.549+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829819f7a0 con 0x7f8298102360 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.549+0000 7f828ea00640 1 -- 172.21.15.38:0/4168752779 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284010690 con 0x7f8298102360 2024-09-12T12:25:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.549+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82981a7080 con 0x7f8298102360 2024-09-12T12:25:59.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.553+0000 7f829f493740 1 Processor -- start 2024-09-12T12:25:59.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.553+0000 7f829f493740 1 -- start start 2024-09-12T12:25:59.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.553+0000 7f828ea00640 1 -- 172.21.15.38:0/4168752779 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f82840046c0 con 0x7f8298102360 2024-09-12T12:25:59.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f829f493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f829f493740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f829f493740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f829f493740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a8a6a073e0 con 0x55a8a6aabf30 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f829f493740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a8a69aed80 con 0x55a8a6aa1670 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f829f493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8a6a033a0 con 0x55a8a6aa0d50 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f8295e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f8295e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:44072/0 (socket says 172.21.15.38:44072) 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f8295e00640 1 -- 172.21.15.38:0/2965651745 learned_addr learned my addr 172.21.15.38:0/2965651745 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f8295400640 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.554+0000 7f8296800640 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8295e00640 1 -- 172.21.15.38:0/2965651745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 msgr2=0x55a8a6aa1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8295e00640 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8295e00640 1 -- 172.21.15.38:0/2965651745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 msgr2=0x55a8a6aae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8295e00640 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8295e00640 1 -- 172.21.15.38:0/2965651745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8a69cdae0 con 0x55a8a6aa1670 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8295400640 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8295e00640 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aab9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8288009930 tx=0x7f8288005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712209099e783589 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f828ea00640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f827c0a2c00 0x7f827c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8283000640 1 -- 172.21.15.38:0/2965651745 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288035040 con 0x55a8a6aa1670 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8283000640 1 -- 172.21.15.38:0/2965651745 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288005520 con 0x55a8a6aa1670 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.555+0000 7f8283000640 1 -- 172.21.15.38:0/2965651745 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82880035f0 con 0x55a8a6aa1670 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.556+0000 7f828ea00640 1 -- 172.21.15.38:0/4168752779 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f82840cf750 con 0x7f8298102360 2024-09-12T12:25:59.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.556+0000 7f8296800640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f827c0a2c00 0x7f827c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 -- 172.21.15.38:0/2965651745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 msgr2=0x55a8a6aab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f8296800640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f827c0a2c00 0x7f827c0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8290005fd0 tx=0x7f8290009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aab9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8288009930 tx=0x7f8288005de0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 -- 172.21.15.38:0/2965651745 shutdown_connections 2024-09-12T12:25:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aab9f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 --2- 172.21.15.38:0/2965651745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 -- 172.21.15.38:0/2965651745 >> 172.21.15.38:0/2965651745 conn(0x55a8a6a9d2e0 msgr2=0x55a8a6a9d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 -- 172.21.15.38:0/2965651745 shutdown_connections 2024-09-12T12:25:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 -- 172.21.15.38:0/2965651745 wait complete. 2024-09-12T12:25:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.557+0000 7f829f493740 1 -- start start 2024-09-12T12:25:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.558+0000 7f829f493740 1 Processor -- start 2024-09-12T12:25:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.558+0000 7f829f493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f829f493740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f829f493740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f829f493740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a8a6aaeba0 con 0x55a8a6aabf30 2024-09-12T12:25:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f829f493740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a8a69c20f0 con 0x55a8a6aa1670 2024-09-12T12:25:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f829f493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8a6aaed20 con 0x55a8a6aa0d50 2024-09-12T12:25:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f829f493740 10 client.0 _ll_register_callbacks cb 0x55a8a69b39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f8296800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f8295e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f8295e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:50452/0 (socket says 172.21.15.38:50452) 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f8295e00640 1 -- 172.21.15.38:0/4219607134 learned_addr learned my addr 172.21.15.38:0/4219607134 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f8295400640 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.559+0000 7f8295400640 1 -- 172.21.15.38:0/4219607134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 msgr2=0x55a8a6aa8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8295400640 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8295400640 1 -- 172.21.15.38:0/4219607134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 msgr2=0x55a8a6aa9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8295400640 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8295400640 1 -- 172.21.15.38:0/4219607134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8a67783c0 con 0x55a8a6aa1670 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8295e00640 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8295400640 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa92c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82840ccef0 tx=0x7f8284097ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=504eb9177f7d35c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8277400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:25:59.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8277400640 1 -- 172.21.15.38:0/4219607134 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828409b560 con 0x55a8a6aa1670 2024-09-12T12:25:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8288005520 con 0x55a8a6aa1670 2024-09-12T12:25:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8277400640 1 -- 172.21.15.38:0/4219607134 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f82840a43e0 con 0x55a8a6aa1670 2024-09-12T12:25:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f8277400640 1 -- 172.21.15.38:0/4219607134 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f828409c300 con 0x55a8a6aa1670 2024-09-12T12:25:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f829f493740 10 client.25325 fetch_fsmap learned FSMap version 30 2024-09-12T12:25:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.560+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a8a6aba8c0 con 0x55a8a6aa1670 2024-09-12T12:25:59.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f8277400640 1 -- 172.21.15.38:0/4219607134 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288005520 con 0x55a8a6aa1670 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f8277400640 1 -- 172.21.15.38:0/4219607134 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f828409b050 con 0x55a8a6aa1670 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f829f493740 10 client.25325 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f829f493740 10 client.25325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f829f493740 20 client.25325 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f829f493740 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6abbcd0 0x55a8a6abe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f829f493740 4 client.25325 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.561+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8a6a14950 con 0x55a8a6abbcd0 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.562+0000 7f8295e00640 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6abbcd0 0x55a8a6abe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.562+0000 7f8295e00640 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6abbcd0 0x55a8a6abe0c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd58ca4a2b326f0b server_cookie=8179a0b8aa692f2f in_seq=0 out_seq=0 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.562+0000 7f8277400640 10 client.25325 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f8277400640 1 -- 172.21.15.38:0/4219607134 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8a6a14950 con 0x55a8a6abbcd0 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f8277400640 10 client.25325 handle_command_reply: tid=0 2024-09-12T12:25:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 client.25325 shutdown 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 msgr2=0x55a8a6aa92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa92c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82840ccef0 tx=0x7f8284097ea0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 shutdown_connections 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6abbcd0 0x55a8a6abe0c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa92c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 --2- 172.21.15.38:0/4219607134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f8277400640 0 client.25325 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.563+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 >> 172.21.15.38:0/4219607134 conn(0x55a8a6a9d2e0 msgr2=0x55a8a6aa2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.564+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 shutdown_connections 2024-09-12T12:25:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.564+0000 7f829f493740 1 -- 172.21.15.38:0/4219607134 wait complete. 2024-09-12T12:25:59.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.564+0000 7f829f493740 20 client.25325 trim_cache size 0 max 16384 2024-09-12T12:25:59.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 Processor -- start 2024-09-12T12:25:59.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 -- start start 2024-09-12T12:25:59.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6ac3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa1670 0x55a8a6ac3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f82981b0e10 con 0x55a8a6aa1670 2024-09-12T12:25:59.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f82981b2950 con 0x55a8a6aabf30 2024-09-12T12:25:59.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.582+0000 7f829f493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82981b14e0 con 0x55a8a6aa0d50 2024-09-12T12:25:59.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6ac3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa1670 0x55a8a6ac3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6ac3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:50456/0 (socket says 172.21.15.38:50456) 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 -- 172.21.15.38:0/1574735791 learned_addr learned my addr 172.21.15.38:0/1574735791 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8296800640 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 -- 172.21.15.38:0/1574735791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 msgr2=0x55a8a6aa5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 -- 172.21.15.38:0/1574735791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa1670 msgr2=0x55a8a6ac3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa1670 0x55a8a6ac3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295e00640 1 -- 172.21.15.38:0/1574735791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8a6aa14a0 con 0x55a8a6aa0d50 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.583+0000 7f8295400640 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa1670 0x55a8a6ac3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.584+0000 7f8295e00640 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6ac3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8288004b10 tx=0x7f8288004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beff2becc93fca9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.584+0000 7f8282600640 1 -- 172.21.15.38:0/1574735791 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288035040 con 0x55a8a6aa0d50 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.584+0000 7f8282600640 1 -- 172.21.15.38:0/1574735791 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288004380 con 0x55a8a6aa0d50 2024-09-12T12:25:59.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.584+0000 7f8282600640 1 -- 172.21.15.38:0/1574735791 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288003850 con 0x55a8a6aa0d50 2024-09-12T12:25:59.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 -- 172.21.15.38:0/1574735791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 msgr2=0x55a8a6ac3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6ac3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8288004b10 tx=0x7f8288004b40 comp rx=0 tx=0).stop 2024-09-12T12:25:59.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 -- 172.21.15.38:0/1574735791 shutdown_connections 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa1670 0x55a8a6ac3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 --2- 172.21.15.38:0/1574735791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa0d50 0x55a8a6ac3990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 -- 172.21.15.38:0/1574735791 >> 172.21.15.38:0/1574735791 conn(0x55a8a6a9d2e0 msgr2=0x55a8a6aaae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 -- 172.21.15.38:0/1574735791 shutdown_connections 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.585+0000 7f829f493740 1 -- 172.21.15.38:0/1574735791 wait complete. 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 -- start start 2024-09-12T12:25:59.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 Processor -- start 2024-09-12T12:25:59.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f82981b2280 con 0x55a8a6aa0d50 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f82981b1bb0 con 0x55a8a6aabf30 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82981aedf0 con 0x55a8a6aa1670 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.586+0000 7f829f493740 10 client.0 _ll_register_callbacks cb 0x7f82840d5240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36748/0 (socket says 172.21.15.38:36748) 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 -- 172.21.15.38:0/2474182472 learned_addr learned my addr 172.21.15.38:0/2474182472 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8296800640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 -- 172.21.15.38:0/2474182472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa1670 msgr2=0x55a8a6aa61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 -- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 msgr2=0x55a8a6aa66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295e00640 1 -- 172.21.15.38:0/2474182472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8a6ab23a0 con 0x55a8a6aa0d50 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8295400640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.587+0000 7f8296800640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f8295e00640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa5c60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8288031fd0 tx=0x7f8288005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59f3b2f7b55c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f8277400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f8277400640 1 -- 172.21.15.38:0/2474182472 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288035050 con 0x55a8a6aa0d50 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8288004380 con 0x55a8a6aa0d50 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f8277400640 1 -- 172.21.15.38:0/2474182472 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f82880317c0 con 0x55a8a6aa0d50 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f8277400640 1 -- 172.21.15.38:0/2474182472 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8288069050 con 0x55a8a6aa0d50 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f829f493740 10 client.15324 fetch_fsmap learned FSMap version 30 2024-09-12T12:25:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.588+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a8a6b26b70 con 0x55a8a6aa0d50 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f8277400640 1 -- 172.21.15.38:0/2474182472 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288004380 con 0x55a8a6aa0d50 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f8277400640 1 -- 172.21.15.38:0/2474182472 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f82880634c0 con 0x55a8a6aa0d50 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f829f493740 10 client.15324 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f829f493740 10 client.15324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f829f493740 20 client.15324 populate_metadata read hostname 'smithi038' 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f829f493740 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6b26da0 0x55a8a6b29190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f829f493740 4 client.15324 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a8a6a0ee60 con 0x55a8a6b26da0 2024-09-12T12:25:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.589+0000 7f8295400640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6b26da0 0x55a8a6b29190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f8295400640 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6b26da0 0x55a8a6b29190 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daf7b6608df18a7d server_cookie=805092a052549169 in_seq=0 out_seq=0 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f8277400640 10 client.15324 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f8277400640 1 -- 172.21.15.38:0/2474182472 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a8a6a0ee60 con 0x55a8a6b26da0 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f8277400640 10 client.15324 handle_command_reply: tid=0 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 client.15324 shutdown 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa0d50 msgr2=0x55a8a6aa5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa5c60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8288031fd0 tx=0x7f8288005de0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 shutdown_connections 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55a8a6b26da0 0x55a8a6b29190 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8a6aabf30 0x55a8a6aa66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8a6aa1670 0x55a8a6aa61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f829f493740 1 --2- 172.21.15.38:0/2474182472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8a6aa0d50 0x55a8a6aa5c60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.590+0000 7f8277400640 0 client.15324 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.591+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 >> 172.21.15.38:0/2474182472 conn(0x55a8a6a9d2e0 msgr2=0x55a8a6aa27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.591+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 shutdown_connections 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.591+0000 7f829f493740 1 -- 172.21.15.38:0/2474182472 wait complete. 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.591+0000 7f829f493740 20 client.15324 trim_cache size 0 max 16384 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stdout: "fd648094-6eae-46a3-8ae2-0908c8a0a4d7": { 2024-09-12T12:25:59.595 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-12T12:25:59.596 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "fd648094-6eae-46a3-8ae2-0908c8a0a4d7", 2024-09-12T12:25:59.596 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-12T12:25:59.596 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:25:59.596 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:25:59.596 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:25:59.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f827c0a2c00 msgr2=0x7f827c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f827c0a2c00 0x7f827c0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8290005fd0 tx=0x7f8290009500 comp rx=0 tx=0).stop 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 msgr2=0x7f829819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 0x7f829819aa40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f828400e9f0 tx=0x7f828400edf0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 shutdown_connections 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f827c0a2c00 0x7f827c0a50c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82981079c0 0x7f829819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8298102360 0x7f829819aa40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 --2- 172.21.15.38:0/4168752779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82981019c0 0x7f829819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 >> 172.21.15.38:0/4168752779 conn(0x7f82980fd740 msgr2=0x7f829810cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 shutdown_connections 2024-09-12T12:25:59.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:25:59.592+0000 7f8297200640 1 -- 172.21.15.38:0/4168752779 wait complete. 2024-09-12T12:25:59.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:25:59 smithi154 ceph-mon[35578]: pgmap v395: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-12T12:25:59.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:25:59 smithi071 ceph-mon[34859]: pgmap v395: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-12T12:26:00.463 INFO:tasks.cephfs.filesystem:scrub status for tag:fd648094-6eae-46a3-8ae2-0908c8a0a4d7 - {'path': '/', 'tag': 'fd648094-6eae-46a3-8ae2-0908c8a0a4d7', 'options': 'recursive,force'} 2024-09-12T12:26:01.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:01 smithi154 ceph-mon[35578]: pgmap v396: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T12:26:01.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:01.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:01 smithi038 ceph-mon[30810]: pgmap v396: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T12:26:01.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:01.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:01 smithi071 ceph-mon[34859]: pgmap v396: 129 pgs: 129 active+clean; 651 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T12:26:01.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:01.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:01.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:02.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:02.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:02.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:02 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:02.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:02.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:02.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:02 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:02.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:02.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:02.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:02 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:26:03.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:03 smithi154 ceph-mon[35578]: pgmap v397: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-12T12:26:03.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:03 smithi038 ceph-mon[30810]: pgmap v397: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-12T12:26:04.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:03 smithi071 ceph-mon[34859]: pgmap v397: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-12T12:26:05.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:05 smithi154 ceph-mon[35578]: pgmap v398: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-12T12:26:05.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:05 smithi038 ceph-mon[30810]: pgmap v398: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-12T12:26:06.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:05 smithi071 ceph-mon[34859]: pgmap v398: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-12T12:26:07.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:07 smithi154 ceph-mon[35578]: pgmap v399: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-12T12:26:07.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:07 smithi038 ceph-mon[30810]: pgmap v399: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-12T12:26:08.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:07 smithi071 ceph-mon[34859]: pgmap v399: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-12T12:26:08.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:08 smithi154 ceph-mon[35578]: scrub summary: idle 2024-09-12T12:26:08.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:08 smithi038 ceph-mon[30810]: scrub summary: idle 2024-09-12T12:26:09.015 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:08 smithi071 ceph-mon[34859]: scrub summary: idle 2024-09-12T12:26:09.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:09 smithi154 ceph-mon[35578]: pgmap v400: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-12T12:26:09.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:09 smithi038 ceph-mon[30810]: pgmap v400: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-12T12:26:10.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:09 smithi071 ceph-mon[34859]: pgmap v400: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-12T12:26:11.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:11 smithi154 ceph-mon[35578]: pgmap v401: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T12:26:11.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:11 smithi038 ceph-mon[30810]: pgmap v401: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T12:26:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:11 smithi071 ceph-mon[34859]: pgmap v401: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T12:26:13.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:13 smithi154 ceph-mon[35578]: pgmap v402: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T12:26:13.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:13 smithi038 ceph-mon[30810]: pgmap v402: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T12:26:14.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:13 smithi071 ceph-mon[34859]: pgmap v402: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T12:26:15.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:15 smithi154 ceph-mon[35578]: pgmap v403: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:15.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:15 smithi038 ceph-mon[30810]: pgmap v403: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:16.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:15 smithi071 ceph-mon[34859]: pgmap v403: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:17.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:17 smithi154 ceph-mon[35578]: pgmap v404: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:17.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:17 smithi038 ceph-mon[30810]: pgmap v404: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:17 smithi071 ceph-mon[34859]: pgmap v404: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:19.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:19 smithi154 ceph-mon[35578]: pgmap v405: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:19.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:19 smithi038 ceph-mon[30810]: pgmap v405: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:20.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:19 smithi071 ceph-mon[34859]: pgmap v405: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:21.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:21 smithi154 ceph-mon[35578]: pgmap v406: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:21.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:21 smithi038 ceph-mon[30810]: pgmap v406: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:22.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:21 smithi071 ceph-mon[34859]: pgmap v406: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:23.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:23 smithi154 ceph-mon[35578]: pgmap v407: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:26:23.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:23 smithi038 ceph-mon[30810]: pgmap v407: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:26:24.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:23 smithi071 ceph-mon[34859]: pgmap v407: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T12:26:25.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:25 smithi154 ceph-mon[35578]: pgmap v408: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:25.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:25 smithi038 ceph-mon[30810]: pgmap v408: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:26.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:25 smithi071 ceph-mon[34859]: pgmap v408: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:27.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:27 smithi038 ceph-mon[30810]: pgmap v409: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:28.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:27 smithi071 ceph-mon[34859]: pgmap v409: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:28.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:27 smithi154 ceph-mon[35578]: pgmap v409: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:29.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:29 smithi038 ceph-mon[30810]: pgmap v410: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:30.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:29 smithi071 ceph-mon[34859]: pgmap v410: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:30.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:29 smithi154 ceph-mon[35578]: pgmap v410: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:30.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:26:30.974 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 -- 172.21.15.38:0/2425509916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f8108f60 msgr2=0x7f48f8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 --2- 172.21.15.38:0/2425509916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f8108f60 0x7f48f8110ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009ca0 tx=0x7f48f002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 -- 172.21.15.38:0/2425509916 shutdown_connections 2024-09-12T12:26:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 --2- 172.21.15.38:0/2425509916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f8108f60 0x7f48f8110ae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 --2- 172.21.15.38:0/2425509916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f81047e0 0x7f48f8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 --2- 172.21.15.38:0/2425509916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8103e30 0x7f48f8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 -- 172.21.15.38:0/2425509916 >> 172.21.15.38:0/2425509916 conn(0x7f48f80ff910 msgr2=0x7f48f8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:31.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 -- 172.21.15.38:0/2425509916 shutdown_connections 2024-09-12T12:26:31.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.617+0000 7f48f7e00640 1 -- 172.21.15.38:0/2425509916 wait complete. 2024-09-12T12:26:31.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.618+0000 7f48f7e00640 1 Processor -- start 2024-09-12T12:26:31.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.619+0000 7f48f7e00640 1 -- start start 2024-09-12T12:26:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.619+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f8103e30 0x7f48f819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.619+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f81047e0 0x7f48f819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.619+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8108f60 0x7f48f819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.619+0000 7f48f7e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8114010 con 0x7f48f8103e30 2024-09-12T12:26:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.619+0000 7f48f7e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8113e90 con 0x7f48f8108f60 2024-09-12T12:26:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.619+0000 7f48f7e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8114190 con 0x7f48f81047e0 2024-09-12T12:26:31.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.620+0000 7f48f7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8108f60 0x7f48f819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.620+0000 7f48f7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8108f60 0x7f48f819ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55536/0 (socket says 172.21.15.38:55536) 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.620+0000 7f48f7400640 1 -- 172.21.15.38:0/70428976 learned_addr learned my addr 172.21.15.38:0/70428976 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.620+0000 7f48f6000640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f81047e0 0x7f48f819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.620+0000 7f48f6a00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f8103e30 0x7f48f819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f7400640 1 -- 172.21.15.38:0/70428976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f81047e0 msgr2=0x7f48f819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f7400640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f81047e0 0x7f48f819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f7400640 1 -- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f8103e30 msgr2=0x7f48f819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f7400640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f8103e30 0x7f48f819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f7400640 1 -- 172.21.15.38:0/70428976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f819f390 con 0x7f48f8108f60 2024-09-12T12:26:31.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f6000640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f81047e0 0x7f48f819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:31.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f6a00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f8103e30 0x7f48f819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:31.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.621+0000 7f48f7400640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8108f60 0x7f48f819ecb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f48f0033040 tx=0x7f48f0003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.622+0000 7f48ef400640 1 -- 172.21.15.38:0/70428976 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0031650 con 0x7f48f8108f60 2024-09-12T12:26:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.622+0000 7f48ef400640 1 -- 172.21.15.38:0/70428976 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f00317f0 con 0x7f48f8108f60 2024-09-12T12:26:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.622+0000 7f48ef400640 1 -- 172.21.15.38:0/70428976 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f002fa40 con 0x7f48f8108f60 2024-09-12T12:26:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.622+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f819f620 con 0x7f48f8108f60 2024-09-12T12:26:31.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.622+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f81a6f60 con 0x7f48f8108f60 2024-09-12T12:26:31.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.626+0000 7f490060d740 1 Processor -- start 2024-09-12T12:26:31.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.627+0000 7f48ef400640 1 -- 172.21.15.38:0/70428976 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48f002fbe0 con 0x7f48f8108f60 2024-09-12T12:26:31.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.627+0000 7f490060d740 1 -- start start 2024-09-12T12:26:31.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.628+0000 7f490060d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7012d50 0x564fd7013130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.628+0000 7f490060d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd701d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.628+0000 7f490060d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd701df30 0x564fd7020320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.628+0000 7f490060d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564fd6f793e0 con 0x564fd7013670 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.628+0000 7f490060d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564fd6f20d80 con 0x564fd7012d50 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.628+0000 7f490060d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564fd6f753a0 con 0x564fd701df30 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.628+0000 7f48f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7012d50 0x564fd7013130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.629+0000 7f48f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7012d50 0x564fd7013130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55538/0 (socket says 172.21.15.38:55538) 2024-09-12T12:26:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.629+0000 7f48f6000640 1 -- 172.21.15.38:0/2431756043 learned_addr learned my addr 172.21.15.38:0/2431756043 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.629+0000 7f48f6000640 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd701df30 0x564fd7020320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.629+0000 7f48f6a00640 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd701d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.629+0000 7f48ef400640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48dc0a2c00 0x7f48dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.629+0000 7f48ef400640 1 -- 172.21.15.38:0/70428976 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f48f00f0bf0 con 0x7f48f8108f60 2024-09-12T12:26:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.630+0000 7f48f7400640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48dc0a2c00 0x7f48dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.630+0000 7f48f6000640 1 -- 172.21.15.38:0/2431756043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd701df30 msgr2=0x564fd7020320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.630+0000 7f48f6000640 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd701df30 0x564fd7020320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.630+0000 7f48f6000640 1 -- 172.21.15.38:0/2431756043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 msgr2=0x564fd701d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.630+0000 7f48f6000640 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd701d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.630+0000 7f48f6000640 1 -- 172.21.15.38:0/2431756043 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd6f3fae0 con 0x564fd7012d50 2024-09-12T12:26:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.631+0000 7f48f6a00640 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd701d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.631+0000 7f48f6000640 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7012d50 0x564fd7013130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48e4020ca0 tx=0x7f48e400c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6779f86d538a852 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.631+0000 7f48f7400640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48dc0a2c00 0x7f48dc0a50c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48f002ae80 tx=0x7f48f00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.632+0000 7f48e3e00640 1 -- 172.21.15.38:0/2431756043 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4014110 con 0x564fd7012d50 2024-09-12T12:26:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.632+0000 7f48e3e00640 1 -- 172.21.15.38:0/2431756043 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e40142b0 con 0x564fd7012d50 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.632+0000 7f48e3e00640 1 -- 172.21.15.38:0/2431756043 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4020040 con 0x564fd7012d50 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.633+0000 7f490060d740 1 -- 172.21.15.38:0/2431756043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7012d50 msgr2=0x564fd7013130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.633+0000 7f490060d740 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7012d50 0x564fd7013130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48e4020ca0 tx=0x7f48e400c510 comp rx=0 tx=0).stop 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.633+0000 7f490060d740 1 -- 172.21.15.38:0/2431756043 shutdown_connections 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.633+0000 7f490060d740 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd701df30 0x564fd7020320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.633+0000 7f490060d740 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd701d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.633+0000 7f490060d740 1 --2- 172.21.15.38:0/2431756043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7012d50 0x564fd7013130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.633+0000 7f490060d740 1 -- 172.21.15.38:0/2431756043 >> 172.21.15.38:0/2431756043 conn(0x564fd700f2e0 msgr2=0x564fd700f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.634+0000 7f490060d740 1 -- 172.21.15.38:0/2431756043 shutdown_connections 2024-09-12T12:26:31.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.634+0000 7f490060d740 1 -- 172.21.15.38:0/2431756043 wait complete. 2024-09-12T12:26:31.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.635+0000 7f490060d740 1 -- start start 2024-09-12T12:26:31.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.635+0000 7f490060d740 1 Processor -- start 2024-09-12T12:26:31.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f490060d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7012d50 0x564fd701aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f490060d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7013670 0x564fd701b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f490060d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd701b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f490060d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564fd7020ba0 con 0x564fd7012d50 2024-09-12T12:26:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f490060d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564fd6f340f0 con 0x564fd701df30 2024-09-12T12:26:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f490060d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564fd7020d20 con 0x564fd7013670 2024-09-12T12:26:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f490060d740 10 client.0 _ll_register_callbacks cb 0x564fd6f259e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.636+0000 7f48f6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7012d50 0x564fd701aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd701b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd701b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55546/0 (socket says 172.21.15.38:55546) 2024-09-12T12:26:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 -- 172.21.15.38:0/1749513823 learned_addr learned my addr 172.21.15.38:0/1749513823 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6a00640 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7013670 0x564fd701b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 -- 172.21.15.38:0/1749513823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7013670 msgr2=0x564fd701b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7013670 0x564fd701b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 -- 172.21.15.38:0/1749513823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7012d50 msgr2=0x564fd701aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7012d50 0x564fd701aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.637+0000 7f48f6000640 1 -- 172.21.15.38:0/1749513823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd6cea3c0 con 0x564fd701df30 2024-09-12T12:26:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.638+0000 7f48f6000640 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd701b930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48e4006010 tx=0x7f48e400cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4797e1e56ce7bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.638+0000 7f48e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.638+0000 7f48e0c00640 1 -- 172.21.15.38:0/1749513823 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4035060 con 0x564fd701df30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.638+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564fd6f86950 con 0x564fd701df30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.638+0000 7f48e0c00640 1 -- 172.21.15.38:0/1749513823 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f48e4004230 con 0x564fd701df30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.639+0000 7f48e0c00640 1 -- 172.21.15.38:0/1749513823 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f48e403c050 con 0x564fd701df30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.639+0000 7f490060d740 10 client.25343 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.639+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564fd702c840 con 0x564fd701df30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.639+0000 7f48e0c00640 1 -- 172.21.15.38:0/1749513823 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564fd6f86950 con 0x564fd701df30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.640+0000 7f48e0c00640 1 -- 172.21.15.38:0/1749513823 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f48e4003800 con 0x564fd701df30 2024-09-12T12:26:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.640+0000 7f490060d740 10 client.25343 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:31.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.640+0000 7f490060d740 10 client.25343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.641+0000 7f490060d740 20 client.25343 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.641+0000 7f490060d740 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd702db90 0x564fd702ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.641+0000 7f490060d740 4 client.25343 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.641+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fd6f80e60 con 0x564fd702db90 2024-09-12T12:26:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.641+0000 7f48f6a00640 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd702db90 0x564fd702ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.642+0000 7f48f6a00640 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd702db90 0x564fd702ff80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22d25921346a4d8e server_cookie=eaa73502e4799eb3 in_seq=0 out_seq=0 2024-09-12T12:26:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.642+0000 7f48e0c00640 10 client.25343 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:31.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.643+0000 7f48e0c00640 1 -- 172.21.15.38:0/1749513823 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fd6f80e60 con 0x564fd702db90 2024-09-12T12:26:31.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.643+0000 7f48e0c00640 10 client.25343 handle_command_reply: tid=0 2024-09-12T12:26:31.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.643+0000 7f490060d740 1 client.25343 shutdown 2024-09-12T12:26:31.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 msgr2=0x564fd701b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd701b930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48e4006010 tx=0x7f48e400cc10 comp rx=0 tx=0).stop 2024-09-12T12:26:31.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 shutdown_connections 2024-09-12T12:26:31.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd702db90 0x564fd702ff80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd701b930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7013670 0x564fd701b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 --2- 172.21.15.38:0/1749513823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7012d50 0x564fd701aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 >> 172.21.15.38:0/1749513823 conn(0x564fd700f2e0 msgr2=0x564fd7015010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:31.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f48e0c00640 0 client.25343 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:31.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 shutdown_connections 2024-09-12T12:26:31.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.644+0000 7f490060d740 1 -- 172.21.15.38:0/1749513823 wait complete. 2024-09-12T12:26:31.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.645+0000 7f490060d740 20 client.25343 trim_cache size 0 max 16384 2024-09-12T12:26:31.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 Processor -- start 2024-09-12T12:26:31.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 -- start start 2024-09-12T12:26:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd701b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd7035520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd7035a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81ac990 con 0x564fd7013670 2024-09-12T12:26:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81ae4d0 con 0x564fd701df30 2024-09-12T12:26:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.680+0000 7f490060d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81ad060 con 0x564fd7012d50 2024-09-12T12:26:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.681+0000 7f48f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd7035a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.681+0000 7f48f6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd7035520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.681+0000 7f48f6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd7035a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55562/0 (socket says 172.21.15.38:55562) 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.681+0000 7f48f6000640 1 -- 172.21.15.38:0/717484645 learned_addr learned my addr 172.21.15.38:0/717484645 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.681+0000 7f48f6000640 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd701b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.682+0000 7f48f6a00640 1 -- 172.21.15.38:0/717484645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 msgr2=0x564fd701b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.682+0000 7f48f6a00640 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd701b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.682+0000 7f48f6a00640 1 -- 172.21.15.38:0/717484645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 msgr2=0x564fd7035a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.682+0000 7f48f6a00640 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd7035a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.682+0000 7f48f6a00640 1 -- 172.21.15.38:0/717484645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd70302f0 con 0x564fd7013670 2024-09-12T12:26:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.682+0000 7f48f6a00640 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd7035520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x564fd7020e70 tx=0x7f48e80092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e444a4f11f0955 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:31.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.683+0000 7f48e3400640 1 -- 172.21.15.38:0/717484645 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8005020 con 0x564fd7013670 2024-09-12T12:26:31.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.683+0000 7f48e3400640 1 -- 172.21.15.38:0/717484645 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e80047a0 con 0x564fd7013670 2024-09-12T12:26:31.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.683+0000 7f48e3400640 1 -- 172.21.15.38:0/717484645 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80116a0 con 0x564fd7013670 2024-09-12T12:26:31.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.684+0000 7f490060d740 1 -- 172.21.15.38:0/717484645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 msgr2=0x564fd7035520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.684+0000 7f490060d740 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd7035520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x564fd7020e70 tx=0x7f48e80092a0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.684+0000 7f490060d740 1 -- 172.21.15.38:0/717484645 shutdown_connections 2024-09-12T12:26:31.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.684+0000 7f490060d740 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd701df30 0x564fd7035a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.684+0000 7f490060d740 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd7013670 0x564fd7035520 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.684+0000 7f490060d740 1 --2- 172.21.15.38:0/717484645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd701b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.684+0000 7f490060d740 1 -- 172.21.15.38:0/717484645 >> 172.21.15.38:0/717484645 conn(0x564fd700f2e0 msgr2=0x564fd701cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:31.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.685+0000 7f490060d740 1 -- 172.21.15.38:0/717484645 shutdown_connections 2024-09-12T12:26:31.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.685+0000 7f490060d740 1 -- 172.21.15.38:0/717484645 wait complete. 2024-09-12T12:26:31.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.686+0000 7f490060d740 1 -- start start 2024-09-12T12:26:31.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.686+0000 7f490060d740 1 Processor -- start 2024-09-12T12:26:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f490060d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd7025f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f490060d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7013670 0x564fd70264b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f490060d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd701df30 0x564fd7022f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f490060d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81ade00 con 0x564fd701df30 2024-09-12T12:26:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f490060d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81ad730 con 0x564fd7013670 2024-09-12T12:26:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f490060d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81aa970 con 0x564fd7012d50 2024-09-12T12:26:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f490060d740 10 client.0 _ll_register_callbacks cb 0x7f48e4020ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f48f6a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7013670 0x564fd70264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f48f6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd701df30 0x564fd7022f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f48f6a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7013670 0x564fd70264b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55570/0 (socket says 172.21.15.38:55570) 2024-09-12T12:26:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f48f6a00640 1 -- 172.21.15.38:0/2337317066 learned_addr learned my addr 172.21.15.38:0/2337317066 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.687+0000 7f48f6000640 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd7025f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.688+0000 7f48f6a00640 1 -- 172.21.15.38:0/2337317066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 msgr2=0x564fd7025f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.688+0000 7f48f6a00640 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd7025f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.688+0000 7f48f6a00640 1 -- 172.21.15.38:0/2337317066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd701df30 msgr2=0x564fd7022f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.688+0000 7f48f6a00640 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd701df30 0x564fd7022f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.688+0000 7f48f6a00640 1 -- 172.21.15.38:0/2337317066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd7018e90 con 0x564fd7013670 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.688+0000 7f48f6000640 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd701df30 0x564fd7022f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.689+0000 7f48f6a00640 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7013670 0x564fd70264b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000c00 tx=0x7f48e8009a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d37ef6131aa243ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.689+0000 7f48e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.689+0000 7f48e0c00640 1 -- 172.21.15.38:0/2337317066 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8004b50 con 0x564fd7013670 2024-09-12T12:26:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.689+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e80047a0 con 0x564fd7013670 2024-09-12T12:26:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.689+0000 7f48e0c00640 1 -- 172.21.15.38:0/2337317066 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f48e8004cf0 con 0x564fd7013670 2024-09-12T12:26:31.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f48e0c00640 1 -- 172.21.15.38:0/2337317066 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f48e8034050 con 0x564fd7013670 2024-09-12T12:26:31.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 10 client.25349 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:31.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564fd7098a80 con 0x564fd7013670 2024-09-12T12:26:31.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f48e0c00640 1 -- 172.21.15.38:0/2337317066 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e80047a0 con 0x564fd7013670 2024-09-12T12:26:31.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f48e0c00640 1 -- 172.21.15.38:0/2337317066 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f48e802f030 con 0x564fd7013670 2024-09-12T12:26:31.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 10 client.25349 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:31.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 10 client.25349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 20 client.25349 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd7099260 0x564fd709b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 4 client.25349 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:26:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.693+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564fd6efd0c0 con 0x564fd7099260 2024-09-12T12:26:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.694+0000 7f48f6000640 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd7099260 0x564fd709b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.694+0000 7f48f6000640 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd7099260 0x564fd709b680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c81d7fbef37a8b server_cookie=9bf49e8341d60b6 in_seq=0 out_seq=0 2024-09-12T12:26:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f48e0c00640 10 client.25349 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f48e0c00640 1 -- 172.21.15.38:0/2337317066 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564fd6efd0c0 con 0x564fd7099260 2024-09-12T12:26:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f48e0c00640 10 client.25349 handle_command_reply: tid=0 2024-09-12T12:26:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 client.25349 shutdown 2024-09-12T12:26:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7013670 msgr2=0x564fd70264b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7013670 0x564fd70264b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000c00 tx=0x7f48e8009a80 comp rx=0 tx=0).stop 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 shutdown_connections 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x564fd7099260 0x564fd709b680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564fd701df30 0x564fd7022f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fd7013670 0x564fd70264b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 --2- 172.21.15.38:0/2337317066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564fd7012d50 0x564fd7025f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 >> 172.21.15.38:0/2337317066 conn(0x564fd700f2e0 msgr2=0x564fd700db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.695+0000 7f48e0c00640 0 client.25349 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.696+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 shutdown_connections 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.696+0000 7f490060d740 1 -- 172.21.15.38:0/2337317066 wait complete. 2024-09-12T12:26:31.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.696+0000 7f490060d740 20 client.25349 trim_cache size 0 max 16384 2024-09-12T12:26:31.698 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:26:31.698 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-12T12:26:31.698 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2024-09-12T12:26:31.698 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:26:31.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48dc0a2c00 msgr2=0x7f48dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48dc0a2c00 0x7f48dc0a50c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48f002ae80 tx=0x7f48f00095c0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8108f60 msgr2=0x7f48f819ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8108f60 0x7f48f819ecb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f48f0033040 tx=0x7f48f0003f10 comp rx=0 tx=0).stop 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 shutdown_connections 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f48dc0a2c00 0x7f48dc0a50c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48f8108f60 0x7f48f819ecb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f81047e0 0x7f48f819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 --2- 172.21.15.38:0/70428976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48f8103e30 0x7f48f819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.697+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 >> 172.21.15.38:0/70428976 conn(0x7f48f80ff910 msgr2=0x7f48f8100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.698+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 shutdown_connections 2024-09-12T12:26:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:31.698+0000 7f48f7e00640 1 -- 172.21.15.38:0/70428976 wait complete. 2024-09-12T12:26:31.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:31 smithi038 ceph-mon[30810]: pgmap v411: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:32.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:31 smithi071 ceph-mon[34859]: pgmap v411: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:32.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:31 smithi154 ceph-mon[35578]: pgmap v411: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:32.663 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:26:32.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:26:33.100 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:33.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.706+0000 7fbe9bc00640 1 -- 172.21.15.38:0/3608976861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 msgr2=0x7fbe941089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:33.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.706+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/3608976861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 0x7fbe941089f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009900 tx=0x7fbe8002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.706+0000 7fbe9bc00640 1 -- 172.21.15.38:0/3608976861 shutdown_connections 2024-09-12T12:26:33.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.706+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/3608976861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94109120 0x7fbe94110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.706+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/3608976861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 0x7fbe941089f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.706+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/3608976861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94103ff0 0x7fbe941043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.706+0000 7fbe9bc00640 1 -- 172.21.15.38:0/3608976861 >> 172.21.15.38:0/3608976861 conn(0x7fbe940ffa90 msgr2=0x7fbe94101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:33.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.707+0000 7fbe9bc00640 1 -- 172.21.15.38:0/3608976861 shutdown_connections 2024-09-12T12:26:33.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.707+0000 7fbe9bc00640 1 -- 172.21.15.38:0/3608976861 wait complete. 2024-09-12T12:26:33.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.708+0000 7fbe9bc00640 1 Processor -- start 2024-09-12T12:26:33.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.708+0000 7fbe9bc00640 1 -- start start 2024-09-12T12:26:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe9bc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94103ff0 0x7fbe9419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe9bc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 0x7fbe9419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe9bc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94109120 0x7fbe9419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe9bc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94114170 con 0x7fbe941049a0 2024-09-12T12:26:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe9bc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94113ff0 con 0x7fbe94103ff0 2024-09-12T12:26:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe9bc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941142f0 con 0x7fbe94109120 2024-09-12T12:26:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe99200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94103ff0 0x7fbe9419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe99200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94103ff0 0x7fbe9419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:55590/0 (socket says 172.21.15.38:55590) 2024-09-12T12:26:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe99200640 1 -- 172.21.15.38:0/1156776647 learned_addr learned my addr 172.21.15.38:0/1156776647 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe93e00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 0x7fbe9419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe99c00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94109120 0x7fbe9419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe99200640 1 -- 172.21.15.38:0/1156776647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94109120 msgr2=0x7fbe9419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.709+0000 7fbe99200640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94109120 0x7fbe9419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.710+0000 7fbe99200640 1 -- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 msgr2=0x7fbe9419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.710+0000 7fbe99200640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 0x7fbe9419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.710+0000 7fbe99200640 1 -- 172.21.15.38:0/1156776647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9419f600 con 0x7fbe94103ff0 2024-09-12T12:26:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.710+0000 7fbe99200640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94103ff0 0x7fbe9419a650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e9f0 tx=0x7fbe8800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:33.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.711+0000 7fbe91600640 1 -- 172.21.15.38:0/1156776647 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800cd80 con 0x7fbe94103ff0 2024-09-12T12:26:33.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.711+0000 7fbe91600640 1 -- 172.21.15.38:0/1156776647 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe88010910 con 0x7fbe94103ff0 2024-09-12T12:26:33.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.711+0000 7fbe91600640 1 -- 172.21.15.38:0/1156776647 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88018990 con 0x7fbe94103ff0 2024-09-12T12:26:33.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.711+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9419f8f0 con 0x7fbe94103ff0 2024-09-12T12:26:33.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.711+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe94076630 con 0x7fbe94103ff0 2024-09-12T12:26:33.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.713+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe941054d0 con 0x7fbe94103ff0 2024-09-12T12:26:33.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.716+0000 7fbe91600640 1 -- 172.21.15.38:0/1156776647 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbe88010ac0 con 0x7fbe94103ff0 2024-09-12T12:26:33.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.717+0000 7fbe91600640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbe7c0a2c00 0x7fbe7c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:33.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.717+0000 7fbe91600640 1 -- 172.21.15.38:0/1156776647 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fbe880cf8e0 con 0x7fbe94103ff0 2024-09-12T12:26:33.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.717+0000 7fbe93e00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbe7c0a2c00 0x7fbe7c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:33.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.718+0000 7fbe93e00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbe7c0a2c00 0x7fbe7c0a50c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000c00 tx=0x7fbe80005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:33.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.721+0000 7fbe91600640 1 -- 172.21.15.38:0/1156776647 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe8809c490 con 0x7fbe94103ff0 2024-09-12T12:26:33.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.942+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe9410c360 con 0x7fbe94103ff0 2024-09-12T12:26:33.942 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:33 smithi038 ceph-mon[30810]: pgmap v412: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T12:26:33.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.943+0000 7fbe91600640 1 -- 172.21.15.38:0/1156776647 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7fbe8809bd90 con 0x7fbe94103ff0 2024-09-12T12:26:33.944 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:26:33.944 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:26:33.944 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:26:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.945+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbe7c0a2c00 msgr2=0x7fbe7c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.945+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbe7c0a2c00 0x7fbe7c0a50c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000c00 tx=0x7fbe80005b50 comp rx=0 tx=0).stop 2024-09-12T12:26:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94103ff0 msgr2=0x7fbe9419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94103ff0 0x7fbe9419a650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e9f0 tx=0x7fbe8800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 shutdown_connections 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbe7c0a2c00 0x7fbe7c0a50c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94109120 0x7fbe9419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe941049a0 0x7fbe9419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 --2- 172.21.15.38:0/1156776647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe94103ff0 0x7fbe9419a650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 >> 172.21.15.38:0/1156776647 conn(0x7fbe940ffa90 msgr2=0x7fbe94100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 shutdown_connections 2024-09-12T12:26:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:33.946+0000 7fbe9bc00640 1 -- 172.21.15.38:0/1156776647 wait complete. 2024-09-12T12:26:34.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:33 smithi071 ceph-mon[34859]: pgmap v412: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T12:26:34.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:33 smithi154 ceph-mon[35578]: pgmap v412: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T12:26:34.706 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:34 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1156776647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:34.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T12:26:35.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:34 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1156776647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:35.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:34 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1156776647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:35.211 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 -- 172.21.15.38:0/2561866085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1079c0 msgr2=0x7f7dcc107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 --2- 172.21.15.38:0/2561866085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1079c0 0x7f7dcc107da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009930 tx=0x7f7dbc02a420 comp rx=0 tx=0).stop 2024-09-12T12:26:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 -- 172.21.15.38:0/2561866085 shutdown_connections 2024-09-12T12:26:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 --2- 172.21.15.38:0/2561866085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc102360 0x7f7dcc10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 --2- 172.21.15.38:0/2561866085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc1019c0 0x7f7dcc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 --2- 172.21.15.38:0/2561866085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1079c0 0x7f7dcc107da0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 -- 172.21.15.38:0/2561866085 >> 172.21.15.38:0/2561866085 conn(0x7f7dcc0fd740 msgr2=0x7f7dcc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 -- 172.21.15.38:0/2561866085 shutdown_connections 2024-09-12T12:26:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.834+0000 7f7dd1000640 1 -- 172.21.15.38:0/2561866085 wait complete. 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 Processor -- start 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 -- start start 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1019c0 0x7f7dcc19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc102360 0x7f7dcc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc1079c0 0x7f7dcc19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc111d90 con 0x7f7dcc102360 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc111c10 con 0x7f7dcc1079c0 2024-09-12T12:26:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.836+0000 7f7dd1000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc111f10 con 0x7f7dcc1019c0 2024-09-12T12:26:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.837+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc102360 0x7f7dcc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.837+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc1079c0 0x7f7dcc19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.837+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc102360 0x7f7dcc19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55332/0 (socket says 172.21.15.38:55332) 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.837+0000 7f7dcaa00640 1 -- 172.21.15.38:0/1142699252 learned_addr learned my addr 172.21.15.38:0/1142699252 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.837+0000 7f7dcbe00640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc1079c0 0x7f7dcc19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:51318/0 (socket says 172.21.15.38:51318) 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.837+0000 7f7dcb400640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1019c0 0x7f7dcc19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.838+0000 7f7dcb400640 1 -- 172.21.15.38:0/1142699252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc1079c0 msgr2=0x7f7dcc19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.838+0000 7f7dcb400640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc1079c0 0x7f7dcc19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.838+0000 7f7dcb400640 1 -- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc102360 msgr2=0x7f7dcc19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.838+0000 7f7dcb400640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc102360 0x7f7dcc19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.838+0000 7f7dcb400640 1 -- 172.21.15.38:0/1142699252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc19f420 con 0x7f7dcc1019c0 2024-09-12T12:26:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.838+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc102360 0x7f7dcc19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.838+0000 7f7dcb400640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1019c0 0x7f7dcc19a470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc005940 tx=0x7f7dbc0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.839+0000 7f7dc3e00640 1 -- 172.21.15.38:0/1142699252 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc03f070 con 0x7f7dcc1019c0 2024-09-12T12:26:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.839+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc19f6b0 con 0x7f7dcc1019c0 2024-09-12T12:26:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.839+0000 7f7dc3e00640 1 -- 172.21.15.38:0/1142699252 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc0044c0 con 0x7f7dcc1019c0 2024-09-12T12:26:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.839+0000 7f7dc3e00640 1 -- 172.21.15.38:0/1142699252 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc035070 con 0x7f7dcc1019c0 2024-09-12T12:26:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.839+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1a6ff0 con 0x7f7dcc1019c0 2024-09-12T12:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 Processor -- start 2024-09-12T12:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 -- start start 2024-09-12T12:26:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58ca2760 0x55af58cacae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58caf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55af58c083e0 con 0x55af58cad020 2024-09-12T12:26:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55af58bafd80 con 0x55af58ca2760 2024-09-12T12:26:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.843+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af58c043a0 con 0x55af58ca1e40 2024-09-12T12:26:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58caf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58caf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55338/0 (socket says 172.21.15.38:55338) 2024-09-12T12:26:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 -- 172.21.15.38:0/259409853 learned_addr learned my addr 172.21.15.38:0/259409853 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 -- 172.21.15.38:0/259409853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 msgr2=0x55af58ca2220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/259409853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca2220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 -- 172.21.15.38:0/259409853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58ca2760 msgr2=0x55af58cacae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/259409853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58ca2760 0x55af58cacae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.844+0000 7f7dcaa00640 1 -- 172.21.15.38:0/259409853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af58bceae0 con 0x55af58cad020 2024-09-12T12:26:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.845+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/259409853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58caf410 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7db80115f0 tx=0x7f7db8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c57c2d25a33eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.845+0000 7f7dc0c00640 1 -- 172.21.15.38:0/259409853 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db801e070 con 0x55af58cad020 2024-09-12T12:26:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.845+0000 7f7dc0c00640 1 -- 172.21.15.38:0/259409853 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db800f660 con 0x55af58cad020 2024-09-12T12:26:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.845+0000 7f7dc0c00640 1 -- 172.21.15.38:0/259409853 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8003970 con 0x55af58cad020 2024-09-12T12:26:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.846+0000 7f7dd51e7740 1 -- 172.21.15.38:0/259409853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 msgr2=0x55af58caf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.846+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/259409853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58caf410 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7db80115f0 tx=0x7f7db8011ab0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.846+0000 7f7dd51e7740 1 -- 172.21.15.38:0/259409853 shutdown_connections 2024-09-12T12:26:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.846+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/259409853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58caf410 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.846+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/259409853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58ca2760 0x55af58cacae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.846+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/259409853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.846+0000 7f7dd51e7740 1 -- 172.21.15.38:0/259409853 >> 172.21.15.38:0/259409853 conn(0x55af58c9e3d0 msgr2=0x55af58c9e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:35.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.849+0000 7f7dc3e00640 1 -- 172.21.15.38:0/1142699252 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7dbc03b460 con 0x7f7dcc1019c0 2024-09-12T12:26:35.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.849+0000 7f7dd51e7740 1 -- 172.21.15.38:0/259409853 shutdown_connections 2024-09-12T12:26:35.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.849+0000 7f7dd51e7740 1 -- 172.21.15.38:0/259409853 wait complete. 2024-09-12T12:26:35.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.850+0000 7f7dd51e7740 1 -- start start 2024-09-12T12:26:35.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.850+0000 7f7dd51e7740 1 Processor -- start 2024-09-12T12:26:35.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.851+0000 7f7dc3e00640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7db00a2b10 0x7f7db00a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58caa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dc3e00640 1 -- 172.21.15.38:0/1142699252 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7dbc0ef4b0 con 0x7f7dcc1019c0 2024-09-12T12:26:35.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58cad020 0x55af58caa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 0x55af58cc18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55af58cafbf0 con 0x55af58ca1e40 2024-09-12T12:26:35.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55af58bc30f0 con 0x55af58caab30 2024-09-12T12:26:35.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af58cafd70 con 0x55af58cad020 2024-09-12T12:26:35.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dd51e7740 10 client.0 _ll_register_callbacks cb 0x55af58baabd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:35.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58cad020 0x55af58caa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58cad020 0x55af58caa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52078/0 (socket says 172.21.15.38:52078) 2024-09-12T12:26:35.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.852+0000 7f7dcaa00640 1 -- 172.21.15.38:0/3723225586 learned_addr learned my addr 172.21.15.38:0/3723225586 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:35.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.853+0000 7f7dcaa00640 1 -- 172.21.15.38:0/3723225586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 msgr2=0x55af58cc18d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:35.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.853+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 0x55af58cc18d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.853+0000 7f7dcaa00640 1 -- 172.21.15.38:0/3723225586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 msgr2=0x55af58caa0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:35.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.853+0000 7f7dcbe00640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7db00a2b10 0x7f7db00a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.854+0000 7f7dcb400640 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58caa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.854+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58caa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.854+0000 7f7dcaa00640 1 -- 172.21.15.38:0/3723225586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af589793c0 con 0x55af58cad020 2024-09-12T12:26:35.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.855+0000 7f7dcb400640 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58caa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:35.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.855+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58cad020 0x55af58caa5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7db8005270 tx=0x7f7db80052a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b25e5a65d7a4bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:35.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.855+0000 7f7db5600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:26:35.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.856+0000 7f7db5600640 1 -- 172.21.15.38:0/3723225586 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db801e040 con 0x55af58cad020 2024-09-12T12:26:35.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.856+0000 7f7db5600640 1 -- 172.21.15.38:0/3723225586 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7db80053c0 con 0x55af58cad020 2024-09-12T12:26:35.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.856+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7db800f660 con 0x55af58cad020 2024-09-12T12:26:35.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.856+0000 7f7db5600640 1 -- 172.21.15.38:0/3723225586 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7db802f050 con 0x55af58cad020 2024-09-12T12:26:35.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.856+0000 7f7dd51e7740 10 client.25342 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:35.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.856+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55af58cc4a20 con 0x55af58cad020 2024-09-12T12:26:35.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7db5600640 1 -- 172.21.15.38:0/3723225586 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db800f660 con 0x55af58cad020 2024-09-12T12:26:35.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7db5600640 1 -- 172.21.15.38:0/3723225586 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7db802a030 con 0x55af58cad020 2024-09-12T12:26:35.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7dd51e7740 10 client.25342 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:35.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7dd51e7740 10 client.25342 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:26:35.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7dd51e7740 20 client.25342 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:35.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58cc5ee0 0x55af58cc82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7dd51e7740 4 client.25342 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:35.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.857+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af58c15950 con 0x55af58cc5ee0 2024-09-12T12:26:35.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.858+0000 7f7dcb400640 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58cc5ee0 0x55af58cc82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.859+0000 7f7dcb400640 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58cc5ee0 0x55af58cc82d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e8051d31af85995 server_cookie=4e494a6e224724b2 in_seq=0 out_seq=0 2024-09-12T12:26:35.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.859+0000 7f7db5600640 10 client.25342 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:35.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.859+0000 7f7dcbe00640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7db00a2b10 0x7f7db00a4fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005fd0 tx=0x7f7dc4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:35.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.859+0000 7f7db5600640 1 -- 172.21.15.38:0/3723225586 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af58c15950 con 0x55af58cc5ee0 2024-09-12T12:26:35.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.859+0000 7f7db5600640 10 client.25342 handle_command_reply: tid=0 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.859+0000 7f7dd51e7740 1 client.25342 shutdown 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58cad020 msgr2=0x55af58caa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58cad020 0x55af58caa5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7db8005270 tx=0x7f7db80052a0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 shutdown_connections 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58cc5ee0 0x55af58cc82d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 0x55af58cc18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58cad020 0x55af58caa5f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/3723225586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58caa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 >> 172.21.15.38:0/3723225586 conn(0x55af58c9e3d0 msgr2=0x55af58ca40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:35.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.860+0000 7f7db5600640 0 client.25342 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:35.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.861+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 shutdown_connections 2024-09-12T12:26:35.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.861+0000 7f7dd51e7740 1 -- 172.21.15.38:0/3723225586 wait complete. 2024-09-12T12:26:35.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.861+0000 7f7dd51e7740 20 client.25342 trim_cache size 0 max 16384 2024-09-12T12:26:35.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.875+0000 7f7dd51e7740 1 Processor -- start 2024-09-12T12:26:35.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.875+0000 7f7dd51e7740 1 -- start start 2024-09-12T12:26:35.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.875+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 0x55af58cc1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58ccd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1acaa0 con 0x55af58cad020 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1ae5e0 con 0x55af58caab30 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1ad170 con 0x55af58ca1e40 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dcb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dcb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52086/0 (socket says 172.21.15.38:52086) 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dcb400640 1 -- 172.21.15.38:0/1056347444 learned_addr learned my addr 172.21.15.38:0/1056347444 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 0x55af58cc1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dcb400640 1 -- 172.21.15.38:0/1056347444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 msgr2=0x55af58cc1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:35.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dcb400640 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 0x55af58cc1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.876+0000 7f7dcb400640 1 -- 172.21.15.38:0/1056347444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 msgr2=0x55af58ccd9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.877+0000 7f7dcb400640 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58ccd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.877+0000 7f7dcb400640 1 -- 172.21.15.38:0/1056347444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af58caf410 con 0x55af58ca1e40 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.877+0000 7f7dcb400640 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca8980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0b7e10 tx=0x7f7dbc02a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f722ba8e3584a854 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.877+0000 7f7db7e00640 1 -- 172.21.15.38:0/1056347444 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc048040 con 0x55af58ca1e40 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.877+0000 7f7db7e00640 1 -- 172.21.15.38:0/1056347444 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc0bfcb0 con 0x55af58ca1e40 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.877+0000 7f7db7e00640 1 -- 172.21.15.38:0/1056347444 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0c40e0 con 0x55af58ca1e40 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.878+0000 7f7dd51e7740 1 -- 172.21.15.38:0/1056347444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 msgr2=0x55af58ca8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.878+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca8980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0b7e10 tx=0x7f7dbc02a420 comp rx=0 tx=0).stop 2024-09-12T12:26:35.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.878+0000 7f7dd51e7740 1 -- 172.21.15.38:0/1056347444 shutdown_connections 2024-09-12T12:26:35.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.878+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58cad020 0x55af58ccd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.878+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58caab30 0x55af58cc1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.878+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/1056347444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58ca1e40 0x55af58ca8980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.878+0000 7f7dd51e7740 1 -- 172.21.15.38:0/1056347444 >> 172.21.15.38:0/1056347444 conn(0x55af58c9e3d0 msgr2=0x55af58cac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:35.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.879+0000 7f7dd51e7740 1 -- 172.21.15.38:0/1056347444 shutdown_connections 2024-09-12T12:26:35.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.879+0000 7f7dd51e7740 1 -- 172.21.15.38:0/1056347444 wait complete. 2024-09-12T12:26:35.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.879+0000 7f7dd51e7740 1 -- start start 2024-09-12T12:26:35.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 1 Processor -- start 2024-09-12T12:26:35.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58cb8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58caab30 0x55af58cb9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58cad020 0x55af58d2e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1adf10 con 0x55af58ca1e40 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1ad840 con 0x55af58cad020 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1aaaa0 con 0x55af58caab30 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.880+0000 7f7dd51e7740 10 client.0 _ll_register_callbacks cb 0x7f7db801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58caab30 0x55af58cb9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58caab30 0x55af58cb9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52098/0 (socket says 172.21.15.38:52098) 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 -- 172.21.15.38:0/2041506693 learned_addr learned my addr 172.21.15.38:0/2041506693 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcb400640 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58cb8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcbe00640 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58cad020 0x55af58d2e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 -- 172.21.15.38:0/2041506693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58cad020 msgr2=0x55af58d2e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58cad020 0x55af58d2e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 -- 172.21.15.38:0/2041506693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 msgr2=0x55af58cb8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58cb8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.881+0000 7f7dcaa00640 1 -- 172.21.15.38:0/2041506693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af58d2eff0 con 0x55af58caab30 2024-09-12T12:26:35.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.882+0000 7f7dcaa00640 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58caab30 0x55af58cb9530 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55af58cab6f0 tx=0x7f7db8019890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e492a0691a9d6df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.882+0000 7f7db5600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.882+0000 7f7db5600640 1 -- 172.21.15.38:0/2041506693 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db801e050 con 0x55af58caab30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.882+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dbc0bfcb0 con 0x55af58caab30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.882+0000 7f7db5600640 1 -- 172.21.15.38:0/2041506693 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7db8005310 con 0x55af58caab30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.882+0000 7f7db5600640 1 -- 172.21.15.38:0/2041506693 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7db803e050 con 0x55af58caab30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.882+0000 7f7dd51e7740 10 client.25348 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55af58d302d0 con 0x55af58caab30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7db5600640 1 -- 172.21.15.38:0/2041506693 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc0bfcb0 con 0x55af58caab30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7db5600640 1 -- 172.21.15.38:0/2041506693 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7db802a040 con 0x55af58caab30 2024-09-12T12:26:35.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dd51e7740 10 client.25348 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dd51e7740 10 client.25348 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dd51e7740 20 client.25348 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58d30a10 0x55af58d32e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dd51e7740 4 client.25348 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af58c0fe60 con 0x55af58d30a10 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.883+0000 7f7dcb400640 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58d30a10 0x55af58d32e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.884+0000 7f7dcb400640 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58d30a10 0x55af58d32e30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ab98a075b43d3fab server_cookie=4b5aa741abcc3153 in_seq=0 out_seq=0 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.884+0000 7f7db5600640 10 client.25348 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.884+0000 7f7db5600640 1 -- 172.21.15.38:0/2041506693 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af58c0fe60 con 0x55af58d30a10 2024-09-12T12:26:35.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.884+0000 7f7db5600640 10 client.25348 handle_command_reply: tid=0 2024-09-12T12:26:35.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.884+0000 7f7dd51e7740 1 client.25348 shutdown 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.884+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58caab30 msgr2=0x55af58cb9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.884+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58caab30 0x55af58cb9530 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55af58cab6f0 tx=0x7f7db8019890 comp rx=0 tx=0).stop 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 shutdown_connections 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55af58d30a10 0x55af58d32e30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55af58cad020 0x55af58d2e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af58caab30 0x55af58cb9530 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 --2- 172.21.15.38:0/2041506693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55af58ca1e40 0x55af58cb8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7db5600640 0 client.25348 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 >> 172.21.15.38:0/2041506693 conn(0x55af58c9e3d0 msgr2=0x55af58ca3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:35.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 shutdown_connections 2024-09-12T12:26:35.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 1 -- 172.21.15.38:0/2041506693 wait complete. 2024-09-12T12:26:35.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.885+0000 7f7dd51e7740 20 client.25348 trim_cache size 0 max 16384 2024-09-12T12:26:35.889 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.886+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7db00a2b10 msgr2=0x7f7db00a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.886+0000 7f7dd1000640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7db00a2b10 0x7f7db00a4fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005fd0 tx=0x7f7dc4009600 comp rx=0 tx=0).stop 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.886+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1019c0 msgr2=0x7f7dcc19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.886+0000 7f7dd1000640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1019c0 0x7f7dcc19a470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc005940 tx=0x7f7dbc0040c0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 shutdown_connections 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7db00a2b10 0x7f7db00a4fd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc1079c0 0x7f7dcc19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dcc102360 0x7f7dcc19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 --2- 172.21.15.38:0/1142699252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc1019c0 0x7f7dcc19a470 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:35.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 >> 172.21.15.38:0/1142699252 conn(0x7f7dcc0fd740 msgr2=0x7f7dcc10cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:35.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 shutdown_connections 2024-09-12T12:26:35.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:35.887+0000 7f7dd1000640 1 -- 172.21.15.38:0/1142699252 wait complete. 2024-09-12T12:26:35.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:35 smithi038 ceph-mon[30810]: pgmap v413: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-12T12:26:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:35 smithi071 ceph-mon[34859]: pgmap v413: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-12T12:26:36.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:35 smithi154 ceph-mon[35578]: pgmap v413: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-12T12:26:36.714 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T12:26:37.173 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:37.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.775+0000 7fa742600640 1 -- 172.21.15.38:0/4119281569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074510 msgr2=0x7fa73c0748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.775+0000 7fa742600640 1 --2- 172.21.15.38:0/4119281569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074510 0x7fa73c0748f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009900 tx=0x7fa72c02a490 comp rx=0 tx=0).stop 2024-09-12T12:26:37.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.775+0000 7fa742600640 1 -- 172.21.15.38:0/4119281569 shutdown_connections 2024-09-12T12:26:37.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.775+0000 7fa742600640 1 --2- 172.21.15.38:0/4119281569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa73c10e440 0x7fa73c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.775+0000 7fa742600640 1 --2- 172.21.15.38:0/4119281569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c074e30 0x7fa73c10df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.775+0000 7fa742600640 1 --2- 172.21.15.38:0/4119281569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074510 0x7fa73c0748f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.775+0000 7fa742600640 1 -- 172.21.15.38:0/4119281569 >> 172.21.15.38:0/4119281569 conn(0x7fa73c0fd8c0 msgr2=0x7fa73c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:37.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.776+0000 7fa742600640 1 -- 172.21.15.38:0/4119281569 shutdown_connections 2024-09-12T12:26:37.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.776+0000 7fa742600640 1 -- 172.21.15.38:0/4119281569 wait complete. 2024-09-12T12:26:37.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.777+0000 7fa742600640 1 Processor -- start 2024-09-12T12:26:37.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.777+0000 7fa742600640 1 -- start start 2024-09-12T12:26:37.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa742600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa73c074510 0x7fa73c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa742600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074e30 0x7fa73c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa742600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10e440 0x7fa73c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa742600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c114150 con 0x7fa73c074e30 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa742600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c113fd0 con 0x7fa73c074510 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa742600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1142d0 con 0x7fa73c10e440 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa73be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10e440 0x7fa73c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa73be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10e440 0x7fa73c19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52130/0 (socket says 172.21.15.38:52130) 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa73be00640 1 -- 172.21.15.38:0/2499024445 learned_addr learned my addr 172.21.15.38:0/2499024445 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:37.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.778+0000 7fa73b400640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa73c074510 0x7fa73c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa73be00640 1 -- 172.21.15.38:0/2499024445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa73c074510 msgr2=0x7fa73c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa73be00640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa73c074510 0x7fa73c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa73aa00640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074e30 0x7fa73c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa73be00640 1 -- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074e30 msgr2=0x7fa73c19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa73be00640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074e30 0x7fa73c19ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa73be00640 1 -- 172.21.15.38:0/2499024445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c19f6c0 con 0x7fa73c10e440 2024-09-12T12:26:37.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa73be00640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10e440 0x7fa73c19efe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa734009c90 tx=0x7fa73400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:37.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa733e00640 1 -- 172.21.15.38:0/2499024445 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734010630 con 0x7fa73c10e440 2024-09-12T12:26:37.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa733e00640 1 -- 172.21.15.38:0/2499024445 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa734010cb0 con 0x7fa73c10e440 2024-09-12T12:26:37.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.779+0000 7fa733e00640 1 -- 172.21.15.38:0/2499024445 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734017d20 con 0x7fa73c10e440 2024-09-12T12:26:37.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.780+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c19f9b0 con 0x7fa73c10e440 2024-09-12T12:26:37.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.780+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c1a7290 con 0x7fa73c10e440 2024-09-12T12:26:37.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.783+0000 7fa733e00640 1 -- 172.21.15.38:0/2499024445 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa7340107d0 con 0x7fa73c10e440 2024-09-12T12:26:37.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.783+0000 7fa7451e4740 1 Processor -- start 2024-09-12T12:26:37.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa7451e4740 1 -- start start 2024-09-12T12:26:37.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4bc70 0x556fe5d4c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d56910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5d59240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa7451e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556fe5cb23e0 con 0x556fe5d4bc70 2024-09-12T12:26:37.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa7451e4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556fe5c59d80 con 0x556fe5d4c590 2024-09-12T12:26:37.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa7451e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556fe5cae3a0 con 0x556fe5d56e50 2024-09-12T12:26:37.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.784+0000 7fa733e00640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa7200a2c00 0x7fa7200a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.785+0000 7fa733e00640 1 -- 172.21.15.38:0/2499024445 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fa7340cfd80 con 0x7fa73c10e440 2024-09-12T12:26:37.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.785+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5d59240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.785+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5d59240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52142/0 (socket says 172.21.15.38:52142) 2024-09-12T12:26:37.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.785+0000 7fa73aa00640 1 -- 172.21.15.38:0/273310153 learned_addr learned my addr 172.21.15.38:0/273310153 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:37.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.785+0000 7fa73aa00640 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4bc70 0x556fe5d4c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.785+0000 7fa73be00640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa7200a2c00 0x7fa7200a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.785+0000 7fa73b400640 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d56910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.786+0000 7fa73aa00640 1 -- 172.21.15.38:0/273310153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 msgr2=0x556fe5d59240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.786+0000 7fa73aa00640 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5d59240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.786+0000 7fa73aa00640 1 -- 172.21.15.38:0/273310153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 msgr2=0x556fe5d56910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.786+0000 7fa73aa00640 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d56910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.786+0000 7fa73aa00640 1 -- 172.21.15.38:0/273310153 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe5c78ae0 con 0x556fe5d4bc70 2024-09-12T12:26:37.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.786+0000 7fa73aa00640 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4bc70 0x556fe5d4c050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa728005d00 tx=0x7fa728005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea795649de43f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:37.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.787+0000 7fa73be00640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa7200a2c00 0x7fa7200a50c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa734098630 tx=0x7fa7340177c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:37.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.787+0000 7fa730c00640 1 -- 172.21.15.38:0/273310153 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7280142d0 con 0x556fe5d4bc70 2024-09-12T12:26:37.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.787+0000 7fa730c00640 1 -- 172.21.15.38:0/273310153 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa728011950 con 0x556fe5d4bc70 2024-09-12T12:26:37.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.788+0000 7fa730c00640 1 -- 172.21.15.38:0/273310153 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72800fa80 con 0x556fe5d4bc70 2024-09-12T12:26:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.788+0000 7fa7451e4740 1 -- 172.21.15.38:0/273310153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4bc70 msgr2=0x556fe5d4c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.788+0000 7fa7451e4740 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4bc70 0x556fe5d4c050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa728005d00 tx=0x7fa728005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.789+0000 7fa7451e4740 1 -- 172.21.15.38:0/273310153 shutdown_connections 2024-09-12T12:26:37.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.789+0000 7fa7451e4740 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5d59240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.789+0000 7fa7451e4740 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d56910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.789+0000 7fa7451e4740 1 --2- 172.21.15.38:0/273310153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4bc70 0x556fe5d4c050 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.789+0000 7fa7451e4740 1 -- 172.21.15.38:0/273310153 >> 172.21.15.38:0/273310153 conn(0x556fe5d48200 msgr2=0x556fe5d485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:37.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.789+0000 7fa7451e4740 1 -- 172.21.15.38:0/273310153 shutdown_connections 2024-09-12T12:26:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.789+0000 7fa7451e4740 1 -- 172.21.15.38:0/273310153 wait complete. 2024-09-12T12:26:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.790+0000 7fa7451e4740 1 -- start start 2024-09-12T12:26:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.790+0000 7fa7451e4740 1 Processor -- start 2024-09-12T12:26:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d53f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d56e50 0x556fe5d544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d54a00 0x556fe5d6b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa7451e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556fe5d59a20 con 0x556fe5d56e50 2024-09-12T12:26:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa7451e4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556fe5c6d0f0 con 0x556fe5d4c590 2024-09-12T12:26:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa7451e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556fe5d59ba0 con 0x556fe5d54a00 2024-09-12T12:26:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa7451e4740 10 client.0 _ll_register_callbacks cb 0x556fe5c54bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d53f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d53f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:51374/0 (socket says 172.21.15.38:51374) 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.791+0000 7fa73aa00640 1 -- 172.21.15.38:0/2993312265 learned_addr learned my addr 172.21.15.38:0/2993312265 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73aa00640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d54a00 0x556fe5d6b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73b400640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d56e50 0x556fe5d544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73aa00640 1 -- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d54a00 msgr2=0x556fe5d6b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73aa00640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d54a00 0x556fe5d6b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73aa00640 1 -- 172.21.15.38:0/2993312265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d56e50 msgr2=0x556fe5d544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73aa00640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d56e50 0x556fe5d544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73aa00640 1 -- 172.21.15.38:0/2993312265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fe5a233c0 con 0x556fe5d4c590 2024-09-12T12:26:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.792+0000 7fa73b400640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d56e50 0x556fe5d544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa73aa00640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d53f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7280095f0 tx=0x7fa72800f720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a021bec60e6328ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa725600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa725600640 1 -- 172.21.15.38:0/2993312265 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728028030 con 0x556fe5d4c590 2024-09-12T12:26:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa725600640 1 -- 172.21.15.38:0/2993312265 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fa728011d10 con 0x556fe5d4c590 2024-09-12T12:26:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa728011950 con 0x556fe5d4c590 2024-09-12T12:26:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa725600640 1 -- 172.21.15.38:0/2993312265 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa728005040 con 0x556fe5d4c590 2024-09-12T12:26:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa7451e4740 10 client.25379 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.793+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fe5d6e890 con 0x556fe5d4c590 2024-09-12T12:26:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.794+0000 7fa725600640 1 -- 172.21.15.38:0/2993312265 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa728011950 con 0x556fe5d4c590 2024-09-12T12:26:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.794+0000 7fa725600640 1 -- 172.21.15.38:0/2993312265 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fa72800fc50 con 0x556fe5d4c590 2024-09-12T12:26:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.795+0000 7fa7451e4740 10 client.25379 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.795+0000 7fa7451e4740 10 client.25379 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.795+0000 7fa7451e4740 20 client.25379 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.795+0000 7fa7451e4740 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5d6fc40 0x556fe5d72030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.795+0000 7fa7451e4740 4 client.25379 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.795+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fe5cbf950 con 0x556fe5d6fc40 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.795+0000 7fa73b400640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5d6fc40 0x556fe5d72030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.796+0000 7fa73b400640 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5d6fc40 0x556fe5d72030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=29c0b294ad164a8d server_cookie=2c3dc78666f6310f in_seq=0 out_seq=0 2024-09-12T12:26:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.796+0000 7fa725600640 10 client.25379 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:37.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa725600640 1 -- 172.21.15.38:0/2993312265 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556fe5cbf950 con 0x556fe5d6fc40 2024-09-12T12:26:37.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa725600640 10 client.25379 handle_command_reply: tid=0 2024-09-12T12:26:37.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 client.25379 shutdown 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 msgr2=0x556fe5d53f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d53f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7280095f0 tx=0x7fa72800f720 comp rx=0 tx=0).stop 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 shutdown_connections 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5d6fc40 0x556fe5d72030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d54a00 0x556fe5d6b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d56e50 0x556fe5d544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 --2- 172.21.15.38:0/2993312265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d4c590 0x556fe5d53f80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 >> 172.21.15.38:0/2993312265 conn(0x556fe5d48200 msgr2=0x556fe5d47380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:37.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.797+0000 7fa725600640 0 client.25379 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:37.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.798+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 shutdown_connections 2024-09-12T12:26:37.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.798+0000 7fa7451e4740 1 -- 172.21.15.38:0/2993312265 wait complete. 2024-09-12T12:26:37.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.798+0000 7fa7451e4740 20 client.25379 trim_cache size 0 max 16384 2024-09-12T12:26:37.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 Processor -- start 2024-09-12T12:26:37.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 -- start start 2024-09-12T12:26:37.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d4c590 0x556fe5d6b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d54a00 0x556fe5d51200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d56e50 0x556fe5d51740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1acc70 con 0x556fe5d54a00 2024-09-12T12:26:37.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ae7b0 con 0x556fe5d56e50 2024-09-12T12:26:37.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.812+0000 7fa7451e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ad340 con 0x556fe5d4c590 2024-09-12T12:26:37.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d4c590 0x556fe5d6b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d4c590 0x556fe5d6b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52164/0 (socket says 172.21.15.38:52164) 2024-09-12T12:26:37.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 -- 172.21.15.38:0/4014970783 learned_addr learned my addr 172.21.15.38:0/4014970783 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:37.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73b400640 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d54a00 0x556fe5d51200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d56e50 0x556fe5d51740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 -- 172.21.15.38:0/4014970783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d56e50 msgr2=0x556fe5d51740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d56e50 0x556fe5d51740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 -- 172.21.15.38:0/4014970783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d54a00 msgr2=0x556fe5d51200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d54a00 0x556fe5d51200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73aa00640 1 -- 172.21.15.38:0/4014970783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe5d43770 con 0x556fe5d4c590 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.813+0000 7fa73b400640 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d54a00 0x556fe5d51200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.814+0000 7fa73aa00640 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d4c590 0x556fe5d6b690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa728009b90 tx=0x7fa728014e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d60ec3d56e88489 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.814+0000 7fa727e00640 1 -- 172.21.15.38:0/4014970783 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728028070 con 0x556fe5d4c590 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.814+0000 7fa727e00640 1 -- 172.21.15.38:0/4014970783 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa728009da0 con 0x556fe5d4c590 2024-09-12T12:26:37.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.814+0000 7fa727e00640 1 -- 172.21.15.38:0/4014970783 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728034030 con 0x556fe5d4c590 2024-09-12T12:26:37.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 -- 172.21.15.38:0/4014970783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d4c590 msgr2=0x556fe5d6b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d4c590 0x556fe5d6b690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa728009b90 tx=0x7fa728014e90 comp rx=0 tx=0).stop 2024-09-12T12:26:37.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 -- 172.21.15.38:0/4014970783 shutdown_connections 2024-09-12T12:26:37.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d56e50 0x556fe5d51740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d54a00 0x556fe5d51200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 --2- 172.21.15.38:0/4014970783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d4c590 0x556fe5d6b690 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 -- 172.21.15.38:0/4014970783 >> 172.21.15.38:0/4014970783 conn(0x556fe5d48200 msgr2=0x556fe5d53070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:37.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 -- 172.21.15.38:0/4014970783 shutdown_connections 2024-09-12T12:26:37.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 -- 172.21.15.38:0/4014970783 wait complete. 2024-09-12T12:26:37.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.815+0000 7fa7451e4740 1 -- start start 2024-09-12T12:26:37.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 1 Processor -- start 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4c590 0x556fe5d721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d54a00 0x556fe5d726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5dd8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ae0e0 con 0x556fe5d4c590 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ada10 con 0x556fe5d54a00 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1aac50 con 0x556fe5d56e50 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.816+0000 7fa7451e4740 10 client.0 _ll_register_callbacks cb 0x7fa7340093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4c590 0x556fe5d721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4c590 0x556fe5d721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55410/0 (socket says 172.21.15.38:55410) 2024-09-12T12:26:37.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 -- 172.21.15.38:0/1050214733 learned_addr learned my addr 172.21.15.38:0/1050214733 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5dd8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73b400640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d54a00 0x556fe5d726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 -- 172.21.15.38:0/1050214733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d54a00 msgr2=0x556fe5d726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d54a00 0x556fe5d726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 -- 172.21.15.38:0/1050214733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4c590 msgr2=0x556fe5d721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4c590 0x556fe5d721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73aa00640 1 -- 172.21.15.38:0/1050214733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fe5d59a90 con 0x556fe5d56e50 2024-09-12T12:26:37.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.817+0000 7fa73b400640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d54a00 0x556fe5d726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:37.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.818+0000 7fa73aa00640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5dd8570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097e0 tx=0x7fa728020040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9cd46eea0a64e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:37.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.818+0000 7fa725600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:26:37.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.818+0000 7fa725600640 1 -- 172.21.15.38:0/1050214733 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728034070 con 0x556fe5d56e50 2024-09-12T12:26:37.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.818+0000 7fa725600640 1 -- 172.21.15.38:0/1050214733 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fa7280051e0 con 0x556fe5d56e50 2024-09-12T12:26:37.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.818+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa728009da0 con 0x556fe5d56e50 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa725600640 1 -- 172.21.15.38:0/1050214733 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa728046050 con 0x556fe5d56e50 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 10 client.25366 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fe5dd9bc0 con 0x556fe5d56e50 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa725600640 1 -- 172.21.15.38:0/1050214733 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa728009da0 con 0x556fe5d56e50 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa725600640 1 -- 172.21.15.38:0/1050214733 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fa728041030 con 0x556fe5d56e50 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 10 client.25366 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 10 client.25366 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 20 client.25366 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5dda2d0 0x556fe5ddc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 4 client.25366 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.819+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fe5cb9e60 con 0x556fe5dda2d0 2024-09-12T12:26:37.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.820+0000 7fa73b400640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5dda2d0 0x556fe5ddc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:37.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.820+0000 7fa73b400640 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5dda2d0 0x556fe5ddc6c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c944373c15ff0a48 server_cookie=d5b77d8bac4c5a2e in_seq=0 out_seq=0 2024-09-12T12:26:37.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.820+0000 7fa725600640 10 client.25366 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:37.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa725600640 1 -- 172.21.15.38:0/1050214733 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fe5cb9e60 con 0x556fe5dda2d0 2024-09-12T12:26:37.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa725600640 10 client.25366 handle_command_reply: tid=0 2024-09-12T12:26:37.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 client.25366 shutdown 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 msgr2=0x556fe5dd8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5dd8570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097e0 tx=0x7fa728020040 comp rx=0 tx=0).stop 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 shutdown_connections 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x556fe5dda2d0 0x556fe5ddc6c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fe5d56e50 0x556fe5dd8570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556fe5d54a00 0x556fe5d726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 --2- 172.21.15.38:0/1050214733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556fe5d4c590 0x556fe5d721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 >> 172.21.15.38:0/1050214733 conn(0x556fe5d48200 msgr2=0x556fe5d4d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa725600640 0 client.25366 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 shutdown_connections 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.821+0000 7fa7451e4740 1 -- 172.21.15.38:0/1050214733 wait complete. 2024-09-12T12:26:37.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.822+0000 7fa7451e4740 20 client.25366 trim_cache size 0 max 16384 2024-09-12T12:26:37.824 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:26:37.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.822+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa7200a2c00 msgr2=0x7fa7200a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.822+0000 7fa742600640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa7200a2c00 0x7fa7200a50c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa734098630 tx=0x7fa7340177c0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.822+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10e440 msgr2=0x7fa73c19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.822+0000 7fa742600640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10e440 0x7fa73c19efe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa734009c90 tx=0x7fa73400c6a0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 shutdown_connections 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa7200a2c00 0x7fa7200a50c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10e440 0x7fa73c19efe0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa73c074e30 0x7fa73c19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 --2- 172.21.15.38:0/2499024445 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa73c074510 0x7fa73c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 >> 172.21.15.38:0/2499024445 conn(0x7fa73c0fd8c0 msgr2=0x7fa73c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 shutdown_connections 2024-09-12T12:26:37.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:37.823+0000 7fa742600640 1 -- 172.21.15.38:0/2499024445 wait complete. 2024-09-12T12:26:37.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:37 smithi038 ceph-mon[30810]: pgmap v414: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T12:26:38.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:37 smithi071 ceph-mon[34859]: pgmap v414: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T12:26:38.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:37 smithi154 ceph-mon[35578]: pgmap v414: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T12:26:38.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:26:39.218 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:39.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.854+0000 7f7e8a400640 1 -- 172.21.15.38:0/582733146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e841047e0 msgr2=0x7f7e84108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.854+0000 7f7e8a400640 1 --2- 172.21.15.38:0/582733146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e841047e0 0x7f7e84108830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009900 tx=0x7f7e7002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.855+0000 7f7e8a400640 1 -- 172.21.15.38:0/582733146 shutdown_connections 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.855+0000 7f7e8a400640 1 --2- 172.21.15.38:0/582733146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e84108f60 0x7f7e84110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.855+0000 7f7e8a400640 1 --2- 172.21.15.38:0/582733146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e841047e0 0x7f7e84108830 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.855+0000 7f7e8a400640 1 --2- 172.21.15.38:0/582733146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84103e30 0x7f7e84104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.855+0000 7f7e8a400640 1 -- 172.21.15.38:0/582733146 >> 172.21.15.38:0/582733146 conn(0x7f7e840ff910 msgr2=0x7f7e84101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.855+0000 7f7e8a400640 1 -- 172.21.15.38:0/582733146 shutdown_connections 2024-09-12T12:26:39.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.855+0000 7f7e8a400640 1 -- 172.21.15.38:0/582733146 wait complete. 2024-09-12T12:26:39.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.856+0000 7f7e8a400640 1 Processor -- start 2024-09-12T12:26:39.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.856+0000 7f7e8a400640 1 -- start start 2024-09-12T12:26:39.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e8a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84103e30 0x7f7e84110950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e8a400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841047e0 0x7f7e8410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e8a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e84108f60 0x7f7e8410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e8a400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84114010 con 0x7f7e84108f60 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e8a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84113e90 con 0x7f7e84103e30 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e8a400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84114190 con 0x7f7e841047e0 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e84108f60 0x7f7e8410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e89000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84103e30 0x7f7e84110950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841047e0 0x7f7e8410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e84108f60 0x7f7e8410df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55424/0 (socket says 172.21.15.38:55424) 2024-09-12T12:26:39.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.857+0000 7f7e89a00640 1 -- 172.21.15.38:0/2154835355 learned_addr learned my addr 172.21.15.38:0/2154835355 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.858+0000 7f7e83e00640 1 -- 172.21.15.38:0/2154835355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84103e30 msgr2=0x7f7e84110950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.858+0000 7f7e83e00640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84103e30 0x7f7e84110950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.858+0000 7f7e83e00640 1 -- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e84108f60 msgr2=0x7f7e8410df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.858+0000 7f7e83e00640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e84108f60 0x7f7e8410df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.858+0000 7f7e83e00640 1 -- 172.21.15.38:0/2154835355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8410e7d0 con 0x7f7e841047e0 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.858+0000 7f7e89000640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84103e30 0x7f7e84110950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.858+0000 7f7e89a00640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e84108f60 0x7f7e8410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.859+0000 7f7e83e00640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841047e0 0x7f7e8410da00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7e7002a910 tx=0x7f7e70003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.859+0000 7f7e81600640 1 -- 172.21.15.38:0/2154835355 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7003f070 con 0x7f7e841047e0 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.859+0000 7f7e81600640 1 -- 172.21.15.38:0/2154835355 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e70031c90 con 0x7f7e841047e0 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.859+0000 7f7e81600640 1 -- 172.21.15.38:0/2154835355 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70035030 con 0x7f7e841047e0 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.859+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e841aad70 con 0x7f7e841047e0 2024-09-12T12:26:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.859+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841ab200 con 0x7f7e841047e0 2024-09-12T12:26:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.863+0000 7f7e81600640 1 -- 172.21.15.38:0/2154835355 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7e70042070 con 0x7f7e841047e0 2024-09-12T12:26:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.864+0000 7f7e8e420740 1 Processor -- start 2024-09-12T12:26:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.864+0000 7f7e8e420740 1 -- start start 2024-09-12T12:26:39.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dbfe40 0x561d55dc0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dcaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dcb020 0x561d55dcd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e8e420740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561d55d263e0 con 0x561d55dcb020 2024-09-12T12:26:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e8e420740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561d55ccdd80 con 0x561d55dc0760 2024-09-12T12:26:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e8e420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561d55d223a0 con 0x561d55dbfe40 2024-09-12T12:26:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dbfe40 0x561d55dc0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e81600640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e6c0a2c00 0x7f7e6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dbfe40 0x561d55dc0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52192/0 (socket says 172.21.15.38:52192) 2024-09-12T12:26:39.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e89a00640 1 -- 172.21.15.38:0/3794089507 learned_addr learned my addr 172.21.15.38:0/3794089507 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:39.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.865+0000 7f7e83e00640 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dcb020 0x561d55dcd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e81600640 1 -- 172.21.15.38:0/2154835355 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7e700ef750 con 0x7f7e841047e0 2024-09-12T12:26:39.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e89000640 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dcaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e89a00640 1 -- 172.21.15.38:0/3794089507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 msgr2=0x561d55dcaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e89a00640 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dcaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e89a00640 1 -- 172.21.15.38:0/3794089507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dcb020 msgr2=0x561d55dcd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e89a00640 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dcb020 0x561d55dcd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e89a00640 1 -- 172.21.15.38:0/3794089507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d55cecae0 con 0x561d55dbfe40 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e83e00640 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dcb020 0x561d55dcd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.866+0000 7f7e89a00640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e6c0a2c00 0x7f7e6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.867+0000 7f7e89a00640 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dbfe40 0x561d55dc0220 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009fd0 tx=0x7f7e7c013d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0dfa9b8349caf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.867+0000 7f7e76000640 1 -- 172.21.15.38:0/3794089507 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c01c6d0 con 0x561d55dbfe40 2024-09-12T12:26:39.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.867+0000 7f7e76000640 1 -- 172.21.15.38:0/3794089507 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e7c01cd50 con 0x561d55dbfe40 2024-09-12T12:26:39.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.867+0000 7f7e76000640 1 -- 172.21.15.38:0/3794089507 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c010c30 con 0x561d55dbfe40 2024-09-12T12:26:39.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.867+0000 7f7e89a00640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e6c0a2c00 0x7f7e6c0a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c022000 tx=0x7f7e7c01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.868+0000 7f7e8e420740 1 -- 172.21.15.38:0/3794089507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dbfe40 msgr2=0x561d55dc0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.868+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dbfe40 0x561d55dc0220 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009fd0 tx=0x7f7e7c013d30 comp rx=0 tx=0).stop 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.868+0000 7f7e8e420740 1 -- 172.21.15.38:0/3794089507 shutdown_connections 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.868+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dcb020 0x561d55dcd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.868+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dcaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.868+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3794089507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dbfe40 0x561d55dc0220 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.868+0000 7f7e8e420740 1 -- 172.21.15.38:0/3794089507 >> 172.21.15.38:0/3794089507 conn(0x561d55dbc3d0 msgr2=0x561d55dbc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.869+0000 7f7e8e420740 1 -- 172.21.15.38:0/3794089507 shutdown_connections 2024-09-12T12:26:39.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.869+0000 7f7e8e420740 1 -- 172.21.15.38:0/3794089507 wait complete. 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.869+0000 7f7e8e420740 1 -- start start 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.870+0000 7f7e8e420740 1 Processor -- start 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dbfe40 0x561d55dc7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dc8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55dc89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e8e420740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561d55dcdbf0 con 0x561d55dbfe40 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e8e420740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561d55ce10f0 con 0x561d55dc0760 2024-09-12T12:26:39.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e8e420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561d55dcdd70 con 0x561d55dcb020 2024-09-12T12:26:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e8e420740 10 client.0 _ll_register_callbacks cb 0x561d55cc8bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e89000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dbfe40 0x561d55dc7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e89000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dbfe40 0x561d55dc7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55444/0 (socket says 172.21.15.38:55444) 2024-09-12T12:26:39.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.871+0000 7f7e89000640 1 -- 172.21.15.38:0/609551684 learned_addr learned my addr 172.21.15.38:0/609551684 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:39.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.872+0000 7f7e83e00640 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dc8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.872+0000 7f7e89a00640 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55dc89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.872+0000 7f7e89000640 1 -- 172.21.15.38:0/609551684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 msgr2=0x561d55dc89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.872+0000 7f7e89000640 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55dc89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.872+0000 7f7e89000640 1 -- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 msgr2=0x561d55dc8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.872+0000 7f7e89000640 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dc8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.872+0000 7f7e89000640 1 -- 172.21.15.38:0/609551684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d55a973c0 con 0x561d55dbfe40 2024-09-12T12:26:39.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.873+0000 7f7e89000640 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dbfe40 0x561d55dc7f30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7e780136f0 tx=0x7f7e78013bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c82b1b91ece2ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:39.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.873+0000 7f7e6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:26:39.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.873+0000 7f7e6aa00640 1 -- 172.21.15.38:0/609551684 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78011c30 con 0x561d55dbfe40 2024-09-12T12:26:39.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.873+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7c01cd50 con 0x561d55dbfe40 2024-09-12T12:26:39.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.874+0000 7f7e6aa00640 1 -- 172.21.15.38:0/609551684 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7e78011dd0 con 0x561d55dbfe40 2024-09-12T12:26:39.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.874+0000 7f7e6aa00640 1 -- 172.21.15.38:0/609551684 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7e78025050 con 0x561d55dbfe40 2024-09-12T12:26:39.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.874+0000 7f7e8e420740 10 client.15381 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:39.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.874+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561d55dd9d10 con 0x561d55dbfe40 2024-09-12T12:26:39.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.875+0000 7f7e6aa00640 1 -- 172.21.15.38:0/609551684 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e7c01cd50 con 0x561d55dbfe40 2024-09-12T12:26:39.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.875+0000 7f7e6aa00640 1 -- 172.21.15.38:0/609551684 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7e7801a030 con 0x561d55dbfe40 2024-09-12T12:26:39.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.876+0000 7f7e8e420740 10 client.15381 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:39.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.876+0000 7f7e8e420740 10 client.15381 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:26:39.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.876+0000 7f7e8e420740 20 client.15381 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:39.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.876+0000 7f7e8e420740 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55ddb120 0x561d55ddd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.876+0000 7f7e8e420740 4 client.15381 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:39.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.876+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d55d33950 con 0x561d55ddb120 2024-09-12T12:26:39.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.876+0000 7f7e83e00640 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55ddb120 0x561d55ddd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.877+0000 7f7e83e00640 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55ddb120 0x561d55ddd570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5931b1843672c9e server_cookie=1b3a302ba578ce4d in_seq=0 out_seq=0 2024-09-12T12:26:39.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.877+0000 7f7e6aa00640 10 client.15381 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:26:39.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e6aa00640 1 -- 172.21.15.38:0/609551684 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d55d33950 con 0x561d55ddb120 2024-09-12T12:26:39.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e6aa00640 10 client.15381 handle_command_reply: tid=0 2024-09-12T12:26:39.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 client.15381 shutdown 2024-09-12T12:26:39.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dbfe40 msgr2=0x561d55dc7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dbfe40 0x561d55dc7f30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7e780136f0 tx=0x7f7e78013bb0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 shutdown_connections 2024-09-12T12:26:39.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55ddb120 0x561d55ddd570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55dc89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55dc8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 --2- 172.21.15.38:0/609551684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dbfe40 0x561d55dc7f30 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7e780136f0 tx=0x7f7e78013bb0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 >> 172.21.15.38:0/609551684 conn(0x561d55dbc3d0 msgr2=0x561d55dc20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:39.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.879+0000 7f7e6aa00640 0 client.15381 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:26:39.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.880+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 shutdown_connections 2024-09-12T12:26:39.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.880+0000 7f7e8e420740 1 -- 172.21.15.38:0/609551684 wait complete. 2024-09-12T12:26:39.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.880+0000 7f7e8e420740 20 client.15381 trim_cache size 0 max 16384 2024-09-12T12:26:39.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.903+0000 7f7e8e420740 1 Processor -- start 2024-09-12T12:26:39.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e8e420740 1 -- start start 2024-09-12T12:26:39.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55de2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55de33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc9790 0x561d55dc9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e8e420740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b5170 con 0x561d55dc9790 2024-09-12T12:26:39.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e8e420740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b6cb0 con 0x561d55dc0760 2024-09-12T12:26:39.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e8e420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b5840 con 0x561d55dcb020 2024-09-12T12:26:39.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.904+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55de33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc9790 0x561d55dc9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc9790 0x561d55dc9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55452/0 (socket says 172.21.15.38:55452) 2024-09-12T12:26:39.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 -- 172.21.15.38:0/3876891901 learned_addr learned my addr 172.21.15.38:0/3876891901 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:39.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89000640 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55de2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 -- 172.21.15.38:0/3876891901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 msgr2=0x561d55de33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55de33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 -- 172.21.15.38:0/3876891901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 msgr2=0x561d55de2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55de2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.905+0000 7f7e89a00640 1 -- 172.21.15.38:0/3876891901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d55dbcf80 con 0x561d55dc9790 2024-09-12T12:26:39.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.906+0000 7f7e89a00640 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc9790 0x561d55dc9c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c013600 tx=0x7f7e7c009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5340aed42a61c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:39.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.906+0000 7f7e75600640 1 -- 172.21.15.38:0/3876891901 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c004a00 con 0x561d55dc9790 2024-09-12T12:26:39.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.906+0000 7f7e75600640 1 -- 172.21.15.38:0/3876891901 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e7c004ba0 con 0x561d55dc9790 2024-09-12T12:26:39.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.906+0000 7f7e75600640 1 -- 172.21.15.38:0/3876891901 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c01c4d0 con 0x561d55dc9790 2024-09-12T12:26:39.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 -- 172.21.15.38:0/3876891901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc9790 msgr2=0x561d55dc9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc9790 0x561d55dc9c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c013600 tx=0x7f7e7c009230 comp rx=0 tx=0).stop 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 -- 172.21.15.38:0/3876891901 shutdown_connections 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc9790 0x561d55dc9c10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dcb020 0x561d55de33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 --2- 172.21.15.38:0/3876891901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dc0760 0x561d55de2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 -- 172.21.15.38:0/3876891901 >> 172.21.15.38:0/3876891901 conn(0x561d55dbc3d0 msgr2=0x561d55dc3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 -- 172.21.15.38:0/3876891901 shutdown_connections 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.907+0000 7f7e8e420740 1 -- 172.21.15.38:0/3876891901 wait complete. 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.908+0000 7f7e8e420740 1 -- start start 2024-09-12T12:26:39.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.908+0000 7f7e8e420740 1 Processor -- start 2024-09-12T12:26:39.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc0760 0x561d55dd3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dc9790 0x561d55dce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e8e420740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dcb020 0x561d55dcedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e8e420740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b65e0 con 0x561d55dc0760 2024-09-12T12:26:39.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e8e420740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b5f10 con 0x561d55dcb020 2024-09-12T12:26:39.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e8e420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b3150 con 0x561d55dc9790 2024-09-12T12:26:39.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e8e420740 10 client.0 _ll_register_callbacks cb 0x7f7e78009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:39.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e89000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc0760 0x561d55dd3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e89000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc0760 0x561d55dd3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55458/0 (socket says 172.21.15.38:55458) 2024-09-12T12:26:39.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e83e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dc9790 0x561d55dce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e89000640 1 -- 172.21.15.38:0/4254043647 learned_addr learned my addr 172.21.15.38:0/4254043647 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.909+0000 7f7e89a00640 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dcb020 0x561d55dcedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e83e00640 1 -- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dcb020 msgr2=0x561d55dcedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e83e00640 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dcb020 0x561d55dcedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e83e00640 1 -- 172.21.15.38:0/4254043647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc0760 msgr2=0x561d55dd3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e83e00640 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc0760 0x561d55dd3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e83e00640 1 -- 172.21.15.38:0/4254043647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d55dcf3c0 con 0x561d55dc9790 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e83e00640 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dc9790 0x561d55dce890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e700ece10 tx=0x7f7e7003b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fc60101c1c21be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e6aa00640 1 -- 172.21.15.38:0/4254043647 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700bff50 con 0x561d55dc9790 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.910+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7c004ba0 con 0x561d55dc9790 2024-09-12T12:26:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.911+0000 7f7e6aa00640 1 -- 172.21.15.38:0/4254043647 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7e7003b460 con 0x561d55dc9790 2024-09-12T12:26:39.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.911+0000 7f7e6aa00640 1 -- 172.21.15.38:0/4254043647 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7e700c4810 con 0x561d55dc9790 2024-09-12T12:26:39.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.911+0000 7f7e8e420740 10 client.25381 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:39.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.911+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561d55e45d10 con 0x561d55dc9790 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.911+0000 7f7e6aa00640 1 -- 172.21.15.38:0/4254043647 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e7c004ba0 con 0x561d55dc9790 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e6aa00640 1 -- 172.21.15.38:0/4254043647 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7e7004c060 con 0x561d55dc9790 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e8e420740 10 client.25381 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e8e420740 10 client.25381 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e8e420740 20 client.25381 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e8e420740 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55e463f0 0x561d55e48810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e8e420740 4 client.25381 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d55d2de60 con 0x561d55e463f0 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.912+0000 7f7e89000640 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55e463f0 0x561d55e48810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:39.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.913+0000 7f7e89000640 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55e463f0 0x561d55e48810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a7b1f8a00bae7774 server_cookie=a112f1ca4136f4cd in_seq=0 out_seq=0 2024-09-12T12:26:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.913+0000 7f7e6aa00640 10 client.25381 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:26:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.913+0000 7f7e6aa00640 1 -- 172.21.15.38:0/4254043647 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d55d2de60 con 0x561d55e463f0 2024-09-12T12:26:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.913+0000 7f7e6aa00640 10 client.25381 handle_command_reply: tid=0 2024-09-12T12:26:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.913+0000 7f7e8e420740 1 client.25381 shutdown 2024-09-12T12:26:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dc9790 msgr2=0x561d55dce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dc9790 0x561d55dce890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e700ece10 tx=0x7f7e7003b790 comp rx=0 tx=0).stop 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 shutdown_connections 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x561d55e463f0 0x561d55e48810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561d55dcb020 0x561d55dcedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561d55dc9790 0x561d55dce890 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 --2- 172.21.15.38:0/4254043647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d55dc0760 0x561d55dd3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 >> 172.21.15.38:0/4254043647 conn(0x561d55dbc3d0 msgr2=0x561d55dc9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e6aa00640 0 client.25381 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.914+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 shutdown_connections 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.915+0000 7f7e8e420740 1 -- 172.21.15.38:0/4254043647 wait complete. 2024-09-12T12:26:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.915+0000 7f7e8e420740 20 client.25381 trim_cache size 0 max 16384 2024-09-12T12:26:39.917 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:26:39.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e6c0a2c00 msgr2=0x7f7e6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e6c0a2c00 0x7f7e6c0a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c022000 tx=0x7f7e7c01f000 comp rx=0 tx=0).stop 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841047e0 msgr2=0x7f7e8410da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841047e0 0x7f7e8410da00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7e7002a910 tx=0x7f7e70003b90 comp rx=0 tx=0).stop 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 shutdown_connections 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e6c0a2c00 0x7f7e6c0a50c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e84108f60 0x7f7e8410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e841047e0 0x7f7e8410da00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 --2- 172.21.15.38:0/2154835355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e84103e30 0x7f7e84110950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 >> 172.21.15.38:0/2154835355 conn(0x7f7e840ff910 msgr2=0x7f7e84100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 shutdown_connections 2024-09-12T12:26:39.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:39.916+0000 7f7e8a400640 1 -- 172.21.15.38:0/2154835355 wait complete. 2024-09-12T12:26:39.932 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:39 smithi038 ceph-mon[30810]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T12:26:40.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:39 smithi071 ceph-mon[34859]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T12:26:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:39 smithi154 ceph-mon[35578]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T12:26:40.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:26:41.185 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:41.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.778+0000 7ff4d7800640 1 -- 172.21.15.38:0/802042165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 msgr2=0x7ff4d01021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.778+0000 7ff4d7800640 1 --2- 172.21.15.38:0/802042165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01021b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009860 tx=0x7ff4c402a360 comp rx=0 tx=0).stop 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.778+0000 7ff4d7800640 1 -- 172.21.15.38:0/802042165 shutdown_connections 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.778+0000 7ff4d7800640 1 --2- 172.21.15.38:0/802042165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d0106f00 0x7ff4d010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.778+0000 7ff4d7800640 1 --2- 172.21.15.38:0/802042165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4d0102780 0x7ff4d01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.778+0000 7ff4d7800640 1 --2- 172.21.15.38:0/802042165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01021b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.778+0000 7ff4d7800640 1 -- 172.21.15.38:0/802042165 >> 172.21.15.38:0/802042165 conn(0x7ff4d00fd890 msgr2=0x7ff4d00ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.779+0000 7ff4d7800640 1 -- 172.21.15.38:0/802042165 shutdown_connections 2024-09-12T12:26:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.779+0000 7ff4d7800640 1 -- 172.21.15.38:0/802042165 wait complete. 2024-09-12T12:26:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.780+0000 7ff4d7800640 1 Processor -- start 2024-09-12T12:26:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.780+0000 7ff4d7800640 1 -- start start 2024-09-12T12:26:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d7800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d7800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d0102780 0x7ff4d01a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d7800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4d0106f00 0x7ff4d019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d7800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0111f60 con 0x7ff4d0106f00 2024-09-12T12:26:41.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d7800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0111de0 con 0x7ff4d0102780 2024-09-12T12:26:41.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d7800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01120e0 con 0x7ff4d0101dd0 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52228/0 (socket says 172.21.15.38:52228) 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.781+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2072740640 learned_addr learned my addr 172.21.15.38:0/2072740640 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d0102780 0x7ff4d01a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d5800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4d0106f00 0x7ff4d019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2072740640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d0102780 msgr2=0x7ff4d01a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d0102780 0x7ff4d01a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4d0106f00 msgr2=0x7ff4d019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4d0106f00 0x7ff4d019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2072740640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d019acc0 con 0x7ff4d0101dd0 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d5800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4d0106f00 0x7ff4d019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.782+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01a03d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4005940 tx=0x7ff4c4033ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.783+0000 7ff4cd600640 1 -- 172.21.15.38:0/2072740640 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4037040 con 0x7ff4d0101dd0 2024-09-12T12:26:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.783+0000 7ff4cd600640 1 -- 172.21.15.38:0/2072740640 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c4042070 con 0x7ff4d0101dd0 2024-09-12T12:26:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.783+0000 7ff4cd600640 1 -- 172.21.15.38:0/2072740640 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4003920 con 0x7ff4d0101dd0 2024-09-12T12:26:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.783+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d019af50 con 0x7ff4d0101dd0 2024-09-12T12:26:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.784+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d01a72a0 con 0x7ff4d0101dd0 2024-09-12T12:26:41.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.788+0000 7ff4da250740 1 Processor -- start 2024-09-12T12:26:41.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.788+0000 7ff4da250740 1 -- start start 2024-09-12T12:26:41.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4cd600640 1 -- 172.21.15.38:0/2072740640 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff4c40040d0 con 0x7ff4d0101dd0 2024-09-12T12:26:41.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4da250740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523af7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4da250740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523b01910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4da250740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523b04240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4da250740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d523a5d3e0 con 0x55d523b01e50 2024-09-12T12:26:41.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4da250740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d523a04d80 con 0x55d523af6c70 2024-09-12T12:26:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4da250740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d523a593a0 con 0x55d523af7590 2024-09-12T12:26:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.789+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523b01910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523b01910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52230/0 (socket says 172.21.15.38:52230) 2024-09-12T12:26:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2538643712 learned_addr learned my addr 172.21.15.38:0/2538643712 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d5800640 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523af7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523b04240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2538643712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 msgr2=0x55d523af7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523af7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2538643712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 msgr2=0x55d523b04240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523b04240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.790+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2538643712 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d523a23ae0 con 0x55d523af7590 2024-09-12T12:26:41.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.791+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523b01910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40f5a90 tx=0x7ff4c40f5b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb67b8c4df8b9914 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.791+0000 7ff4cd600640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff4b80a2c80 0x7ff4b80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.791+0000 7ff4c2000640 1 -- 172.21.15.38:0/2538643712 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40b80e0 con 0x55d523af7590 2024-09-12T12:26:41.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.791+0000 7ff4cd600640 1 -- 172.21.15.38:0/2072740640 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff4c40ef9f0 con 0x7ff4d0101dd0 2024-09-12T12:26:41.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.791+0000 7ff4c2000640 1 -- 172.21.15.38:0/2538643712 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c40ff020 con 0x55d523af7590 2024-09-12T12:26:41.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.791+0000 7ff4c2000640 1 -- 172.21.15.38:0/2538643712 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40bb980 con 0x55d523af7590 2024-09-12T12:26:41.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.792+0000 7ff4da250740 1 -- 172.21.15.38:0/2538643712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 msgr2=0x55d523b01910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.792+0000 7ff4da250740 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523b01910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40f5a90 tx=0x7ff4c40f5b80 comp rx=0 tx=0).stop 2024-09-12T12:26:41.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.792+0000 7ff4da250740 1 -- 172.21.15.38:0/2538643712 shutdown_connections 2024-09-12T12:26:41.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.792+0000 7ff4da250740 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523b04240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.792+0000 7ff4da250740 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523b01910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.792+0000 7ff4da250740 1 --2- 172.21.15.38:0/2538643712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523af7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.793+0000 7ff4da250740 1 -- 172.21.15.38:0/2538643712 >> 172.21.15.38:0/2538643712 conn(0x55d523af3200 msgr2=0x55d523af35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.793+0000 7ff4d5800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff4b80a2c80 0x7ff4b80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.793+0000 7ff4da250740 1 -- 172.21.15.38:0/2538643712 shutdown_connections 2024-09-12T12:26:41.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.793+0000 7ff4da250740 1 -- 172.21.15.38:0/2538643712 wait complete. 2024-09-12T12:26:41.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.794+0000 7ff4da250740 1 -- start start 2024-09-12T12:26:41.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.794+0000 7ff4da250740 1 Processor -- start 2024-09-12T12:26:41.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.794+0000 7ff4d5800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff4b80a2c80 0x7ff4b80a5140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8005fd0 tx=0x7ff4c8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.795+0000 7ff4da250740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af6c70 0x55d523afece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.795+0000 7ff4da250740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523aff220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.795+0000 7ff4da250740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523aff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.795+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af6c70 0x55d523afece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.795+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af6c70 0x55d523afece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52232/0 (socket says 172.21.15.38:52232) 2024-09-12T12:26:41.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.795+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2932776825 learned_addr learned my addr 172.21.15.38:0/2932776825 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:41.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.796+0000 7ff4d5800640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523aff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.796+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d523b0cff0 con 0x55d523b01e50 2024-09-12T12:26:41.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.796+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523aff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.796+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d523a180f0 con 0x55d523af7590 2024-09-12T12:26:41.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.796+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d523b0d170 con 0x55d523af6c70 2024-09-12T12:26:41.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.796+0000 7ff4da250740 10 client.0 _ll_register_callbacks cb 0x55d5239ffbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:41.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.796+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2932776825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 msgr2=0x55d523aff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523aff220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2932776825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 msgr2=0x55d523aff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523aff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4d4e00640 1 -- 172.21.15.38:0/2932776825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5237ce3c0 con 0x55d523af6c70 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523aff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4d5800640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523aff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af6c70 0x55d523afece0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4101040 tx=0x7ff4c402a360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a9f6bebc677546 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4b6a00640 1 -- 172.21.15.38:0/2932776825 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40be060 con 0x55d523af6c70 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4b6a00640 1 -- 172.21.15.38:0/2932776825 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff4c40bc0a0 con 0x55d523af6c70 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.797+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4c40ff020 con 0x55d523af6c70 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4b6a00640 1 -- 172.21.15.38:0/2932776825 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff4c40fe030 con 0x55d523af6c70 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 10 client.25393 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d523b0cff0 con 0x55d523af6c70 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4b6a00640 1 -- 172.21.15.38:0/2932776825 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c40ff020 con 0x55d523af6c70 2024-09-12T12:26:41.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4b6a00640 1 -- 172.21.15.38:0/2932776825 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff4c403a030 con 0x55d523af6c70 2024-09-12T12:26:41.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 10 client.25393 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:41.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 10 client.25393 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:26:41.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 20 client.25393 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:41.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b1a170 0x55d523b1c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 4 client.25393 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:41.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.798+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d523a6a950 con 0x55d523b1a170 2024-09-12T12:26:41.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.800+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b1a170 0x55d523b1c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.801+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b1a170 0x55d523b1c580 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb4735f593354867 server_cookie=b6a7ae541ab028d4 in_seq=0 out_seq=0 2024-09-12T12:26:41.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.801+0000 7ff4b6a00640 10 client.25393 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:26:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.802+0000 7ff4b6a00640 1 -- 172.21.15.38:0/2932776825 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d523a6a950 con 0x55d523b1a170 2024-09-12T12:26:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.802+0000 7ff4b6a00640 10 client.25393 handle_command_reply: tid=0 2024-09-12T12:26:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.802+0000 7ff4da250740 1 client.25393 shutdown 2024-09-12T12:26:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af6c70 msgr2=0x55d523afece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af6c70 0x55d523afece0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4101040 tx=0x7ff4c402a360 comp rx=0 tx=0).stop 2024-09-12T12:26:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 shutdown_connections 2024-09-12T12:26:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b1a170 0x55d523b1c580 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523aff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523aff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 --2- 172.21.15.38:0/2932776825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af6c70 0x55d523afece0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 >> 172.21.15.38:0/2932776825 conn(0x55d523af3200 msgr2=0x55d523af2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4b6a00640 0 client.25393 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:26:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 shutdown_connections 2024-09-12T12:26:41.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.803+0000 7ff4da250740 1 -- 172.21.15.38:0/2932776825 wait complete. 2024-09-12T12:26:41.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.804+0000 7ff4da250740 20 client.25393 trim_cache size 0 max 16384 2024-09-12T12:26:41.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.818+0000 7ff4da250740 1 Processor -- start 2024-09-12T12:26:41.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.818+0000 7ff4da250740 1 -- start start 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4da250740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523af6c70 0x55d523b21e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4da250740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523b22390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4da250740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523b01e50 0x55d523af1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4da250740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01acbd0 con 0x55d523af6c70 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4da250740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01ae710 con 0x55d523af7590 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4da250740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01ad2a0 con 0x55d523b01e50 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4d5800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523b01e50 0x55d523af1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4d5800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523b01e50 0x55d523af1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52234/0 (socket says 172.21.15.38:52234) 2024-09-12T12:26:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.819+0000 7ff4d5800640 1 -- 172.21.15.38:0/1054445240 learned_addr learned my addr 172.21.15.38:0/1054445240 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.820+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523af6c70 0x55d523b21e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.820+0000 7ff4d5800640 1 -- 172.21.15.38:0/1054445240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 msgr2=0x55d523b22390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.820+0000 7ff4d5800640 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523b22390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.820+0000 7ff4d5800640 1 -- 172.21.15.38:0/1054445240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523af6c70 msgr2=0x55d523b21e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.820+0000 7ff4d5800640 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523af6c70 0x55d523b21e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.820+0000 7ff4d5800640 1 -- 172.21.15.38:0/1054445240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d523aee770 con 0x55d523b01e50 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.820+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523af6c70 0x55d523b21e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.821+0000 7ff4d5800640 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523b01e50 0x55d523af1b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8003c40 tx=0x7ff4c8015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3101ced9175f8b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.821+0000 7ff4c1600640 1 -- 172.21.15.38:0/1054445240 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8003db0 con 0x55d523b01e50 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.821+0000 7ff4c1600640 1 -- 172.21.15.38:0/1054445240 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c801e950 con 0x55d523b01e50 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.822+0000 7ff4c1600640 1 -- 172.21.15.38:0/1054445240 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c801ca30 con 0x55d523b01e50 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.822+0000 7ff4da250740 1 -- 172.21.15.38:0/1054445240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523b01e50 msgr2=0x55d523af1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.822+0000 7ff4da250740 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523b01e50 0x55d523af1b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8003c40 tx=0x7ff4c8015000 comp rx=0 tx=0).stop 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.823+0000 7ff4da250740 1 -- 172.21.15.38:0/1054445240 shutdown_connections 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.823+0000 7ff4da250740 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523b01e50 0x55d523af1b60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.823+0000 7ff4da250740 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af7590 0x55d523b22390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.823+0000 7ff4da250740 1 --2- 172.21.15.38:0/1054445240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523af6c70 0x55d523b21e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.823+0000 7ff4da250740 1 -- 172.21.15.38:0/1054445240 >> 172.21.15.38:0/1054445240 conn(0x55d523af3200 msgr2=0x55d523afddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.823+0000 7ff4da250740 1 -- 172.21.15.38:0/1054445240 shutdown_connections 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.823+0000 7ff4da250740 1 -- 172.21.15.38:0/1054445240 wait complete. 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.824+0000 7ff4da250740 1 -- start start 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.824+0000 7ff4da250740 1 Processor -- start 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4da250740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523b12a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4da250740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523afba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4da250740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523afbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4da250740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01ae040 con 0x55d523b01e50 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4da250740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01ad970 con 0x55d523af6c70 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4da250740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01aac30 con 0x55d523af7590 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4da250740 10 client.0 _ll_register_callbacks cb 0x7ff4bc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.825+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523b12a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523b12a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:51496/0 (socket says 172.21.15.38:51496) 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d4e00640 1 -- 172.21.15.38:0/1613116531 learned_addr learned my addr 172.21.15.38:0/1613116531 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d5800640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523afbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523afba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d4e00640 1 -- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 msgr2=0x55d523afba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523afba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d4e00640 1 -- 172.21.15.38:0/1613116531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 msgr2=0x55d523afbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523afbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4d4e00640 1 -- 172.21.15.38:0/1613116531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d523afc790 con 0x55d523af6c70 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.826+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523afba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.827+0000 7ff4d4e00640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523b12a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40b87c0 tx=0x7ff4c40f5b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f80cb28834c459 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.827+0000 7ff4b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.827+0000 7ff4b6a00640 1 -- 172.21.15.38:0/1613116531 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40be070 con 0x55d523af6c70 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.827+0000 7ff4b6a00640 1 -- 172.21.15.38:0/1613116531 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff4c40b7b90 con 0x55d523af6c70 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.828+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4c801e950 con 0x55d523af6c70 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.828+0000 7ff4b6a00640 1 -- 172.21.15.38:0/1613116531 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff4c40bb7a0 con 0x55d523af6c70 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.828+0000 7ff4da250740 10 client.25415 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.828+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d523afc790 con 0x55d523af6c70 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4b6a00640 1 -- 172.21.15.38:0/1613116531 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c801e950 con 0x55d523af6c70 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4b6a00640 1 -- 172.21.15.38:0/1613116531 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff4c40b7d90 con 0x55d523af6c70 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4da250740 10 client.25415 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4da250740 10 client.25415 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4da250740 20 client.25415 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4da250740 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b85100 0x55d523b874f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4da250740 4 client.25415 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.829+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d523a64e60 con 0x55d523b85100 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.830+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b85100 0x55d523b874f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.831+0000 7ff4cfe00640 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b85100 0x55d523b874f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3ad8de197c57ff88 server_cookie=2831c5bc169308df in_seq=0 out_seq=0 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.831+0000 7ff4b6a00640 10 client.25415 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.831+0000 7ff4b6a00640 1 -- 172.21.15.38:0/1613116531 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d523a64e60 con 0x55d523b85100 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.831+0000 7ff4b6a00640 10 client.25415 handle_command_reply: tid=0 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.831+0000 7ff4da250740 1 client.25415 shutdown 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 msgr2=0x55d523b12a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523b12a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40b87c0 tx=0x7ff4c40f5b80 comp rx=0 tx=0).stop 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 shutdown_connections 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d523b85100 0x55d523b874f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d523b01e50 0x55d523afbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d523af7590 0x55d523afba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 --2- 172.21.15.38:0/1613116531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d523af6c70 0x55d523b12a30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 >> 172.21.15.38:0/1613116531 conn(0x55d523af3200 msgr2=0x55d523afec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4b6a00640 0 client.25415 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 shutdown_connections 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.832+0000 7ff4da250740 1 -- 172.21.15.38:0/1613116531 wait complete. 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.833+0000 7ff4da250740 20 client.25415 trim_cache size 0 max 16384 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff4b80a2c80 msgr2=0x7ff4b80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff4b80a2c80 0x7ff4b80a5140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8005fd0 tx=0x7ff4c8009500 comp rx=0 tx=0).stop 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 msgr2=0x7ff4d01a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01a03d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4005940 tx=0x7ff4c4033ae0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 shutdown_connections 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff4b80a2c80 0x7ff4b80a5140 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4d0106f00 0x7ff4d019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d0102780 0x7ff4d01a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 --2- 172.21.15.38:0/2072740640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d0101dd0 0x7ff4d01a03d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.834+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 >> 172.21.15.38:0/2072740640 conn(0x7ff4d00fd890 msgr2=0x7ff4d00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.835+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 shutdown_connections 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:41.835+0000 7ff4d7800640 1 -- 172.21.15.38:0/2072740640 wait complete. 2024-09-12T12:26:41.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:41 smithi038 ceph-mon[30810]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T12:26:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:41 smithi154 ceph-mon[35578]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T12:26:42.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:41 smithi071 ceph-mon[34859]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T12:26:42.794 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:26:43.244 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.919+0000 7f97dca00640 1 -- 172.21.15.38:0/1749810958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 msgr2=0x7f97d8110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.919+0000 7f97dca00640 1 --2- 172.21.15.38:0/1749810958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 0x7f97d8110650 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009be0 tx=0x7f97d002a750 comp rx=0 tx=0).stop 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.920+0000 7f97dca00640 1 -- 172.21.15.38:0/1749810958 shutdown_connections 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.920+0000 7f97dca00640 1 --2- 172.21.15.38:0/1749810958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 0x7f97d8110650 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.920+0000 7f97dca00640 1 --2- 172.21.15.38:0/1749810958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d8074ee0 0x7f97d810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.920+0000 7f97dca00640 1 --2- 172.21.15.38:0/1749810958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 0x7f97d80749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.920+0000 7f97dca00640 1 -- 172.21.15.38:0/1749810958 >> 172.21.15.38:0/1749810958 conn(0x7f97d80fd740 msgr2=0x7f97d80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.920+0000 7f97dca00640 1 -- 172.21.15.38:0/1749810958 shutdown_connections 2024-09-12T12:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.920+0000 7f97dca00640 1 -- 172.21.15.38:0/1749810958 wait complete. 2024-09-12T12:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.921+0000 7f97dca00640 1 Processor -- start 2024-09-12T12:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.922+0000 7f97dca00640 1 -- start start 2024-09-12T12:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.922+0000 7f97dca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 0x7f97d819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.922+0000 7f97dca00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d8074ee0 0x7f97d819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.922+0000 7f97dca00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 0x7f97d819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.922+0000 7f97dca00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f97d8113fb0 con 0x7f97d810e260 2024-09-12T12:26:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.922+0000 7f97dca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97d8113e30 con 0x7f97d80745c0 2024-09-12T12:26:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.922+0000 7f97dca00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97d8114130 con 0x7f97d8074ee0 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 0x7f97d819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 0x7f97d819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:51526/0 (socket says 172.21.15.38:51526) 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 -- 172.21.15.38:0/309101359 learned_addr learned my addr 172.21.15.38:0/309101359 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d5e00640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d8074ee0 0x7f97d819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d7200640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 0x7f97d819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 -- 172.21.15.38:0/309101359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d8074ee0 msgr2=0x7f97d819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d8074ee0 0x7f97d819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 -- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 msgr2=0x7f97d819ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 0x7f97d819ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d6800640 1 -- 172.21.15.38:0/309101359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d819f410 con 0x7f97d80745c0 2024-09-12T12:26:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.923+0000 7f97d7200640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 0x7f97d819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.924+0000 7f97d6800640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 0x7f97d819a460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97c800e9c0 tx=0x7f97c800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.924+0000 7f97cf400640 1 -- 172.21.15.38:0/309101359 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c800cde0 con 0x7f97d80745c0 2024-09-12T12:26:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.924+0000 7f97cf400640 1 -- 172.21.15.38:0/309101359 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c80035f0 con 0x7f97d80745c0 2024-09-12T12:26:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.924+0000 7f97cf400640 1 -- 172.21.15.38:0/309101359 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8010690 con 0x7f97d80745c0 2024-09-12T12:26:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.924+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d819f700 con 0x7f97d80745c0 2024-09-12T12:26:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.924+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d81a6fe0 con 0x7f97d80745c0 2024-09-12T12:26:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.927+0000 7f97cf400640 1 -- 172.21.15.38:0/309101359 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f97c80037a0 con 0x7f97d80745c0 2024-09-12T12:26:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97e006a740 1 Processor -- start 2024-09-12T12:26:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97cf400640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97e006a740 1 -- start start 2024-09-12T12:26:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97cf400640 1 -- 172.21.15.38:0/309101359 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f97c80cf780 con 0x7f97d80745c0 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97e006a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190de40 0x55668190e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97e006a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190e760 0x556681918ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97e006a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x55668191b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97e006a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5566818743e0 con 0x55668190de40 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.929+0000 7f97e006a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55668181bd80 con 0x55668190e760 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.930+0000 7f97e006a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5566818703a0 con 0x556681919020 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.930+0000 7f97d6800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190de40 0x55668190e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.930+0000 7f97d6800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190de40 0x55668190e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55544/0 (socket says 172.21.15.38:55544) 2024-09-12T12:26:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.930+0000 7f97d6800640 1 -- 172.21.15.38:0/2366381633 learned_addr learned my addr 172.21.15.38:0/2366381633 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.930+0000 7f97d7200640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.931+0000 7f97d5e00640 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190e760 0x556681918ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.931+0000 7f97d6800640 1 -- 172.21.15.38:0/2366381633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 msgr2=0x55668191b410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.931+0000 7f97d6800640 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x55668191b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.931+0000 7f97d6800640 1 -- 172.21.15.38:0/2366381633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190e760 msgr2=0x556681918ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.931+0000 7f97d6800640 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190e760 0x556681918ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.932+0000 7f97d7200640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97d002ac70 tx=0x7f97d0009840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.932+0000 7f97d6800640 1 -- 172.21.15.38:0/2366381633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668183aae0 con 0x55668190de40 2024-09-12T12:26:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.932+0000 7f97d6800640 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190de40 0x55668190e220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f97c80a4310 tx=0x7f97c8009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51da2c834dd98312 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.933+0000 7f97c3400640 1 -- 172.21.15.38:0/2366381633 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c809bbd0 con 0x55668190de40 2024-09-12T12:26:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.933+0000 7f97c3400640 1 -- 172.21.15.38:0/2366381633 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c809ff80 con 0x55668190de40 2024-09-12T12:26:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.933+0000 7f97c3400640 1 -- 172.21.15.38:0/2366381633 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c809b020 con 0x55668190de40 2024-09-12T12:26:43.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 -- 172.21.15.38:0/2366381633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190de40 msgr2=0x55668190e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190de40 0x55668190e220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f97c80a4310 tx=0x7f97c8009540 comp rx=0 tx=0).stop 2024-09-12T12:26:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 -- 172.21.15.38:0/2366381633 shutdown_connections 2024-09-12T12:26:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x55668191b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190e760 0x556681918ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 --2- 172.21.15.38:0/2366381633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190de40 0x55668190e220 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 -- 172.21.15.38:0/2366381633 >> 172.21.15.38:0/2366381633 conn(0x55668190a3d0 msgr2=0x55668190a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 -- 172.21.15.38:0/2366381633 shutdown_connections 2024-09-12T12:26:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.934+0000 7f97e006a740 1 -- 172.21.15.38:0/2366381633 wait complete. 2024-09-12T12:26:43.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.935+0000 7f97e006a740 1 -- start start 2024-09-12T12:26:43.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.935+0000 7f97e006a740 1 Processor -- start 2024-09-12T12:26:43.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.936+0000 7f97e006a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681915f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.936+0000 7f97e006a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190e760 0x556681916460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.936+0000 7f97e006a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x5566819169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.936+0000 7f97e006a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556681924400 con 0x55668190e760 2024-09-12T12:26:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.936+0000 7f97e006a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55668182f0f0 con 0x55668190de40 2024-09-12T12:26:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.936+0000 7f97e006a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556681924580 con 0x556681919020 2024-09-12T12:26:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.936+0000 7f97e006a740 10 client.0 _ll_register_callbacks cb 0x556681816bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190e760 0x556681916460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x5566819169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x5566819169a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:52282/0 (socket says 172.21.15.38:52282) 2024-09-12T12:26:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d7200640 1 -- 172.21.15.38:0/3322021990 learned_addr learned my addr 172.21.15.38:0/3322021990 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d6800640 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681915f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d5e00640 1 -- 172.21.15.38:0/3322021990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 msgr2=0x5566819169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d5e00640 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x5566819169a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d5e00640 1 -- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 msgr2=0x556681915f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d5e00640 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681915f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d5e00640 1 -- 172.21.15.38:0/3322021990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566815e53c0 con 0x55668190e760 2024-09-12T12:26:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.937+0000 7f97d7200640 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x5566819169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.938+0000 7f97d5e00640 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190e760 0x556681916460 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f97d810f5f0 tx=0x7f97c4013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b144ee5f84046fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.938+0000 7f97b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:26:43.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.938+0000 7f97b7e00640 1 -- 172.21.15.38:0/3322021990 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4004460 con 0x55668190e760 2024-09-12T12:26:43.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.939+0000 7f97b7e00640 1 -- 172.21.15.38:0/3322021990 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f97c40119c0 con 0x55668190e760 2024-09-12T12:26:43.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.939+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97c809ff80 con 0x55668190e760 2024-09-12T12:26:43.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.939+0000 7f97b7e00640 1 -- 172.21.15.38:0/3322021990 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f97c4011bc0 con 0x55668190e760 2024-09-12T12:26:43.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.939+0000 7f97e006a740 10 client.15411 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:43.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.939+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5566819304b0 con 0x55668190e760 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97b7e00640 1 -- 172.21.15.38:0/3322021990 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c809ff80 con 0x55668190e760 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97b7e00640 1 -- 172.21.15.38:0/3322021990 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f97c401a070 con 0x55668190e760 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97e006a740 10 client.15411 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97e006a740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97e006a740 20 client.15411 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97e006a740 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x556681931960 0x556681933d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97e006a740 4 client.15411 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:43.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.940+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556681881950 con 0x556681931960 2024-09-12T12:26:43.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.941+0000 7f97d6800640 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x556681931960 0x556681933d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.942+0000 7f97d6800640 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x556681931960 0x556681933d80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f369932362d37e94 server_cookie=555ed02531ecb982 in_seq=0 out_seq=0 2024-09-12T12:26:43.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.942+0000 7f97b7e00640 10 client.15411 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:43.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.942+0000 7f97b7e00640 1 -- 172.21.15.38:0/3322021990 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556681881950 con 0x556681931960 2024-09-12T12:26:43.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.942+0000 7f97b7e00640 10 client.15411 handle_command_reply: tid=0 2024-09-12T12:26:43.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.942+0000 7f97e006a740 1 client.15411 shutdown 2024-09-12T12:26:43.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190e760 msgr2=0x556681916460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190e760 0x556681916460 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f97d810f5f0 tx=0x7f97c4013b70 comp rx=0 tx=0).stop 2024-09-12T12:26:43.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 shutdown_connections 2024-09-12T12:26:43.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x556681931960 0x556681933d80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681919020 0x5566819169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55668190e760 0x556681916460 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 --2- 172.21.15.38:0/3322021990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681915f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 >> 172.21.15.38:0/3322021990 conn(0x55668190a3d0 msgr2=0x556681910100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97b7e00640 0 client.15411 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:43.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.943+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 shutdown_connections 2024-09-12T12:26:43.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.944+0000 7f97e006a740 1 -- 172.21.15.38:0/3322021990 wait complete. 2024-09-12T12:26:43.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.944+0000 7f97e006a740 20 client.15411 trim_cache size 0 max 16384 2024-09-12T12:26:43.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 Processor -- start 2024-09-12T12:26:43.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 -- start start 2024-09-12T12:26:43.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55668190de40 0x5566819147f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x5566819167f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556681939630 0x556681939a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f97d81acae0 con 0x556681919020 2024-09-12T12:26:43.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97d81ae620 con 0x556681939630 2024-09-12T12:26:43.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.958+0000 7f97e006a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97d81ad1b0 con 0x55668190de40 2024-09-12T12:26:43.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.959+0000 7f97d6800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55668190de40 0x5566819147f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.959+0000 7f97d7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556681939630 0x556681939a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.959+0000 7f97d7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556681939630 0x556681939a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:51546/0 (socket says 172.21.15.38:51546) 2024-09-12T12:26:43.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.959+0000 7f97d7200640 1 -- 172.21.15.38:0/1152945818 learned_addr learned my addr 172.21.15.38:0/1152945818 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:43.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.959+0000 7f97d5e00640 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x5566819167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.960+0000 7f97d7200640 1 -- 172.21.15.38:0/1152945818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55668190de40 msgr2=0x5566819147f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.960+0000 7f97d7200640 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55668190de40 0x5566819147f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.960+0000 7f97d7200640 1 -- 172.21.15.38:0/1152945818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 msgr2=0x5566819167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.960+0000 7f97d7200640 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x5566819167f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.960+0000 7f97d7200640 1 -- 172.21.15.38:0/1152945818 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668190b480 con 0x556681939630 2024-09-12T12:26:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.960+0000 7f97d5e00640 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x5566819167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.961+0000 7f97d7200640 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556681939630 0x556681939a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97d0030f60 tx=0x7f97d003c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b547ddf82d5f1a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.961+0000 7f97c2a00640 1 -- 172.21.15.38:0/1152945818 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d004e070 con 0x556681939630 2024-09-12T12:26:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.961+0000 7f97c2a00640 1 -- 172.21.15.38:0/1152945818 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d0003b70 con 0x556681939630 2024-09-12T12:26:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.961+0000 7f97c2a00640 1 -- 172.21.15.38:0/1152945818 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0042070 con 0x556681939630 2024-09-12T12:26:43.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 -- 172.21.15.38:0/1152945818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556681939630 msgr2=0x556681939a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556681939630 0x556681939a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97d0030f60 tx=0x7f97d003c000 comp rx=0 tx=0).stop 2024-09-12T12:26:43.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 -- 172.21.15.38:0/1152945818 shutdown_connections 2024-09-12T12:26:43.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556681939630 0x556681939a90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x5566819167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 --2- 172.21.15.38:0/1152945818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55668190de40 0x5566819147f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 -- 172.21.15.38:0/1152945818 >> 172.21.15.38:0/1152945818 conn(0x55668190a3d0 msgr2=0x556681917fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 -- 172.21.15.38:0/1152945818 shutdown_connections 2024-09-12T12:26:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.962+0000 7f97e006a740 1 -- 172.21.15.38:0/1152945818 wait complete. 2024-09-12T12:26:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.963+0000 7f97e006a740 1 -- start start 2024-09-12T12:26:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.963+0000 7f97e006a740 1 Processor -- start 2024-09-12T12:26:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97e006a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681925c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97e006a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x556681926150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97e006a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681939630 0x55668199b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97e006a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f97d81adf50 con 0x556681919020 2024-09-12T12:26:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97e006a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97d81ad880 con 0x55668190de40 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97e006a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97d81aaac0 con 0x556681939630 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97e006a740 10 client.0 _ll_register_callbacks cb 0x7f97c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97d5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x556681926150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97d6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681925c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97d5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x556681926150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55576/0 (socket says 172.21.15.38:55576) 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.964+0000 7f97d5e00640 1 -- 172.21.15.38:0/1896297477 learned_addr learned my addr 172.21.15.38:0/1896297477 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.965+0000 7f97d7200640 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681939630 0x55668199b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.965+0000 7f97d5e00640 1 -- 172.21.15.38:0/1896297477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681939630 msgr2=0x55668199b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.965+0000 7f97d5e00640 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681939630 0x55668199b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.965+0000 7f97d5e00640 1 -- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 msgr2=0x556681925c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.965+0000 7f97d5e00640 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681925c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.965+0000 7f97d5e00640 1 -- 172.21.15.38:0/1896297477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556681910cb0 con 0x556681919020 2024-09-12T12:26:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.965+0000 7f97d6800640 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681925c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:43.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.966+0000 7f97d5e00640 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x556681926150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f97c400a010 tx=0x7f97c4005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461a515bbb3ea574 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.966+0000 7f97b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:26:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.966+0000 7f97b7e00640 1 -- 172.21.15.38:0/1896297477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40054d0 con 0x556681919020 2024-09-12T12:26:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.966+0000 7f97b7e00640 1 -- 172.21.15.38:0/1896297477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f97c40258d0 con 0x556681919020 2024-09-12T12:26:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.967+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97d0003b70 con 0x556681919020 2024-09-12T12:26:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.967+0000 7f97b7e00640 1 -- 172.21.15.38:0/1896297477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f97c4025af0 con 0x556681919020 2024-09-12T12:26:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.967+0000 7f97e006a740 10 client.15417 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.967+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55668199cc10 con 0x556681919020 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97b7e00640 1 -- 172.21.15.38:0/1896297477 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d0003b70 con 0x556681919020 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97b7e00640 1 -- 172.21.15.38:0/1896297477 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f97c401a070 con 0x556681919020 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97e006a740 10 client.15417 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97e006a740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97e006a740 20 client.15417 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97e006a740 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55668199d390 0x55668199f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97e006a740 4 client.15417 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.968+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55668187be60 con 0x55668199d390 2024-09-12T12:26:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.969+0000 7f97d6800640 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55668199d390 0x55668199f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.970+0000 7f97d6800640 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55668199d390 0x55668199f7b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60e0332cbb2cdad server_cookie=adf7186a3aee0c46 in_seq=0 out_seq=0 2024-09-12T12:26:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.970+0000 7f97b7e00640 10 client.15417 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.970+0000 7f97b7e00640 1 -- 172.21.15.38:0/1896297477 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55668187be60 con 0x55668199d390 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.970+0000 7f97b7e00640 10 client.15417 handle_command_reply: tid=0 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.970+0000 7f97e006a740 1 client.15417 shutdown 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.970+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 msgr2=0x556681926150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.970+0000 7f97e006a740 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x556681926150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f97c400a010 tx=0x7f97c4005ce0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 shutdown_connections 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55668199d390 0x55668199f7b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556681939630 0x55668199b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556681919020 0x556681926150 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97b7e00640 0 client.15417 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 --2- 172.21.15.38:0/1896297477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55668190de40 0x556681925c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 >> 172.21.15.38:0/1896297477 conn(0x55668190a3d0 msgr2=0x556681917fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 shutdown_connections 2024-09-12T12:26:43.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 1 -- 172.21.15.38:0/1896297477 wait complete. 2024-09-12T12:26:43.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.971+0000 7f97e006a740 20 client.15417 trim_cache size 0 max 16384 2024-09-12T12:26:43.972 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f97bc0a2c00 msgr2=0x7f97bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f97d002ac70 tx=0x7f97d0009840 comp rx=0 tx=0).stop 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 msgr2=0x7f97d819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 0x7f97d819a460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97c800e9c0 tx=0x7f97c800ee80 comp rx=0 tx=0).stop 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 shutdown_connections 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f97bc0a2c00 0x7f97bc0a50c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97d810e260 0x7f97d819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d8074ee0 0x7f97d819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 --2- 172.21.15.38:0/309101359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97d80745c0 0x7f97d819a460 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.972+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 >> 172.21.15.38:0/309101359 conn(0x7f97d80fd740 msgr2=0x7f97d80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.973+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 shutdown_connections 2024-09-12T12:26:43.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:43.973+0000 7f97dca00640 1 -- 172.21.15.38:0/309101359 wait complete. 2024-09-12T12:26:43.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:43 smithi038 ceph-mon[30810]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T12:26:44.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:43 smithi154 ceph-mon[35578]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T12:26:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:43 smithi071 ceph-mon[34859]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T12:26:45.858 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:26:45.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:26:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:45 smithi154 ceph-mon[35578]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:46.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:45 smithi038 ceph-mon[30810]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:46.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:45 smithi071 ceph-mon[34859]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:26:46.310 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.196+0000 7f4471e00640 1 -- 172.21.15.38:0/4156692380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 msgr2=0x7f446c10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.196+0000 7f4471e00640 1 --2- 172.21.15.38:0/4156692380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c10b9a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4458009900 tx=0x7f445802a480 comp rx=0 tx=0).stop 2024-09-12T12:26:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.196+0000 7f4471e00640 1 -- 172.21.15.38:0/4156692380 shutdown_connections 2024-09-12T12:26:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.196+0000 7f4471e00640 1 --2- 172.21.15.38:0/4156692380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446c10bfc0 0x7f446c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.196+0000 7f4471e00640 1 --2- 172.21.15.38:0/4156692380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c10b9a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.196+0000 7f4471e00640 1 --2- 172.21.15.38:0/4156692380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c102b90 0x7f446c102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.196+0000 7f4471e00640 1 -- 172.21.15.38:0/4156692380 >> 172.21.15.38:0/4156692380 conn(0x7f446c0fc610 msgr2=0x7f446c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.197+0000 7f4471e00640 1 -- 172.21.15.38:0/4156692380 shutdown_connections 2024-09-12T12:26:47.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.197+0000 7f4471e00640 1 -- 172.21.15.38:0/4156692380 wait complete. 2024-09-12T12:26:47.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.198+0000 7f4471e00640 1 Processor -- start 2024-09-12T12:26:47.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.199+0000 7f4471e00640 1 -- start start 2024-09-12T12:26:47.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.199+0000 7f4471e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c102b90 0x7f446c1161b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.199+0000 7f4471e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c1166f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.199+0000 7f4471e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446c10bfc0 0x7f446c11bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.199+0000 7f4471e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1023e0 con 0x7f446c1034b0 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.199+0000 7f4471e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f446c102260 con 0x7f446c10bfc0 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.199+0000 7f4471e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f446c102560 con 0x7f446c102b90 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f4470a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c102b90 0x7f446c1161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f446be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c1166f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f446be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c1166f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47804/0 (socket says 172.21.15.38:47804) 2024-09-12T12:26:47.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f446be00640 1 -- 172.21.15.38:0/1597472172 learned_addr learned my addr 172.21.15.38:0/1597472172 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f4471400640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446c10bfc0 0x7f446c11bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f4471400640 1 -- 172.21.15.38:0/1597472172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c102b90 msgr2=0x7f446c1161b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f4471400640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c102b90 0x7f446c1161b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.200+0000 7f4471400640 1 -- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 msgr2=0x7f446c1166f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.201+0000 7f4471400640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c1166f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.201+0000 7f4471400640 1 -- 172.21.15.38:0/1597472172 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c11c790 con 0x7f446c10bfc0 2024-09-12T12:26:47.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.201+0000 7f446be00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c1166f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:47.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.201+0000 7f4471400640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446c10bfc0 0x7f446c11bed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f446400ec50 tx=0x7f446400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.201+0000 7f4469600640 1 -- 172.21.15.38:0/1597472172 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464003b70 con 0x7f446c10bfc0 2024-09-12T12:26:47.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.202+0000 7f4469600640 1 -- 172.21.15.38:0/1597472172 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4464003d10 con 0x7f446c10bfc0 2024-09-12T12:26:47.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.202+0000 7f4469600640 1 -- 172.21.15.38:0/1597472172 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464010890 con 0x7f446c10bfc0 2024-09-12T12:26:47.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.202+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c11ca80 con 0x7f446c10bfc0 2024-09-12T12:26:47.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.202+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c111500 con 0x7f446c10bfc0 2024-09-12T12:26:47.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.206+0000 7f4475ff9740 1 Processor -- start 2024-09-12T12:26:47.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.207+0000 7f4469600640 1 -- 172.21.15.38:0/1597472172 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4464003fc0 con 0x7f446c10bfc0 2024-09-12T12:26:47.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.207+0000 7f4475ff9740 1 -- start start 2024-09-12T12:26:47.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.208+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcc9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.208+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.208+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.208+0000 7f4475ff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ef3bc2f290 con 0x55ef3bcc95d0 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.208+0000 7f4475ff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef3bbd6b40 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.208+0000 7f4475ff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ef3bc2b250 con 0x55ef3bcd3e90 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.209+0000 7f4470a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.209+0000 7f4470a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47810/0 (socket says 172.21.15.38:47810) 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.209+0000 7f4470a00640 1 -- 172.21.15.38:0/2762332747 learned_addr learned my addr 172.21.15.38:0/2762332747 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.209+0000 7f446be00640 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcc9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.209+0000 7f446be00640 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.210+0000 7f4470a00640 1 -- 172.21.15.38:0/2762332747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 msgr2=0x55ef3bcd6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.210+0000 7f4470a00640 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.210+0000 7f4470a00640 1 -- 172.21.15.38:0/2762332747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcc8cb0 msgr2=0x55ef3bcc9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.210+0000 7f4470a00640 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcc9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.210+0000 7f4470a00640 1 -- 172.21.15.38:0/2762332747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef3b9a06a0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.210+0000 7f4469600640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44540a2c00 0x7f44540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.211+0000 7f4469600640 1 -- 172.21.15.38:0/1597472172 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f44640cf940 con 0x7f446c10bfc0 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.211+0000 7f446be00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44540a2c00 0x7f44540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.211+0000 7f4470a00640 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd3950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4460009cf0 tx=0x7f4460011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95344730e18d0bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.212+0000 7f445dc00640 1 -- 172.21.15.38:0/2762332747 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460004230 con 0x55ef3bcc95d0 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.212+0000 7f445dc00640 1 -- 172.21.15.38:0/2762332747 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44600043d0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.212+0000 7f445dc00640 1 -- 172.21.15.38:0/2762332747 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460019840 con 0x55ef3bcc95d0 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 -- 172.21.15.38:0/2762332747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 msgr2=0x55ef3bcd3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd3950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4460009cf0 tx=0x7f4460011810 comp rx=0 tx=0).stop 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f446be00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44540a2c00 0x7f44540a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f446c112a90 tx=0x7f44580314b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 -- 172.21.15.38:0/2762332747 shutdown_connections 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd3950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2762332747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcc9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 -- 172.21.15.38:0/2762332747 >> 172.21.15.38:0/2762332747 conn(0x55ef3bcc5240 msgr2=0x55ef3bcc5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.213+0000 7f4475ff9740 1 -- 172.21.15.38:0/2762332747 shutdown_connections 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.214+0000 7f4475ff9740 1 -- 172.21.15.38:0/2762332747 wait complete. 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.214+0000 7f4475ff9740 1 -- start start 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.214+0000 7f4475ff9740 1 Processor -- start 2024-09-12T12:26:47.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.215+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcd3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.215+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.215+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.215+0000 7f4475ff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ef3bcd6b00 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.215+0000 7f4475ff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef3bbe9fa0 con 0x55ef3bcd3e90 2024-09-12T12:26:47.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.215+0000 7f4475ff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ef3bcd6c80 con 0x55ef3bcc95d0 2024-09-12T12:26:47.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.215+0000 7f4475ff9740 10 client.0 _ll_register_callbacks cb 0x55ef3b93dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:47.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4470a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcd3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4470a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcd3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47820/0 (socket says 172.21.15.38:47820) 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4470a00640 1 -- 172.21.15.38:0/2137106278 learned_addr learned my addr 172.21.15.38:0/2137106278 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f446be00640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4470a00640 1 -- 172.21.15.38:0/2137106278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcc95d0 msgr2=0x55ef3bcd0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4470a00640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4471400640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4470a00640 1 -- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcd3e90 msgr2=0x55ef3bcd0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.216+0000 7f4470a00640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.217+0000 7f4470a00640 1 -- 172.21.15.38:0/2137106278 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef3bcd1770 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.217+0000 7f4471400640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:47.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.217+0000 7f446be00640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:47.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.217+0000 7f4470a00640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcd3750 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4460000c00 tx=0x7f4460003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f60c31015ca361c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.217+0000 7f4452000640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.218+0000 7f4452000640 1 -- 172.21.15.38:0/2137106278 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460027070 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.218+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44600043d0 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.218+0000 7f4452000640 1 -- 172.21.15.38:0/2137106278 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f4460005240 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.218+0000 7f4452000640 1 -- 172.21.15.38:0/2137106278 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4460031050 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.218+0000 7f4475ff9740 10 client.15429 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.218+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef3bce29a0 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4452000640 1 -- 172.21.15.38:0/2137106278 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44600043d0 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4452000640 1 -- 172.21.15.38:0/2137106278 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f4460004ba0 con 0x55ef3bcc8cb0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4475ff9740 10 client.15429 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4475ff9740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:47.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4475ff9740 20 client.15429 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:47.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bce3db0 0x55ef3bce61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4475ff9740 4 client.15429 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:47.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.219+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef3bc3c800 con 0x55ef3bce3db0 2024-09-12T12:26:47.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.220+0000 7f446be00640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bce3db0 0x55ef3bce61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.221+0000 7f446be00640 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bce3db0 0x55ef3bce61a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6ac8054f38c5652 server_cookie=b4f291bbeeb41b24 in_seq=0 out_seq=0 2024-09-12T12:26:47.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.221+0000 7f4452000640 10 client.15429 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:47.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.222+0000 7f4452000640 1 -- 172.21.15.38:0/2137106278 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef3bc3c800 con 0x55ef3bce3db0 2024-09-12T12:26:47.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.222+0000 7f4452000640 10 client.15429 handle_command_reply: tid=0 2024-09-12T12:26:47.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.222+0000 7f4475ff9740 1 client.15429 shutdown 2024-09-12T12:26:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc8cb0 msgr2=0x55ef3bcd3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcd3750 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4460000c00 tx=0x7f4460003820 comp rx=0 tx=0).stop 2024-09-12T12:26:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 shutdown_connections 2024-09-12T12:26:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bce3db0 0x55ef3bce61a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcd0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2137106278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc8cb0 0x55ef3bcd3750 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4452000640 0 client.15429 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.223+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 >> 172.21.15.38:0/2137106278 conn(0x55ef3bcc5240 msgr2=0x55ef3bccaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.224+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 shutdown_connections 2024-09-12T12:26:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.224+0000 7f4475ff9740 1 -- 172.21.15.38:0/2137106278 wait complete. 2024-09-12T12:26:47.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.224+0000 7f4475ff9740 20 client.15429 trim_cache size 0 max 16384 2024-09-12T12:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 Processor -- start 2024-09-12T12:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 -- start start 2024-09-12T12:26:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bceb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcebea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bccdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1bdb30 con 0x55ef3bcc95d0 2024-09-12T12:26:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1bf670 con 0x55ef3bccbf60 2024-09-12T12:26:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.261+0000 7f4475ff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1be200 con 0x55ef3bcd3e90 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f446be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f4470a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bceb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f446be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcebea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:56726/0 (socket says 172.21.15.38:56726) 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f446be00640 1 -- 172.21.15.38:0/2667191038 learned_addr learned my addr 172.21.15.38:0/2667191038 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f4471400640 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bccdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f446be00640 1 -- 172.21.15.38:0/2667191038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 msgr2=0x55ef3bccdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f446be00640 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bccdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.262+0000 7f446be00640 1 -- 172.21.15.38:0/2667191038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 msgr2=0x55ef3bceb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.263+0000 7f446be00640 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bceb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.263+0000 7f446be00640 1 -- 172.21.15.38:0/2667191038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef3bce6510 con 0x55ef3bcd3e90 2024-09-12T12:26:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.263+0000 7f4470a00640 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bceb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.263+0000 7f446be00640 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcebea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f445802aa70 tx=0x7f4458009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b26e231df07a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.263+0000 7f445d200640 1 -- 172.21.15.38:0/2667191038 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458031c00 con 0x55ef3bcd3e90 2024-09-12T12:26:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.264+0000 7f445d200640 1 -- 172.21.15.38:0/2667191038 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4458031da0 con 0x55ef3bcd3e90 2024-09-12T12:26:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.264+0000 7f445d200640 1 -- 172.21.15.38:0/2667191038 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458004e00 con 0x55ef3bcd3e90 2024-09-12T12:26:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 -- 172.21.15.38:0/2667191038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 msgr2=0x55ef3bcebea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcebea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f445802aa70 tx=0x7f4458009260 comp rx=0 tx=0).stop 2024-09-12T12:26:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 -- 172.21.15.38:0/2667191038 shutdown_connections 2024-09-12T12:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bccdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcebea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 --2- 172.21.15.38:0/2667191038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bceb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 -- 172.21.15.38:0/2667191038 >> 172.21.15.38:0/2667191038 conn(0x55ef3bcc5240 msgr2=0x55ef3bcd2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 -- 172.21.15.38:0/2667191038 shutdown_connections 2024-09-12T12:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.265+0000 7f4475ff9740 1 -- 172.21.15.38:0/2667191038 wait complete. 2024-09-12T12:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.266+0000 7f4475ff9740 1 -- start start 2024-09-12T12:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.266+0000 7f4475ff9740 1 Processor -- start 2024-09-12T12:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.267+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcdc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.267+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bcd8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.267+0000 7f4475ff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.267+0000 7f4475ff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1befa0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.267+0000 7f4475ff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1be8d0 con 0x55ef3bccbf60 2024-09-12T12:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.267+0000 7f4475ff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1bbb10 con 0x55ef3bcd3e90 2024-09-12T12:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.267+0000 7f4475ff9740 10 client.0 _ll_register_callbacks cb 0x7f44640093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f446be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bcd8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcdc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcdc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47828/0 (socket says 172.21.15.38:47828) 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 -- 172.21.15.38:0/621944080 learned_addr learned my addr 172.21.15.38:0/621944080 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4471400640 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 -- 172.21.15.38:0/621944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 msgr2=0x55ef3bcd8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 -- 172.21.15.38:0/621944080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 msgr2=0x55ef3bcd8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bcd8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.268+0000 7f4470a00640 1 -- 172.21.15.38:0/621944080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef3bcd93e0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.269+0000 7f4470a00640 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcdc4c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4460004f70 tx=0x7f4460003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e96ccc7a26301d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.269+0000 7f4452000640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.270+0000 7f4452000640 1 -- 172.21.15.38:0/621944080 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460027040 con 0x55ef3bcc95d0 2024-09-12T12:26:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.270+0000 7f4452000640 1 -- 172.21.15.38:0/621944080 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f4460004fa0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.270+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4458031da0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.271+0000 7f4452000640 1 -- 172.21.15.38:0/621944080 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4460045050 con 0x55ef3bcc95d0 2024-09-12T12:26:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.271+0000 7f4475ff9740 10 client.15435 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.271+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef3bd4f810 con 0x55ef3bcc95d0 2024-09-12T12:26:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4452000640 1 -- 172.21.15.38:0/621944080 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4458031da0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4452000640 1 -- 172.21.15.38:0/621944080 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f446003f4c0 con 0x55ef3bcc95d0 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4475ff9740 10 client.15435 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4475ff9740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4475ff9740 20 client.15435 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4475ff9740 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bd4fed0 0x55ef3bd522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4475ff9740 4 client.15435 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.272+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ef3bcd12d0 con 0x55ef3bd4fed0 2024-09-12T12:26:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.273+0000 7f446be00640 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bd4fed0 0x55ef3bd522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.274+0000 7f446be00640 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bd4fed0 0x55ef3bd522f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=244fdc145cb48253 server_cookie=cf85692ec166984b in_seq=0 out_seq=0 2024-09-12T12:26:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.274+0000 7f4452000640 10 client.15435 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.275+0000 7f4452000640 1 -- 172.21.15.38:0/621944080 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ef3bcd12d0 con 0x55ef3bd4fed0 2024-09-12T12:26:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.275+0000 7f4452000640 10 client.15435 handle_command_reply: tid=0 2024-09-12T12:26:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.275+0000 7f4475ff9740 1 client.15435 shutdown 2024-09-12T12:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 msgr2=0x55ef3bcdc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcdc4c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4460004f70 tx=0x7f4460003890 comp rx=0 tx=0).stop 2024-09-12T12:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 shutdown_connections 2024-09-12T12:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55ef3bd4fed0 0x55ef3bd522f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ef3bcd3e90 0x55ef3bcd8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef3bccbf60 0x55ef3bcd8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 --2- 172.21.15.38:0/621944080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ef3bcc95d0 0x55ef3bcdc4c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.276+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 >> 172.21.15.38:0/621944080 conn(0x55ef3bcc5240 msgr2=0x55ef3bccf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.277+0000 7f4452000640 0 client.15435 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.277+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 shutdown_connections 2024-09-12T12:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.277+0000 7f4475ff9740 1 -- 172.21.15.38:0/621944080 wait complete. 2024-09-12T12:26:47.277 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:26:47.278 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-12T12:26:47.278 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "66368c61-ac2e-4754-8af0-a44ba5b9281d", 2024-09-12T12:26:47.278 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-12T12:26:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.277+0000 7f4475ff9740 20 client.15435 trim_cache size 0 max 16384 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44540a2c00 msgr2=0x7f44540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44540a2c00 0x7f44540a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f446c112a90 tx=0x7f44580314b0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446c10bfc0 msgr2=0x7f446c11bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446c10bfc0 0x7f446c11bed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f446400ec50 tx=0x7f446400c6a0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 shutdown_connections 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f44540a2c00 0x7f44540a50c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f446c10bfc0 0x7f446c11bed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f446c1034b0 0x7f446c1166f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.278+0000 7f4471e00640 1 --2- 172.21.15.38:0/1597472172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c102b90 0x7f446c1161b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.279+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 >> 172.21.15.38:0/1597472172 conn(0x7f446c0fc610 msgr2=0x7f446c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.279+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 shutdown_connections 2024-09-12T12:26:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:47.279+0000 7f4471e00640 1 -- 172.21.15.38:0/1597472172 wait complete. 2024-09-12T12:26:47.866 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:47 smithi038 ceph-mon[30810]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:48.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:26:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:47 smithi154 ceph-mon[35578]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:47 smithi071 ceph-mon[34859]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:48.477 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:48.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:48 smithi038 ceph-mon[30810]: scrub queued for path: / 2024-09-12T12:26:48.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:48 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:48.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:48 smithi038 ceph-mon[30810]: scrub summary: active paths [/] 2024-09-12T12:26:48.890 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:48 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:48.891 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:48 smithi038 ceph-mon[30810]: scrub summary: idle 2024-09-12T12:26:49.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:48 smithi071 ceph-mon[34859]: scrub queued for path: / 2024-09-12T12:26:49.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:48 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:49.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:48 smithi071 ceph-mon[34859]: scrub summary: active paths [/] 2024-09-12T12:26:49.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:48 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:49.165 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:48 smithi071 ceph-mon[34859]: scrub summary: idle 2024-09-12T12:26:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 -- 172.21.15.38:0/3659105525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 msgr2=0x7fbac4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 --2- 172.21.15.38:0/3659105525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac4108830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009900 tx=0x7fbab002a410 comp rx=0 tx=0).stop 2024-09-12T12:26:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 -- 172.21.15.38:0/3659105525 shutdown_connections 2024-09-12T12:26:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 --2- 172.21.15.38:0/3659105525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbac4108f60 0x7fbac4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 --2- 172.21.15.38:0/3659105525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac4108830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 --2- 172.21.15.38:0/3659105525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbac4103e30 0x7fbac4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 -- 172.21.15.38:0/3659105525 >> 172.21.15.38:0/3659105525 conn(0x7fbac40ff910 msgr2=0x7fbac4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.165+0000 7fbac9600640 1 -- 172.21.15.38:0/3659105525 shutdown_connections 2024-09-12T12:26:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.166+0000 7fbac9600640 1 -- 172.21.15.38:0/3659105525 wait complete. 2024-09-12T12:26:49.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:48 smithi154 ceph-mon[35578]: scrub queued for path: / 2024-09-12T12:26:49.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:48 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:49.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:48 smithi154 ceph-mon[35578]: scrub summary: active paths [/] 2024-09-12T12:26:49.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:48 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:49.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:48 smithi154 ceph-mon[35578]: scrub summary: idle 2024-09-12T12:26:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.167+0000 7fbac9600640 1 Processor -- start 2024-09-12T12:26:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.168+0000 7fbac9600640 1 -- start start 2024-09-12T12:26:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.168+0000 7fbac9600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbac4103e30 0x7fbac419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.168+0000 7fbac9600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.168+0000 7fbac9600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbac4108f60 0x7fbac419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.168+0000 7fbac9600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbac4114010 con 0x7fbac4103e30 2024-09-12T12:26:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.168+0000 7fbac9600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbac4113e90 con 0x7fbac4108f60 2024-09-12T12:26:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.168+0000 7fbac9600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbac4114190 con 0x7fbac41047e0 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:56756/0 (socket says 172.21.15.38:56756) 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 -- 172.21.15.38:0/1876930688 learned_addr learned my addr 172.21.15.38:0/1876930688 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3e00640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbac4103e30 0x7fbac419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac8c00640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbac4108f60 0x7fbac419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 -- 172.21.15.38:0/1876930688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbac4108f60 msgr2=0x7fbac419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbac4108f60 0x7fbac419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 -- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbac4103e30 msgr2=0x7fbac419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbac4103e30 0x7fbac419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.169+0000 7fbac3400640 1 -- 172.21.15.38:0/1876930688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac419f4c0 con 0x7fbac41047e0 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.170+0000 7fbac3400640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac419aa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbab0004770 tx=0x7fbab0003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.170+0000 7fbac0c00640 1 -- 172.21.15.38:0/1876930688 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab003f070 con 0x7fbac41047e0 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.170+0000 7fbac0c00640 1 -- 172.21.15.38:0/1876930688 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab0031ca0 con 0x7fbac41047e0 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.170+0000 7fbac0c00640 1 -- 172.21.15.38:0/1876930688 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0035030 con 0x7fbac41047e0 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.170+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac419f750 con 0x7fbac41047e0 2024-09-12T12:26:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.170+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac419fbe0 con 0x7fbac41047e0 2024-09-12T12:26:49.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.175+0000 7fbacd85f740 1 Processor -- start 2024-09-12T12:26:49.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbacd85f740 1 -- start start 2024-09-12T12:26:49.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbac0c00640 1 -- 172.21.15.38:0/1876930688 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbab0042070 con 0x7fbac41047e0 2024-09-12T12:26:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7c85130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c8f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c92320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbacd85f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5571e7beb3e0 con 0x5571e7c85670 2024-09-12T12:26:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbacd85f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5571e7b92d80 con 0x5571e7c84d50 2024-09-12T12:26:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.176+0000 7fbacd85f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571e7be73a0 con 0x5571e7c8ff30 2024-09-12T12:26:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.177+0000 7fbac3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c92320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.177+0000 7fbac3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c8f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.177+0000 7fbac8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7c85130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.177+0000 7fbac3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c92320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:56758/0 (socket says 172.21.15.38:56758) 2024-09-12T12:26:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.177+0000 7fbac8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7c85130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:47178/0 (socket says 172.21.15.38:47178) 2024-09-12T12:26:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.177+0000 7fbac3400640 1 -- 172.21.15.38:0/3998185556 learned_addr learned my addr 172.21.15.38:0/3998185556 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac0c00640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbaa80a2b80 0x7fbaa80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac0c00640 1 -- 172.21.15.38:0/1876930688 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fbab00ef6e0 con 0x7fbac41047e0 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac3400640 1 -- 172.21.15.38:0/3998185556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 msgr2=0x5571e7c85130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac3400640 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7c85130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac3400640 1 -- 172.21.15.38:0/3998185556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 msgr2=0x5571e7c8f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac3400640 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c8f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac3400640 1 -- 172.21.15.38:0/3998185556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e7bb1ae0 con 0x5571e7c8ff30 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac3e00640 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c8f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.178+0000 7fbac8c00640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbaa80a2b80 0x7fbaa80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.179+0000 7fbac3400640 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c92320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbab00ece30 tx=0x7fbab0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e80208761cb53f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.179+0000 7fbab9200640 1 -- 172.21.15.38:0/3998185556 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0049070 con 0x5571e7c8ff30 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.179+0000 7fbab9200640 1 -- 172.21.15.38:0/3998185556 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab00bbc40 con 0x5571e7c8ff30 2024-09-12T12:26:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.179+0000 7fbab9200640 1 -- 172.21.15.38:0/3998185556 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00b9f40 con 0x5571e7c8ff30 2024-09-12T12:26:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.179+0000 7fbac8c00640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbaa80a2b80 0x7fbaa80a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbabc005fd0 tx=0x7fbabc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 -- 172.21.15.38:0/3998185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 msgr2=0x5571e7c92320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c92320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbab00ece30 tx=0x7fbab0009260 comp rx=0 tx=0).stop 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 -- 172.21.15.38:0/3998185556 shutdown_connections 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c92320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c8f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 --2- 172.21.15.38:0/3998185556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7c85130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 -- 172.21.15.38:0/3998185556 >> 172.21.15.38:0/3998185556 conn(0x5571e7c812e0 msgr2=0x5571e7c816c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 -- 172.21.15.38:0/3998185556 shutdown_connections 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.180+0000 7fbacd85f740 1 -- 172.21.15.38:0/3998185556 wait complete. 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.181+0000 7fbacd85f740 1 -- start start 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.181+0000 7fbacd85f740 1 Processor -- start 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c8ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c85670 0x5571e7c8d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c8d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbacd85f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5571e7c9b0d0 con 0x5571e7c84d50 2024-09-12T12:26:49.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbacd85f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5571e7ba60f0 con 0x5571e7c85670 2024-09-12T12:26:49.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbacd85f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571e7c9b250 con 0x5571e7c8ff30 2024-09-12T12:26:49.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbacd85f740 10 client.0 _ll_register_callbacks cb 0x5571e7b979e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:49.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.182+0000 7fbac3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c8ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c8d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c85670 0x5571e7c8d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c8d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:56768/0 (socket says 172.21.15.38:56768) 2024-09-12T12:26:49.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 -- 172.21.15.38:0/148648598 learned_addr learned my addr 172.21.15.38:0/148648598 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:49.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 -- 172.21.15.38:0/148648598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c85670 msgr2=0x5571e7c8d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c85670 0x5571e7c8d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 -- 172.21.15.38:0/148648598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 msgr2=0x5571e7c8ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c8ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac8c00640 1 -- 172.21.15.38:0/148648598 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e795c3c0 con 0x5571e7c8ff30 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.183+0000 7fbac3e00640 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c8ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbac8c00640 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c8d910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbabc010860 tx=0x7fbabc004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71b65806adc28243 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbaad600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbaad600640 1 -- 172.21.15.38:0/148648598 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0119c0 con 0x5571e7c8ff30 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab00bbc40 con 0x5571e7c8ff30 2024-09-12T12:26:49.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbaad600640 1 -- 172.21.15.38:0/148648598 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fbabc011b60 con 0x5571e7c8ff30 2024-09-12T12:26:49.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbaad600640 1 -- 172.21.15.38:0/148648598 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbabc030050 con 0x5571e7c8ff30 2024-09-12T12:26:49.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbacd85f740 10 client.25438 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:49.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.184+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5571e7ca6eb0 con 0x5571e7c8ff30 2024-09-12T12:26:49.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.185+0000 7fbaad600640 1 -- 172.21.15.38:0/148648598 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab00bbc40 con 0x5571e7c8ff30 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbaad600640 1 -- 172.21.15.38:0/148648598 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fbabc01e3f0 con 0x5571e7c8ff30 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbacd85f740 10 client.25438 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbacd85f740 10 client.25438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbacd85f740 20 client.25438 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbacd85f740 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7ca82c0 0x5571e7caa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbacd85f740 4 client.25438 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571e7bf8950 con 0x5571e7ca82c0 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.186+0000 7fbac3e00640 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7ca82c0 0x5571e7caa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.187+0000 7fbac3e00640 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7ca82c0 0x5571e7caa6b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d163f5a0adb2691 server_cookie=ab631e81c345d2ec in_seq=0 out_seq=0 2024-09-12T12:26:49.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.187+0000 7fbaad600640 10 client.25438 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:49.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbaad600640 1 -- 172.21.15.38:0/148648598 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571e7bf8950 con 0x5571e7ca82c0 2024-09-12T12:26:49.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbaad600640 10 client.25438 handle_command_reply: tid=0 2024-09-12T12:26:49.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 client.25438 shutdown 2024-09-12T12:26:49.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 msgr2=0x5571e7c8d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c8d910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbabc010860 tx=0x7fbabc004ab0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 shutdown_connections 2024-09-12T12:26:49.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7ca82c0 0x5571e7caa6b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c8d910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c85670 0x5571e7c8d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 --2- 172.21.15.38:0/148648598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c8ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 >> 172.21.15.38:0/148648598 conn(0x5571e7c812e0 msgr2=0x5571e7c87010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:49.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbaad600640 0 client.25438 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:49.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.188+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 shutdown_connections 2024-09-12T12:26:49.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.189+0000 7fbacd85f740 1 -- 172.21.15.38:0/148648598 wait complete. 2024-09-12T12:26:49.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.189+0000 7fbacd85f740 20 client.25438 trim_cache size 0 max 16384 2024-09-12T12:26:49.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.224+0000 7fbacd85f740 1 Processor -- start 2024-09-12T12:26:49.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.224+0000 7fbacd85f740 1 -- start start 2024-09-12T12:26:49.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c85670 0x5571e7c86f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c8ff30 0x5571e7caff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbacd85f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41ac9d0 con 0x5571e7c84d50 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbacd85f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41ae510 con 0x5571e7c8ff30 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbacd85f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41ad0a0 con 0x5571e7c85670 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbac8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c8ff30 0x5571e7caff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbac3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbac8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c8ff30 0x5571e7caff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:47198/0 (socket says 172.21.15.38:47198) 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.225+0000 7fbac8c00640 1 -- 172.21.15.38:0/64477446 learned_addr learned my addr 172.21.15.38:0/64477446 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:49.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.226+0000 7fbac3400640 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c85670 0x5571e7c86f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.226+0000 7fbac8c00640 1 -- 172.21.15.38:0/64477446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c85670 msgr2=0x5571e7c86f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:49.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.226+0000 7fbac8c00640 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c85670 0x5571e7c86f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.226+0000 7fbac8c00640 1 -- 172.21.15.38:0/64477446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 msgr2=0x5571e7c818f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:49.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.226+0000 7fbac8c00640 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c818f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.226+0000 7fbac8c00640 1 -- 172.21.15.38:0/64477446 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e7c8be40 con 0x5571e7c8ff30 2024-09-12T12:26:49.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.226+0000 7fbac3e00640 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:49.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.227+0000 7fbac8c00640 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c8ff30 0x5571e7caff00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbabc013fd0 tx=0x7fbabc005d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42886b300a49d6b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:49.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.227+0000 7fbaafe00640 1 -- 172.21.15.38:0/64477446 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc011810 con 0x5571e7c8ff30 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.227+0000 7fbaafe00640 1 -- 172.21.15.38:0/64477446 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbabc022070 con 0x5571e7c8ff30 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.227+0000 7fbaafe00640 1 -- 172.21.15.38:0/64477446 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc027c50 con 0x5571e7c8ff30 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 -- 172.21.15.38:0/64477446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c8ff30 msgr2=0x5571e7caff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c8ff30 0x5571e7caff00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbabc013fd0 tx=0x7fbabc005d00 comp rx=0 tx=0).stop 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 -- 172.21.15.38:0/64477446 shutdown_connections 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c8ff30 0x5571e7caff00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c85670 0x5571e7c86f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 --2- 172.21.15.38:0/64477446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c84d50 0x5571e7c818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 -- 172.21.15.38:0/64477446 >> 172.21.15.38:0/64477446 conn(0x5571e7c812e0 msgr2=0x5571e7c867f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:49.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 -- 172.21.15.38:0/64477446 shutdown_connections 2024-09-12T12:26:49.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.228+0000 7fbacd85f740 1 -- 172.21.15.38:0/64477446 wait complete. 2024-09-12T12:26:49.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.229+0000 7fbacd85f740 1 -- start start 2024-09-12T12:26:49.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.229+0000 7fbacd85f740 1 Processor -- start 2024-09-12T12:26:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7ca0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c9bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbacd85f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c9c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbacd85f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41ade40 con 0x5571e7c85670 2024-09-12T12:26:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbacd85f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41ad770 con 0x5571e7c84d50 2024-09-12T12:26:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbacd85f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41aa9d0 con 0x5571e7c8ff30 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbacd85f740 10 client.0 _ll_register_callbacks cb 0x7fbabc013290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbac3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7ca0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbac3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7ca0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:47206/0 (socket says 172.21.15.38:47206) 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbac3e00640 1 -- 172.21.15.38:0/1536047486 learned_addr learned my addr 172.21.15.38:0/1536047486 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbac3e00640 1 -- 172.21.15.38:0/1536047486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 msgr2=0x5571e7c9c420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.230+0000 7fbac3e00640 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c9c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.231+0000 7fbac3e00640 1 -- 172.21.15.38:0/1536047486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 msgr2=0x5571e7c9bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.231+0000 7fbac3400640 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c9bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.231+0000 7fbac3e00640 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c9bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.231+0000 7fbac3e00640 1 -- 172.21.15.38:0/1536047486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e7c9cc20 con 0x5571e7c84d50 2024-09-12T12:26:49.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.231+0000 7fbac3400640 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c9bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.232+0000 7fbac3e00640 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7ca0bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009fd0 tx=0x7fbab40108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e4d5f39ba4251d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.232+0000 7fbaad600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.232+0000 7fbaad600640 1 -- 172.21.15.38:0/1536047486 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40035f0 con 0x5571e7c84d50 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.232+0000 7fbaad600640 1 -- 172.21.15.38:0/1536047486 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fbab4003790 con 0x5571e7c84d50 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.232+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbabc022070 con 0x5571e7c84d50 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.233+0000 7fbaad600640 1 -- 172.21.15.38:0/1536047486 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbab402f050 con 0x5571e7c84d50 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.233+0000 7fbacd85f740 10 client.25457 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:49.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.233+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5571e7d12f10 con 0x5571e7c84d50 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.233+0000 7fbaad600640 1 -- 172.21.15.38:0/1536047486 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbabc022070 con 0x5571e7c84d50 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.233+0000 7fbaad600640 1 -- 172.21.15.38:0/1536047486 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fbab401eab0 con 0x5571e7c84d50 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.234+0000 7fbacd85f740 10 client.25457 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.234+0000 7fbacd85f740 10 client.25457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.234+0000 7fbacd85f740 20 client.25457 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.234+0000 7fbacd85f740 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7d13690 0x5571e7d15ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.234+0000 7fbacd85f740 4 client.25457 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.234+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5571e7bf2e60 con 0x5571e7d13690 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.234+0000 7fbac3400640 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7d13690 0x5571e7d15ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbac3400640 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7d13690 0x5571e7d15ad0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29030f2beba69416 server_cookie=8c03a825581c2681 in_seq=0 out_seq=0 2024-09-12T12:26:49.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbaad600640 10 client.25457 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbaad600640 1 -- 172.21.15.38:0/1536047486 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5571e7bf2e60 con 0x5571e7d13690 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbaad600640 10 client.25457 handle_command_reply: tid=0 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 client.25457 shutdown 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 msgr2=0x5571e7ca0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7ca0bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009fd0 tx=0x7fbab40108c0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 shutdown_connections 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5571e7d13690 0x5571e7d15ad0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571e7c8ff30 0x5571e7c9c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5571e7c85670 0x5571e7c9bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 --2- 172.21.15.38:0/1536047486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5571e7c84d50 0x5571e7ca0bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.235+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 >> 172.21.15.38:0/1536047486 conn(0x5571e7c812e0 msgr2=0x5571e7c8ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.236+0000 7fbaad600640 0 client.25457 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:26:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.236+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 shutdown_connections 2024-09-12T12:26:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.236+0000 7fbacd85f740 1 -- 172.21.15.38:0/1536047486 wait complete. 2024-09-12T12:26:49.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.236+0000 7fbacd85f740 20 client.25457 trim_cache size 0 max 16384 2024-09-12T12:26:49.239 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:26:49.239 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-12T12:26:49.239 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2024-09-12T12:26:49.240 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:26:49.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.237+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbaa80a2b80 msgr2=0x7fbaa80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.237+0000 7fbac9600640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbaa80a2b80 0x7fbaa80a5040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbabc005fd0 tx=0x7fbabc004a40 comp rx=0 tx=0).stop 2024-09-12T12:26:49.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.237+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 msgr2=0x7fbac419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.237+0000 7fbac9600640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac419aa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbab0004770 tx=0x7fbab0003c10 comp rx=0 tx=0).stop 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 shutdown_connections 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fbaa80a2b80 0x7fbaa80a5040 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbac4108f60 0x7fbac419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac41047e0 0x7fbac419aa50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 --2- 172.21.15.38:0/1876930688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbac4103e30 0x7fbac419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 >> 172.21.15.38:0/1876930688 conn(0x7fbac40ff910 msgr2=0x7fbac4100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 shutdown_connections 2024-09-12T12:26:49.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:49.238+0000 7fbac9600640 1 -- 172.21.15.38:0/1876930688 wait complete. 2024-09-12T12:26:49.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:49 smithi038 ceph-mon[30810]: pgmap v420: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:50.062 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:26:50.062 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:26:50.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:49 smithi154 ceph-mon[35578]: pgmap v420: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:50.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:49 smithi071 ceph-mon[34859]: pgmap v420: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:50.510 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.189+0000 7f2088a00640 1 -- 172.21.15.38:0/3483539652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20841079c0 msgr2=0x7f2084107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 --2- 172.21.15.38:0/3483539652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20841079c0 0x7f2084107da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2074009900 tx=0x7f207402a410 comp rx=0 tx=0).stop 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 -- 172.21.15.38:0/3483539652 shutdown_connections 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 --2- 172.21.15.38:0/3483539652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2084102360 0x7f208410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 --2- 172.21.15.38:0/3483539652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20841019c0 0x7f2084101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 --2- 172.21.15.38:0/3483539652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20841079c0 0x7f2084107da0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 -- 172.21.15.38:0/3483539652 >> 172.21.15.38:0/3483539652 conn(0x7f20840fd740 msgr2=0x7f20840ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 -- 172.21.15.38:0/3483539652 shutdown_connections 2024-09-12T12:26:51.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.190+0000 7f2088a00640 1 -- 172.21.15.38:0/3483539652 wait complete. 2024-09-12T12:26:51.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.191+0000 7f2088a00640 1 Processor -- start 2024-09-12T12:26:51.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.192+0000 7f2088a00640 1 -- start start 2024-09-12T12:26:51.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.192+0000 7f2088a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20841019c0 0x7f2084198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.192+0000 7f2088a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2084102360 0x7f20841987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.192+0000 7f2088a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20841079c0 0x7f208419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.192+0000 7f2088a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2084111e10 con 0x7f20841079c0 2024-09-12T12:26:51.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.192+0000 7f2088a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2084111c90 con 0x7f2084102360 2024-09-12T12:26:51.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.192+0000 7f2088a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2084111f90 con 0x7f20841019c0 2024-09-12T12:26:51.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.193+0000 7f2081e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2084102360 0x7f20841987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.193+0000 7f2083200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20841079c0 0x7f208419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.193+0000 7f2082800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20841019c0 0x7f2084198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.193+0000 7f2081e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2084102360 0x7f20841987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:47234/0 (socket says 172.21.15.38:47234) 2024-09-12T12:26:51.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.193+0000 7f2081e00640 1 -- 172.21.15.38:0/3998223634 learned_addr learned my addr 172.21.15.38:0/3998223634 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:51.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2083200640 1 -- 172.21.15.38:0/3998223634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20841019c0 msgr2=0x7f2084198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2083200640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20841019c0 0x7f2084198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2083200640 1 -- 172.21.15.38:0/3998223634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2084102360 msgr2=0x7f20841987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2083200640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2084102360 0x7f20841987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2083200640 1 -- 172.21.15.38:0/3998223634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208419d220 con 0x7f20841079c0 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2082800640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20841019c0 0x7f2084198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2081e00640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2084102360 0x7f20841987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.194+0000 7f2083200640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20841079c0 0x7f208419cb40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f207c00da10 tx=0x7f207c00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.195+0000 7f207b400640 1 -- 172.21.15.38:0/3998223634 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c00bd70 con 0x7f20841079c0 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.195+0000 7f207b400640 1 -- 172.21.15.38:0/3998223634 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f207c003e50 con 0x7f20841079c0 2024-09-12T12:26:51.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.195+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208419d510 con 0x7f20841079c0 2024-09-12T12:26:51.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.195+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20841a4df0 con 0x7f20841079c0 2024-09-12T12:26:51.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.195+0000 7f207b400640 1 -- 172.21.15.38:0/3998223634 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0106a0 con 0x7f20841079c0 2024-09-12T12:26:51.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.197+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2064005290 con 0x7f20841079c0 2024-09-12T12:26:51.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.201+0000 7f207b400640 1 -- 172.21.15.38:0/3998223634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f207c003970 con 0x7f20841079c0 2024-09-12T12:26:51.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.203+0000 7f207b400640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f20680a2d50 0x7f20680a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.203+0000 7f207b400640 1 -- 172.21.15.38:0/3998223634 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f207c0cf830 con 0x7f20841079c0 2024-09-12T12:26:51.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.204+0000 7f2082800640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f20680a2d50 0x7f20680a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.206+0000 7f2082800640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f20680a2d50 0x7f20680a5210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2074000c00 tx=0x7f2074005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:51.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.208+0000 7f207b400640 1 -- 172.21.15.38:0/3998223634 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f207c09c480 con 0x7f20841079c0 2024-09-12T12:26:51.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.657+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2064005580 con 0x7f20841079c0 2024-09-12T12:26:51.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.658+0000 7f207b400640 1 -- 172.21.15.38:0/3998223634 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7f207c09bd80 con 0x7f20841079c0 2024-09-12T12:26:51.659 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:26:51.659 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:26:51.659 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:26:51.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f20680a2d50 msgr2=0x7f20680a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f20680a2d50 0x7f20680a5210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2074000c00 tx=0x7f2074005b50 comp rx=0 tx=0).stop 2024-09-12T12:26:51.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20841079c0 msgr2=0x7f208419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20841079c0 0x7f208419cb40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f207c00da10 tx=0x7f207c00ded0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 shutdown_connections 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f20680a2d50 0x7f20680a5210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20841079c0 0x7f208419cb40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2084102360 0x7f20841987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 --2- 172.21.15.38:0/3998223634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20841019c0 0x7f2084198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.661+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 >> 172.21.15.38:0/3998223634 conn(0x7f20840fd740 msgr2=0x7f20840fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.662+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 shutdown_connections 2024-09-12T12:26:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:51.662+0000 7f2088a00640 1 -- 172.21.15.38:0/3998223634 wait complete. 2024-09-12T12:26:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:51 smithi038 ceph-mon[30810]: pgmap v421: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:51.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:51 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3998223634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:52.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:51 smithi154 ceph-mon[35578]: pgmap v421: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:52.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:51 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3998223634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:51 smithi071 ceph-mon[34859]: pgmap v421: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:52.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:51 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3998223634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:54.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:53 smithi154 ceph-mon[35578]: pgmap v422: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-09-12T12:26:54.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:53 smithi038 ceph-mon[30810]: pgmap v422: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-09-12T12:26:54.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:53 smithi071 ceph-mon[34859]: pgmap v422: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-09-12T12:26:56.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:55 smithi154 ceph-mon[35578]: pgmap v423: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-12T12:26:56.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:55 smithi038 ceph-mon[30810]: pgmap v423: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-12T12:26:56.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:55 smithi071 ceph-mon[34859]: pgmap v423: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-12T12:26:56.606 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T12:26:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.696+0000 7f9f7d200640 1 -- 172.21.15.38:0/1232867152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78108f60 msgr2=0x7f9f78110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.696+0000 7f9f7d200640 1 --2- 172.21.15.38:0/1232867152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78108f60 0x7f9f78110ae0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009ca0 tx=0x7f9f7002a8b0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.697+0000 7f9f7d200640 1 -- 172.21.15.38:0/1232867152 shutdown_connections 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.697+0000 7f9f7d200640 1 --2- 172.21.15.38:0/1232867152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78108f60 0x7f9f78110ae0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.697+0000 7f9f7d200640 1 --2- 172.21.15.38:0/1232867152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f781047e0 0x7f9f78108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.697+0000 7f9f7d200640 1 --2- 172.21.15.38:0/1232867152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f78103e30 0x7f9f78104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.697+0000 7f9f7d200640 1 -- 172.21.15.38:0/1232867152 >> 172.21.15.38:0/1232867152 conn(0x7f9f780ff910 msgr2=0x7f9f78101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.697+0000 7f9f7d200640 1 -- 172.21.15.38:0/1232867152 shutdown_connections 2024-09-12T12:26:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.697+0000 7f9f7d200640 1 -- 172.21.15.38:0/1232867152 wait complete. 2024-09-12T12:26:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.699+0000 7f9f7d200640 1 Processor -- start 2024-09-12T12:26:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.699+0000 7f9f7d200640 1 -- start start 2024-09-12T12:26:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f7d200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78103e30 0x7f9f7819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f7d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f781047e0 0x7f9f7819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f7d200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f78108f60 0x7f9f7819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f7d200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78114010 con 0x7f9f78103e30 2024-09-12T12:26:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f7d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78113e90 con 0x7f9f781047e0 2024-09-12T12:26:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f7d200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78114190 con 0x7f9f78108f60 2024-09-12T12:26:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f781047e0 0x7f9f7819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f77400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78103e30 0x7f9f7819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f77400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78103e30 0x7f9f7819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45220/0 (socket says 172.21.15.38:45220) 2024-09-12T12:26:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f77400640 1 -- 172.21.15.38:0/2885825125 learned_addr learned my addr 172.21.15.38:0/2885825125 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:57.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f77e00640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f78108f60 0x7f9f7819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.700+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f781047e0 0x7f9f7819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57304/0 (socket says 172.21.15.38:57304) 2024-09-12T12:26:57.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.701+0000 7f9f77e00640 1 -- 172.21.15.38:0/2885825125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f781047e0 msgr2=0x7f9f7819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.701+0000 7f9f77e00640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f781047e0 0x7f9f7819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.701+0000 7f9f77e00640 1 -- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78103e30 msgr2=0x7f9f7819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.701+0000 7f9f77e00640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78103e30 0x7f9f7819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.701+0000 7f9f77e00640 1 -- 172.21.15.38:0/2885825125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7819f4c0 con 0x7f9f78108f60 2024-09-12T12:26:57.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.701+0000 7f9f77400640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78103e30 0x7f9f7819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:57.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.701+0000 7f9f77e00640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f78108f60 0x7f9f7819ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f70005e30 tx=0x7f9f70003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.702+0000 7f9f6fe00640 1 -- 172.21.15.38:0/2885825125 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70030dc0 con 0x7f9f78108f60 2024-09-12T12:26:57.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.702+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7819f750 con 0x7f9f78108f60 2024-09-12T12:26:57.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.702+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f781a7090 con 0x7f9f78108f60 2024-09-12T12:26:57.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.703+0000 7f9f6fe00640 1 -- 172.21.15.38:0/2885825125 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f70040070 con 0x7f9f78108f60 2024-09-12T12:26:57.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.703+0000 7f9f6fe00640 1 -- 172.21.15.38:0/2885825125 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f700457f0 con 0x7f9f78108f60 2024-09-12T12:26:57.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.707+0000 7f9f81259740 1 Processor -- start 2024-09-12T12:26:57.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f6fe00640 1 -- 172.21.15.38:0/2885825125 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9f70045990 con 0x7f9f78108f60 2024-09-12T12:26:57.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f81259740 1 -- start start 2024-09-12T12:26:57.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f81259740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e578220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f81259740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e582ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f81259740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e585410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f81259740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d41e4de3e0 con 0x55d41e583020 2024-09-12T12:26:57.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f81259740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d41e485d80 con 0x55d41e577e40 2024-09-12T12:26:57.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.708+0000 7f9f81259740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d41e4da3a0 con 0x55d41e578760 2024-09-12T12:26:57.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.709+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e578220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.709+0000 7f9f77400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e582ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.709+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e578220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57316/0 (socket says 172.21.15.38:57316) 2024-09-12T12:26:57.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.710+0000 7f9f76a00640 1 -- 172.21.15.38:0/2317978941 learned_addr learned my addr 172.21.15.38:0/2317978941 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:57.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.710+0000 7f9f6fe00640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9f5c0a2c00 0x7f9f5c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.710+0000 7f9f76a00640 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e585410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.710+0000 7f9f6fe00640 1 -- 172.21.15.38:0/2885825125 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f9f700f07b0 con 0x7f9f78108f60 2024-09-12T12:26:57.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.711+0000 7f9f77e00640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9f5c0a2c00 0x7f9f5c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.711+0000 7f9f77400640 1 -- 172.21.15.38:0/2317978941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 msgr2=0x55d41e578220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.711+0000 7f9f77400640 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e578220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.711+0000 7f9f77400640 1 -- 172.21.15.38:0/2317978941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 msgr2=0x55d41e585410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.712+0000 7f9f77400640 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e585410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.712+0000 7f9f77400640 1 -- 172.21.15.38:0/2317978941 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41e4a4ae0 con 0x55d41e578760 2024-09-12T12:26:57.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.712+0000 7f9f76a00640 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e585410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:57.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.712+0000 7f9f77e00640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9f5c0a2c00 0x7f9f5c0a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f700b90f0 tx=0x7f9f7002a8b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.713+0000 7f9f77400640 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e582ae0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f68011510 tx=0x7f9f680119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceb264a009125ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.713+0000 7f9f6cc00640 1 -- 172.21.15.38:0/2317978941 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68005020 con 0x55d41e578760 2024-09-12T12:26:57.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.713+0000 7f9f6cc00640 1 -- 172.21.15.38:0/2317978941 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f680047a0 con 0x55d41e578760 2024-09-12T12:26:57.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.713+0000 7f9f6cc00640 1 -- 172.21.15.38:0/2317978941 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800f9f0 con 0x55d41e578760 2024-09-12T12:26:57.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.714+0000 7f9f81259740 1 -- 172.21.15.38:0/2317978941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 msgr2=0x55d41e582ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.714+0000 7f9f81259740 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e582ae0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f68011510 tx=0x7f9f680119d0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.714+0000 7f9f81259740 1 -- 172.21.15.38:0/2317978941 shutdown_connections 2024-09-12T12:26:57.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.714+0000 7f9f81259740 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e585410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.714+0000 7f9f81259740 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e582ae0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.714+0000 7f9f81259740 1 --2- 172.21.15.38:0/2317978941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e578220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.714+0000 7f9f81259740 1 -- 172.21.15.38:0/2317978941 >> 172.21.15.38:0/2317978941 conn(0x55d41e5743d0 msgr2=0x55d41e5747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.715+0000 7f9f81259740 1 -- 172.21.15.38:0/2317978941 shutdown_connections 2024-09-12T12:26:57.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.715+0000 7f9f81259740 1 -- 172.21.15.38:0/2317978941 wait complete. 2024-09-12T12:26:57.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.715+0000 7f9f81259740 1 -- start start 2024-09-12T12:26:57.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.716+0000 7f9f81259740 1 Processor -- start 2024-09-12T12:26:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.716+0000 7f9f81259740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e577e40 0x55d41e57fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.716+0000 7f9f81259740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e580370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.716+0000 7f9f81259740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e583020 0x55d41e5808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.716+0000 7f9f81259740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d41e585bf0 con 0x55d41e577e40 2024-09-12T12:26:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.716+0000 7f9f81259740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d41e4990f0 con 0x55d41e583020 2024-09-12T12:26:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.716+0000 7f9f81259740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d41e585d70 con 0x55d41e578760 2024-09-12T12:26:57.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f81259740 10 client.0 _ll_register_callbacks cb 0x55d41e480bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:57.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f77400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e580370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f77400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e580370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:47756/0 (socket says 172.21.15.38:47756) 2024-09-12T12:26:57.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f77400640 1 -- 172.21.15.38:0/2146525226 learned_addr learned my addr 172.21.15.38:0/2146525226 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:57.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f76a00640 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e577e40 0x55d41e57fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f77400640 1 -- 172.21.15.38:0/2146525226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e583020 msgr2=0x55d41e5808b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f77400640 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e583020 0x55d41e5808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.717+0000 7f9f77400640 1 -- 172.21.15.38:0/2146525226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e577e40 msgr2=0x55d41e57fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.718+0000 7f9f77400640 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e577e40 0x55d41e57fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.718+0000 7f9f77400640 1 -- 172.21.15.38:0/2146525226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41e24f3c0 con 0x55d41e578760 2024-09-12T12:26:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.718+0000 7f9f76a00640 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e577e40 0x55d41e57fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.718+0000 7f9f77400640 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e580370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800a010 tx=0x7f9f68004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a333a9289c8a4d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.718+0000 7f9f61600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:26:57.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.719+0000 7f9f61600640 1 -- 172.21.15.38:0/2146525226 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68027070 con 0x55d41e578760 2024-09-12T12:26:57.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.719+0000 7f9f61600640 1 -- 172.21.15.38:0/2146525226 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f9f68004f80 con 0x55d41e578760 2024-09-12T12:26:57.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.719+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f680047a0 con 0x55d41e578760 2024-09-12T12:26:57.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.719+0000 7f9f61600640 1 -- 172.21.15.38:0/2146525226 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9f68033050 con 0x55d41e578760 2024-09-12T12:26:57.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.719+0000 7f9f81259740 10 client.25459 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:57.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.719+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d41e59a3f0 con 0x55d41e578760 2024-09-12T12:26:57.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f61600640 1 -- 172.21.15.38:0/2146525226 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f680047a0 con 0x55d41e578760 2024-09-12T12:26:57.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f61600640 1 -- 172.21.15.38:0/2146525226 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f9f680035f0 con 0x55d41e578760 2024-09-12T12:26:57.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f81259740 10 client.25459 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:57.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f81259740 10 client.25459 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:26:57.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f81259740 20 client.25459 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:57.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f81259740 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e59b7a0 0x55d41e59db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f81259740 4 client.25459 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:57.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.720+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d41e4eb950 con 0x55d41e59b7a0 2024-09-12T12:26:57.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.721+0000 7f9f76a00640 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e59b7a0 0x55d41e59db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.721+0000 7f9f76a00640 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e59b7a0 0x55d41e59db90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4e779b33e2ffd01e server_cookie=6269c10410588459 in_seq=0 out_seq=0 2024-09-12T12:26:57.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.721+0000 7f9f61600640 10 client.25459 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:57.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.722+0000 7f9f61600640 1 -- 172.21.15.38:0/2146525226 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d41e4eb950 con 0x55d41e59b7a0 2024-09-12T12:26:57.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.722+0000 7f9f61600640 10 client.25459 handle_command_reply: tid=0 2024-09-12T12:26:57.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.722+0000 7f9f81259740 1 client.25459 shutdown 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.722+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 msgr2=0x55d41e580370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.722+0000 7f9f81259740 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e580370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800a010 tx=0x7f9f68004270 comp rx=0 tx=0).stop 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 shutdown_connections 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e59b7a0 0x55d41e59db90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e583020 0x55d41e5808b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e580370 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 --2- 172.21.15.38:0/2146525226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e577e40 0x55d41e57fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 >> 172.21.15.38:0/2146525226 conn(0x55d41e5743d0 msgr2=0x55d41e57a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f61600640 0 client.25459 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 shutdown_connections 2024-09-12T12:26:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.723+0000 7f9f81259740 1 -- 172.21.15.38:0/2146525226 wait complete. 2024-09-12T12:26:57.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.724+0000 7f9f81259740 20 client.25459 trim_cache size 0 max 16384 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.737+0000 7f9f81259740 1 Processor -- start 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f81259740 1 -- start start 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f81259740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e577e40 0x55d41e5a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f81259740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e578760 0x55d41e5a3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f81259740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e57fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f81259740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5800fc20 con 0x55d41e583020 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f81259740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f58011760 con 0x55d41e578760 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f81259740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f580102f0 con 0x55d41e577e40 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e577e40 0x55d41e5a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.738+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e57fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e578760 0x55d41e5a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e578760 0x55d41e5a3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57344/0 (socket says 172.21.15.38:57344) 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 -- 172.21.15.38:0/1411791575 learned_addr learned my addr 172.21.15.38:0/1411791575 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 -- 172.21.15.38:0/1411791575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e577e40 msgr2=0x55d41e5a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e577e40 0x55d41e5a33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 -- 172.21.15.38:0/1411791575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 msgr2=0x55d41e57fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e57fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f77400640 1 -- 172.21.15.38:0/1411791575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41e574200 con 0x55d41e578760 2024-09-12T12:26:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.739+0000 7f9f76a00640 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e57fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.740+0000 7f9f77400640 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e578760 0x55d41e5a3930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9f680039f0 tx=0x7f9f680042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61ab0e62c4092a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.740+0000 7f9f63e00640 1 -- 172.21.15.38:0/1411791575 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6803c070 con 0x55d41e578760 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.740+0000 7f9f63e00640 1 -- 172.21.15.38:0/1411791575 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f68030030 con 0x55d41e578760 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.740+0000 7f9f63e00640 1 -- 172.21.15.38:0/1411791575 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68027070 con 0x55d41e578760 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 -- 172.21.15.38:0/1411791575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e578760 msgr2=0x55d41e5a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e578760 0x55d41e5a3930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9f680039f0 tx=0x7f9f680042e0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 -- 172.21.15.38:0/1411791575 shutdown_connections 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e57fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e578760 0x55d41e5a3930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 --2- 172.21.15.38:0/1411791575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e577e40 0x55d41e5a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 -- 172.21.15.38:0/1411791575 >> 172.21.15.38:0/1411791575 conn(0x55d41e5743d0 msgr2=0x55d41e57ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 -- 172.21.15.38:0/1411791575 shutdown_connections 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.741+0000 7f9f81259740 1 -- 172.21.15.38:0/1411791575 wait complete. 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.742+0000 7f9f81259740 1 -- start start 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.742+0000 7f9f81259740 1 Processor -- start 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.742+0000 7f9f81259740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e57c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.742+0000 7f9f81259740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e57cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f81259740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e5928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f81259740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f58011090 con 0x55d41e583020 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f81259740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9f580109c0 con 0x55d41e577e40 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f81259740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5800dc00 con 0x55d41e578760 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f81259740 10 client.0 _ll_register_callbacks cb 0x7f9f64009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e57c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f76a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e57c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57350/0 (socket says 172.21.15.38:57350) 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f76a00640 1 -- 172.21.15.38:0/3507468835 learned_addr learned my addr 172.21.15.38:0/3507468835 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f77400640 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e57cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.743+0000 7f9f76a00640 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e5928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.744+0000 7f9f76a00640 1 -- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 msgr2=0x55d41e57cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.744+0000 7f9f76a00640 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e57cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.744+0000 7f9f76a00640 1 -- 172.21.15.38:0/3507468835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 msgr2=0x55d41e5928e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.744+0000 7f9f76a00640 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e5928e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.744+0000 7f9f76a00640 1 -- 172.21.15.38:0/3507468835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41e573c80 con 0x55d41e577e40 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.744+0000 7f9f76a00640 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e57c840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55d41e59e360 tx=0x7f9f64009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cdcb03865f991be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.744+0000 7f9f61600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.745+0000 7f9f61600640 1 -- 172.21.15.38:0/3507468835 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64020ba0 con 0x55d41e577e40 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.745+0000 7f9f61600640 1 -- 172.21.15.38:0/3507468835 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f9f6402b460 con 0x55d41e577e40 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.745+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f68030030 con 0x55d41e577e40 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.745+0000 7f9f61600640 1 -- 172.21.15.38:0/3507468835 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9f64036050 con 0x55d41e577e40 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.745+0000 7f9f81259740 10 client.25478 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.745+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d41e593fd0 con 0x55d41e577e40 2024-09-12T12:26:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f61600640 1 -- 172.21.15.38:0/3507468835 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f68030030 con 0x55d41e577e40 2024-09-12T12:26:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f61600640 1 -- 172.21.15.38:0/3507468835 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f9f640105f0 con 0x55d41e577e40 2024-09-12T12:26:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f81259740 10 client.25478 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f81259740 10 client.25478 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f81259740 20 client.25478 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f81259740 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e6063c0 0x55d41e6087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f81259740 4 client.25478 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.746+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d41e4e5e60 con 0x55d41e6063c0 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.747+0000 7f9f77400640 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e6063c0 0x55d41e6087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.747+0000 7f9f77400640 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e6063c0 0x55d41e6087b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5969ec3a8c819ab9 server_cookie=ef570557b6e7196e in_seq=0 out_seq=0 2024-09-12T12:26:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.747+0000 7f9f61600640 10 client.25478 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f61600640 1 -- 172.21.15.38:0/3507468835 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d41e4e5e60 con 0x55d41e6063c0 2024-09-12T12:26:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f61600640 10 client.25478 handle_command_reply: tid=0 2024-09-12T12:26:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 client.25478 shutdown 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 msgr2=0x55d41e57c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e57c840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55d41e59e360 tx=0x7f9f64009770 comp rx=0 tx=0).stop 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 shutdown_connections 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x55d41e6063c0 0x55d41e6087b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d41e583020 0x55d41e5928e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d41e578760 0x55d41e57cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 --2- 172.21.15.38:0/3507468835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d41e577e40 0x55d41e57c840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f61600640 0 client.25478 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.748+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 >> 172.21.15.38:0/3507468835 conn(0x55d41e5743d0 msgr2=0x55d41e581690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.749+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 shutdown_connections 2024-09-12T12:26:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.749+0000 7f9f81259740 1 -- 172.21.15.38:0/3507468835 wait complete. 2024-09-12T12:26:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.751+0000 7f9f81259740 20 client.25478 trim_cache size 0 max 16384 2024-09-12T12:26:57.751 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:26:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.751+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9f5c0a2c00 msgr2=0x7f9f5c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.751+0000 7f9f7d200640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9f5c0a2c00 0x7f9f5c0a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f700b90f0 tx=0x7f9f7002a8b0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f78108f60 msgr2=0x7f9f7819ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f78108f60 0x7f9f7819ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f70005e30 tx=0x7f9f70003f10 comp rx=0 tx=0).stop 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 shutdown_connections 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f9f5c0a2c00 0x7f9f5c0a50c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f78108f60 0x7f9f7819ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f781047e0 0x7f9f7819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 --2- 172.21.15.38:0/2885825125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f78103e30 0x7f9f7819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 >> 172.21.15.38:0/2885825125 conn(0x7f9f780ff910 msgr2=0x7f9f78101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 shutdown_connections 2024-09-12T12:26:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:57.752+0000 7f9f7d200640 1 -- 172.21.15.38:0/2885825125 wait complete. 2024-09-12T12:26:58.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:57 smithi154 ceph-mon[35578]: pgmap v424: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T12:26:58.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:57 smithi038 ceph-mon[30810]: pgmap v424: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T12:26:58.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:57 smithi071 ceph-mon[34859]: pgmap v424: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T12:26:58.666 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T12:26:59.066 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.884+0000 7f8b23e00640 1 -- 172.21.15.38:0/3930614094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c103ff0 msgr2=0x7f8b1c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.884+0000 7f8b23e00640 1 --2- 172.21.15.38:0/3930614094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c1043d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009900 tx=0x7f8b1002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.885+0000 7f8b23e00640 1 -- 172.21.15.38:0/3930614094 shutdown_connections 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.885+0000 7f8b23e00640 1 --2- 172.21.15.38:0/3930614094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1c109120 0x7f8b1c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.885+0000 7f8b23e00640 1 --2- 172.21.15.38:0/3930614094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c1049a0 0x7f8b1c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.885+0000 7f8b23e00640 1 --2- 172.21.15.38:0/3930614094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c1043d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.885+0000 7f8b23e00640 1 -- 172.21.15.38:0/3930614094 >> 172.21.15.38:0/3930614094 conn(0x7f8b1c0ffa90 msgr2=0x7f8b1c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.885+0000 7f8b23e00640 1 -- 172.21.15.38:0/3930614094 shutdown_connections 2024-09-12T12:26:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.885+0000 7f8b23e00640 1 -- 172.21.15.38:0/3930614094 wait complete. 2024-09-12T12:26:59.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.886+0000 7f8b23e00640 1 Processor -- start 2024-09-12T12:26:59.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.886+0000 7f8b23e00640 1 -- start start 2024-09-12T12:26:59.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1049a0 0x7f8b1c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1c109120 0x7f8b1c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b23e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c114140 con 0x7f8b1c1049a0 2024-09-12T12:26:59.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b23e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c113fc0 con 0x7f8b1c109120 2024-09-12T12:26:59.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b23e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1142c0 con 0x7f8b1c103ff0 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b21400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1049a0 0x7f8b1c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b21400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:47792/0 (socket says 172.21.15.38:47792) 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.887+0000 7f8b21400640 1 -- 172.21.15.38:0/1437612809 learned_addr learned my addr 172.21.15.38:0/1437612809 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b21e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1c109120 0x7f8b1c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b21400640 1 -- 172.21.15.38:0/1437612809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1c109120 msgr2=0x7f8b1c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b21400640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1c109120 0x7f8b1c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b21400640 1 -- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1049a0 msgr2=0x7f8b1c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b21400640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1049a0 0x7f8b1c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b21400640 1 -- 172.21.15.38:0/1437612809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c19f5b0 con 0x7f8b1c103ff0 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b20a00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1049a0 0x7f8b1c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:59.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.888+0000 7f8b21400640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c19a600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006010 tx=0x7f8b10004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.889+0000 7f8b1a000640 1 -- 172.21.15.38:0/1437612809 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1003f030 con 0x7f8b1c103ff0 2024-09-12T12:26:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.889+0000 7f8b1a000640 1 -- 172.21.15.38:0/1437612809 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b10004440 con 0x7f8b1c103ff0 2024-09-12T12:26:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.889+0000 7f8b1a000640 1 -- 172.21.15.38:0/1437612809 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10035070 con 0x7f8b1c103ff0 2024-09-12T12:26:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.889+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c19f840 con 0x7f8b1c103ff0 2024-09-12T12:26:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.889+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c19fcd0 con 0x7f8b1c103ff0 2024-09-12T12:26:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.892+0000 7f8b267fb740 1 Processor -- start 2024-09-12T12:26:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.892+0000 7f8b267fb740 1 -- start start 2024-09-12T12:26:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c908050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c912910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c912e50 0x559e8c915240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b267fb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559e8c86e3e0 con 0x559e8c912e50 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b267fb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e8c815d80 con 0x559e8c907c70 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b267fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e8c86a3a0 con 0x559e8c908590 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c912e50 0x559e8c915240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b21e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c908050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c912e50 0x559e8c915240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45286/0 (socket says 172.21.15.38:45286) 2024-09-12T12:26:59.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.893+0000 7f8b20a00640 1 -- 172.21.15.38:0/2136899481 learned_addr learned my addr 172.21.15.38:0/2136899481 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b20a00640 1 -- 172.21.15.38:0/2136899481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 msgr2=0x559e8c912910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b20a00640 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c912910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b20a00640 1 -- 172.21.15.38:0/2136899481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 msgr2=0x559e8c908050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b20a00640 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c908050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b20a00640 1 -- 172.21.15.38:0/2136899481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8c834ae0 con 0x559e8c912e50 2024-09-12T12:26:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b21e00640 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c908050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b20a00640 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c912e50 0x559e8c915240 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b080114f0 tx=0x7f8b080119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387f8eab9ae1bd53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.894+0000 7f8b0e600640 1 -- 172.21.15.38:0/2136899481 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08004020 con 0x559e8c912e50 2024-09-12T12:26:59.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.895+0000 7f8b0e600640 1 -- 172.21.15.38:0/2136899481 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b080041c0 con 0x559e8c912e50 2024-09-12T12:26:59.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.895+0000 7f8b0e600640 1 -- 172.21.15.38:0/2136899481 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800f980 con 0x559e8c912e50 2024-09-12T12:26:59.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.895+0000 7f8b1a000640 1 -- 172.21.15.38:0/1437612809 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8b10042030 con 0x7f8b1c103ff0 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 -- 172.21.15.38:0/2136899481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c912e50 msgr2=0x559e8c915240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c912e50 0x559e8c915240 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b080114f0 tx=0x7f8b080119b0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 -- 172.21.15.38:0/2136899481 shutdown_connections 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c912e50 0x559e8c915240 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c912910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2136899481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c908050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 -- 172.21.15.38:0/2136899481 >> 172.21.15.38:0/2136899481 conn(0x559e8c904200 msgr2=0x559e8c9045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 -- 172.21.15.38:0/2136899481 shutdown_connections 2024-09-12T12:26:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.896+0000 7f8b267fb740 1 -- 172.21.15.38:0/2136899481 wait complete. 2024-09-12T12:26:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.897+0000 7f8b267fb740 1 -- start start 2024-09-12T12:26:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.897+0000 7f8b267fb740 1 Processor -- start 2024-09-12T12:26:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.897+0000 7f8b1a000640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8b040a2b10 0x7f8b040a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b1a000640 1 -- 172.21.15.38:0/1437612809 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f8b100ef730 con 0x7f8b1c103ff0 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c90fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c910290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c9107d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b267fb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559e8c915a20 con 0x559e8c908590 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b267fb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e8c8290f0 con 0x559e8c907c70 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b267fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e8c915ba0 con 0x559e8c912e50 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b267fb740 10 client.0 _ll_register_callbacks cb 0x559e8c810bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b21e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8b040a2b10 0x7f8b040a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.898+0000 7f8b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c910290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c9107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c910290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45298/0 (socket says 172.21.15.38:45298) 2024-09-12T12:26:59.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c9107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:47808/0 (socket says 172.21.15.38:47808) 2024-09-12T12:26:59.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b20a00640 1 -- 172.21.15.38:0/1181474699 learned_addr learned my addr 172.21.15.38:0/1181474699 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21400640 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c90fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21400640 1 -- 172.21.15.38:0/1181474699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 msgr2=0x559e8c9107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21400640 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c9107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21400640 1 -- 172.21.15.38:0/1181474699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 msgr2=0x559e8c910290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21400640 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c910290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.899+0000 7f8b21400640 1 -- 172.21.15.38:0/1181474699 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8c5df3c0 con 0x559e8c907c70 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b21400640 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c90fd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b100ecdf0 tx=0x7f8b100bb780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf92e8cccdc5b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b02a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b02a00640 1 -- 172.21.15.38:0/1181474699 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b100bbc40 con 0x559e8c907c70 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b21e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8b040a2b10 0x7f8b040a4fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b14005fd0 tx=0x7f8b14011440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b02a00640 1 -- 172.21.15.38:0/1181474699 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f8b100ef400 con 0x559e8c907c70 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b080041c0 con 0x559e8c907c70 2024-09-12T12:26:59.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b02a00640 1 -- 172.21.15.38:0/1181474699 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8b100bfff0 con 0x559e8c907c70 2024-09-12T12:26:59.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b267fb740 10 client.25490 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:59.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.900+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559e8c92a280 con 0x559e8c907c70 2024-09-12T12:26:59.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b02a00640 1 -- 172.21.15.38:0/1181474699 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b080041c0 con 0x559e8c907c70 2024-09-12T12:26:59.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b02a00640 1 -- 172.21.15.38:0/1181474699 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f8b100c44b0 con 0x559e8c907c70 2024-09-12T12:26:59.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b267fb740 10 client.25490 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b267fb740 10 client.25490 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b267fb740 20 client.25490 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c92b670 0x559e8c92da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b267fb740 4 client.25490 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e8c87b950 con 0x559e8c92b670 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.901+0000 7f8b20a00640 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c92b670 0x559e8c92da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.902+0000 7f8b20a00640 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c92b670 0x559e8c92da60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=859049817154d87b server_cookie=f50a26fe06e70ce8 in_seq=0 out_seq=0 2024-09-12T12:26:59.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.902+0000 7f8b02a00640 10 client.25490 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b02a00640 1 -- 172.21.15.38:0/1181474699 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e8c87b950 con 0x559e8c92b670 2024-09-12T12:26:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b02a00640 10 client.25490 handle_command_reply: tid=0 2024-09-12T12:26:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 client.25490 shutdown 2024-09-12T12:26:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 msgr2=0x559e8c90fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c90fd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b100ecdf0 tx=0x7f8b100bb780 comp rx=0 tx=0).stop 2024-09-12T12:26:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 shutdown_connections 2024-09-12T12:26:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c92b670 0x559e8c92da60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c9107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c910290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1181474699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c90fd50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b02a00640 0 client.25490 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.903+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 >> 172.21.15.38:0/1181474699 conn(0x559e8c904200 msgr2=0x559e8c909ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.904+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 shutdown_connections 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.904+0000 7f8b267fb740 1 -- 172.21.15.38:0/1181474699 wait complete. 2024-09-12T12:26:59.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.904+0000 7f8b267fb740 20 client.25490 trim_cache size 0 max 16384 2024-09-12T12:26:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.918+0000 7f8b267fb740 1 Processor -- start 2024-09-12T12:26:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.918+0000 7f8b267fb740 1 -- start start 2024-09-12T12:26:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c907c70 0x559e8c903270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c9332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c912e50 0x559e8c933830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b267fb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1ac9e0 con 0x559e8c907c70 2024-09-12T12:26:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b267fb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1ae520 con 0x559e8c912e50 2024-09-12T12:26:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b267fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1ad0b0 con 0x559e8c908590 2024-09-12T12:26:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b21400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c907c70 0x559e8c903270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b21e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c912e50 0x559e8c933830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b21400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c907c70 0x559e8c903270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45310/0 (socket says 172.21.15.38:45310) 2024-09-12T12:26:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b21400640 1 -- 172.21.15.38:0/2991594393 learned_addr learned my addr 172.21.15.38:0/2991594393 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.919+0000 7f8b20a00640 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c9332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b21e00640 1 -- 172.21.15.38:0/2991594393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 msgr2=0x559e8c9332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b21e00640 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c9332f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b21e00640 1 -- 172.21.15.38:0/2991594393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c907c70 msgr2=0x559e8c903270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b21e00640 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c907c70 0x559e8c903270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b21e00640 1 -- 172.21.15.38:0/2991594393 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8c9083c0 con 0x559e8c912e50 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b21400640 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c907c70 0x559e8c903270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b20a00640 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c9332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.920+0000 7f8b21e00640 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c912e50 0x559e8c933830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400fc20 tx=0x7f8b14023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad2976a045d6cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.921+0000 7f8b0dc00640 1 -- 172.21.15.38:0/2991594393 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14026070 con 0x559e8c912e50 2024-09-12T12:26:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.921+0000 7f8b0dc00640 1 -- 172.21.15.38:0/2991594393 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1401b040 con 0x559e8c912e50 2024-09-12T12:26:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.921+0000 7f8b0dc00640 1 -- 172.21.15.38:0/2991594393 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1402a660 con 0x559e8c912e50 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 -- 172.21.15.38:0/2991594393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c912e50 msgr2=0x559e8c933830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c912e50 0x559e8c933830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400fc20 tx=0x7f8b14023000 comp rx=0 tx=0).stop 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 -- 172.21.15.38:0/2991594393 shutdown_connections 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c912e50 0x559e8c933830 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c908590 0x559e8c9332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 --2- 172.21.15.38:0/2991594393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c907c70 0x559e8c903270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 -- 172.21.15.38:0/2991594393 >> 172.21.15.38:0/2991594393 conn(0x559e8c904200 msgr2=0x559e8c902b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 -- 172.21.15.38:0/2991594393 shutdown_connections 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.922+0000 7f8b267fb740 1 -- 172.21.15.38:0/2991594393 wait complete. 2024-09-12T12:26:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.923+0000 7f8b267fb740 1 -- start start 2024-09-12T12:26:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.923+0000 7f8b267fb740 1 Processor -- start 2024-09-12T12:26:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.923+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c91afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c91b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b267fb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c917dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b267fb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1ade50 con 0x559e8c908590 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b267fb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1ad780 con 0x559e8c907c70 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b267fb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1aa9c0 con 0x559e8c912e50 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b267fb740 10 client.0 _ll_register_callbacks cb 0x7f8b10005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c91b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b20a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c91b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45312/0 (socket says 172.21.15.38:45312) 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b20a00640 1 -- 172.21.15.38:0/1430198184 learned_addr learned my addr 172.21.15.38:0/1430198184 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:26:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b21e00640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c917dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b21400640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c91afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b21400640 1 -- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 msgr2=0x559e8c917dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.924+0000 7f8b21400640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c917dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b21400640 1 -- 172.21.15.38:0/1430198184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 msgr2=0x559e8c91b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b21400640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c91b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b21400640 1 -- 172.21.15.38:0/1430198184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8c918430 con 0x559e8c907c70 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b20a00640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c91b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b21e00640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c917dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b21400640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c91afd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8b100c4380 tx=0x7f8b1002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c7d8245b603287 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b02a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b02a00640 1 -- 172.21.15.38:0/1430198184 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b100bbc40 con 0x559e8c907c70 2024-09-12T12:26:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b02a00640 1 -- 172.21.15.38:0/1430198184 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f8b100b82b0 con 0x559e8c907c70 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1401b040 con 0x559e8c907c70 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.925+0000 7f8b02a00640 1 -- 172.21.15.38:0/1430198184 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8b100c48b0 con 0x559e8c907c70 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 10 client.25496 fetch_fsmap learned FSMap version 30 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559e8c996c30 con 0x559e8c907c70 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b02a00640 1 -- 172.21.15.38:0/1430198184 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1401b040 con 0x559e8c907c70 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b02a00640 1 -- 172.21.15.38:0/1430198184 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f8b100da2c0 con 0x559e8c907c70 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 10 client.25496 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 10 client.25496 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 20 client.25496 populate_metadata read hostname 'smithi038' 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c997110 0x559e8c999500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 4 client.25496 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e8c875e60 con 0x559e8c997110 2024-09-12T12:26:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.926+0000 7f8b20a00640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c997110 0x559e8c999500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b20a00640 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c997110 0x559e8c999500 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=843c5b6d1c3d87b1 server_cookie=f479289d2ad1e149 in_seq=0 out_seq=0 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b02a00640 10 client.25496 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b02a00640 1 -- 172.21.15.38:0/1430198184 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e8c875e60 con 0x559e8c997110 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b02a00640 10 client.25496 handle_command_reply: tid=0 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 client.25496 shutdown 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 msgr2=0x559e8c91afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c91afd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8b100c4380 tx=0x7f8b1002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 shutdown_connections 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x559e8c997110 0x559e8c999500 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e8c912e50 0x559e8c917dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559e8c908590 0x559e8c91b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b267fb740 1 --2- 172.21.15.38:0/1430198184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e8c907c70 0x559e8c91afd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.927+0000 7f8b02a00640 0 client.25496 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.928+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 >> 172.21.15.38:0/1430198184 conn(0x559e8c904200 msgr2=0x559e8c903380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.928+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 shutdown_connections 2024-09-12T12:26:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.928+0000 7f8b267fb740 1 -- 172.21.15.38:0/1430198184 wait complete. 2024-09-12T12:26:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.928+0000 7f8b267fb740 20 client.25496 trim_cache size 0 max 16384 2024-09-12T12:26:59.931 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:26:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8b040a2b10 msgr2=0x7f8b040a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8b040a2b10 0x7f8b040a4fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b14005fd0 tx=0x7f8b14011440 comp rx=0 tx=0).stop 2024-09-12T12:26:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c103ff0 msgr2=0x7f8b1c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c19a600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006010 tx=0x7f8b10004040 comp rx=0 tx=0).stop 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 shutdown_connections 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f8b040a2b10 0x7f8b040a4fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1c109120 0x7f8b1c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1049a0 0x7f8b1c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 --2- 172.21.15.38:0/1437612809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c103ff0 0x7f8b1c19a600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 >> 172.21.15.38:0/1437612809 conn(0x7f8b1c0ffa90 msgr2=0x7f8b1c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 shutdown_connections 2024-09-12T12:26:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:26:59.929+0000 7f8b23e00640 1 -- 172.21.15.38:0/1437612809 wait complete. 2024-09-12T12:27:00.154 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:26:59 smithi038 ceph-mon[30810]: pgmap v425: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T12:27:00.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:26:59 smithi154 ceph-mon[35578]: pgmap v425: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T12:27:00.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:26:59 smithi071 ceph-mon[34859]: pgmap v425: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T12:27:00.902 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:27:01.303 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:01.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:01 smithi038 ceph-mon[30810]: pgmap v426: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T12:27:01.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:01 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:27:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.982+0000 7fca24a00640 1 -- 172.21.15.38:0/1382953625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20076720 msgr2=0x7fca20076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.982+0000 7fca24a00640 1 --2- 172.21.15.38:0/1382953625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20076720 0x7fca20076b00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca10009900 tx=0x7fca1002a410 comp rx=0 tx=0).stop 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.982+0000 7fca24a00640 1 -- 172.21.15.38:0/1382953625 shutdown_connections 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.982+0000 7fca24a00640 1 --2- 172.21.15.38:0/1382953625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20112a30 0x7fca20114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.982+0000 7fca24a00640 1 --2- 172.21.15.38:0/1382953625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20077040 0x7fca201124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.982+0000 7fca24a00640 1 --2- 172.21.15.38:0/1382953625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20076720 0x7fca20076b00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.982+0000 7fca24a00640 1 -- 172.21.15.38:0/1382953625 >> 172.21.15.38:0/1382953625 conn(0x7fca200ffa90 msgr2=0x7fca20101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.983+0000 7fca24a00640 1 -- 172.21.15.38:0/1382953625 shutdown_connections 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.983+0000 7fca24a00640 1 -- 172.21.15.38:0/1382953625 wait complete. 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.984+0000 7fca24a00640 1 Processor -- start 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.984+0000 7fca24a00640 1 -- start start 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.984+0000 7fca24a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20076720 0x7fca201a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca24a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20077040 0x7fca201a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca24a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20112a30 0x7fca2019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca24a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca20118610 con 0x7fca20077040 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca24a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca20118490 con 0x7fca20112a30 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca24a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca20118790 con 0x7fca20076720 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20076720 0x7fca201a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20076720 0x7fca201a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:47848/0 (socket says 172.21.15.38:47848) 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 -- 172.21.15.38:0/533198003 learned_addr learned my addr 172.21.15.38:0/533198003 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1d400640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20077040 0x7fca201a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1e800640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20112a30 0x7fca2019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 -- 172.21.15.38:0/533198003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20112a30 msgr2=0x7fca2019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20112a30 0x7fca2019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 -- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20077040 msgr2=0x7fca201a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20077040 0x7fca201a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.985+0000 7fca1de00640 1 -- 172.21.15.38:0/533198003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2019f010 con 0x7fca20076720 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.986+0000 7fca1de00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20076720 0x7fca201a4720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca10004770 tx=0x7fca10003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.986+0000 7fca16a00640 1 -- 172.21.15.38:0/533198003 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1003f070 con 0x7fca20076720 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.986+0000 7fca16a00640 1 -- 172.21.15.38:0/533198003 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca10031ca0 con 0x7fca20076720 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.986+0000 7fca16a00640 1 -- 172.21.15.38:0/533198003 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10035030 con 0x7fca20076720 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.986+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2019f2a0 con 0x7fca20076720 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.986+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201ab5f0 con 0x7fca20076720 2024-09-12T12:27:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.989+0000 7fca16a00640 1 -- 172.21.15.38:0/533198003 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca10042070 con 0x7fca20076720 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.991+0000 7fca27667740 1 Processor -- start 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.991+0000 7fca16a00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca040a2c00 0x7fca040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.991+0000 7fca27667740 1 -- start start 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.991+0000 7fca16a00640 1 -- 172.21.15.38:0/533198003 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fca100ef960 con 0x7fca20076720 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca1e800640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca040a2c00 0x7fca040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca27667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca27667740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca27667740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca27667740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5598140123e0 con 0x5598140ac590 2024-09-12T12:27:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca27667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559813fb9d80 con 0x5598140abc70 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca27667740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55981400e3a0 con 0x5598140b6e50 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca1de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca1d400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca1de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57442/0 (socket says 172.21.15.38:57442) 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.992+0000 7fca1de00640 1 -- 172.21.15.38:0/181055766 learned_addr learned my addr 172.21.15.38:0/181055766 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1de00640 1 -- 172.21.15.38:0/181055766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 msgr2=0x5598140b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1de00640 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1de00640 1 -- 172.21.15.38:0/181055766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 msgr2=0x5598140b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1e800640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca040a2c00 0x7fca040a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fca2006b460 tx=0x7fca18009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1de00640 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1de00640 1 -- 172.21.15.38:0/181055766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559813fd8ae0 con 0x5598140abc70 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1d400640 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca1de00640 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ac050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca100bbeb0 tx=0x7fca1003b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db49f01db9423419 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.993+0000 7fca0b000640 1 -- 172.21.15.38:0/181055766 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100d9070 con 0x5598140abc70 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca0b000640 1 -- 172.21.15.38:0/181055766 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca100c0220 con 0x5598140abc70 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca0b000640 1 -- 172.21.15.38:0/181055766 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10049070 con 0x5598140abc70 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca27667740 1 -- 172.21.15.38:0/181055766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 msgr2=0x5598140ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca27667740 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ac050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca100bbeb0 tx=0x7fca1003b460 comp rx=0 tx=0).stop 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca27667740 1 -- 172.21.15.38:0/181055766 shutdown_connections 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca27667740 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca27667740 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca27667740 1 --2- 172.21.15.38:0/181055766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ac050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.994+0000 7fca27667740 1 -- 172.21.15.38:0/181055766 >> 172.21.15.38:0/181055766 conn(0x5598140a8200 msgr2=0x5598140a85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.995+0000 7fca27667740 1 -- 172.21.15.38:0/181055766 shutdown_connections 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.995+0000 7fca27667740 1 -- 172.21.15.38:0/181055766 wait complete. 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.995+0000 7fca27667740 1 -- start start 2024-09-12T12:27:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 1 Processor -- start 2024-09-12T12:27:02.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5598140b97e0 con 0x5598140ac590 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559813fcd0f0 con 0x5598140abc70 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5598140b9960 con 0x5598140b6e50 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.996+0000 7fca27667740 10 client.0 _ll_register_callbacks cb 0x559813fb4bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57452/0 (socket says 172.21.15.38:57452) 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 -- 172.21.15.38:0/1018892986 learned_addr learned my addr 172.21.15.38:0/1018892986 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1e800640 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1d400640 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 -- 172.21.15.38:0/1018892986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 msgr2=0x5598140b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 -- 172.21.15.38:0/1018892986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 msgr2=0x5598140b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 -- 172.21.15.38:0/1018892986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559813d833c0 con 0x5598140abc70 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fca1de00640 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140b3db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca100bc0e0 tx=0x7fca1002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52fa8e763354ebd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.997+0000 7fc9ff400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fc9ff400640 1 -- 172.21.15.38:0/1018892986 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100ab060 con 0x5598140abc70 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fc9ff400640 1 -- 172.21.15.38:0/1018892986 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fca1003b4f0 con 0x5598140abc70 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca100c0220 con 0x5598140abc70 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fc9ff400640 1 -- 172.21.15.38:0/1018892986 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fca100d9030 con 0x5598140abc70 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fca27667740 10 client.25508 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5598140b97e0 con 0x5598140abc70 2024-09-12T12:27:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fc9ff400640 1 -- 172.21.15.38:0/1018892986 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca100c0220 con 0x5598140abc70 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.998+0000 7fc9ff400640 1 -- 172.21.15.38:0/1018892986 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fca100c4670 con 0x5598140abc70 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca27667740 10 client.25508 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca27667740 10 client.25508 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca27667740 20 client.25508 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca27667740 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x5598140c6990 0x5598140c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca27667740 4 client.25508 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55981401f950 con 0x5598140c6990 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca1d400640 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x5598140c6990 0x5598140c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fca1d400640 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x5598140c6990 0x5598140c8d80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8af257a0ace6cff6 server_cookie=177cb7911bfc9ca8 in_seq=0 out_seq=0 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:01.999+0000 7fc9ff400640 10 client.25508 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.000+0000 7fc9ff400640 1 -- 172.21.15.38:0/1018892986 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55981401f950 con 0x5598140c6990 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.000+0000 7fc9ff400640 10 client.25508 handle_command_reply: tid=0 2024-09-12T12:27:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.000+0000 7fca27667740 1 client.25508 shutdown 2024-09-12T12:27:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.000+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 msgr2=0x5598140b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.000+0000 7fca27667740 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140b3db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca100bc0e0 tx=0x7fca1002a410 comp rx=0 tx=0).stop 2024-09-12T12:27:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 shutdown_connections 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x5598140c6990 0x5598140c8d80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 --2- 172.21.15.38:0/1018892986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140b3db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fc9ff400640 0 client.25508 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 >> 172.21.15.38:0/1018892986 conn(0x5598140a8200 msgr2=0x5598140adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 shutdown_connections 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 1 -- 172.21.15.38:0/1018892986 wait complete. 2024-09-12T12:27:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.001+0000 7fca27667740 20 client.25508 trim_cache size 0 max 16384 2024-09-12T12:27:02.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 Processor -- start 2024-09-12T12:27:02.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 -- start start 2024-09-12T12:27:02.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b5470 con 0x5598140ac590 2024-09-12T12:27:02.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b6fb0 con 0x5598140abc70 2024-09-12T12:27:02.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.015+0000 7fca27667740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b5b40 con 0x5598140b6e50 2024-09-12T12:27:02.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57456/0 (socket says 172.21.15.38:57456) 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1de00640 1 -- 172.21.15.38:0/457809493 learned_addr learned my addr 172.21.15.38:0/457809493 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1d400640 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1e800640 1 -- 172.21.15.38:0/457809493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 msgr2=0x5598140ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1e800640 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1e800640 1 -- 172.21.15.38:0/457809493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 msgr2=0x5598140ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1e800640 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1e800640 1 -- 172.21.15.38:0/457809493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598140a92b0 con 0x5598140b6e50 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1d400640 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.016+0000 7fca1de00640 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.017+0000 7fca1e800640 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140ceaf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca18015000 tx=0x7fca18013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e4961344df55dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.017+0000 7fca0a600640 1 -- 172.21.15.38:0/457809493 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18026420 con 0x5598140b6e50 2024-09-12T12:27:02.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.017+0000 7fca0a600640 1 -- 172.21.15.38:0/457809493 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca18026aa0 con 0x5598140b6e50 2024-09-12T12:27:02.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.017+0000 7fca0a600640 1 -- 172.21.15.38:0/457809493 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1801c980 con 0x5598140b6e50 2024-09-12T12:27:02.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.018+0000 7fca27667740 1 -- 172.21.15.38:0/457809493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 msgr2=0x5598140ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.018+0000 7fca27667740 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140ceaf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca18015000 tx=0x7fca18013040 comp rx=0 tx=0).stop 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.018+0000 7fca27667740 1 -- 172.21.15.38:0/457809493 shutdown_connections 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.018+0000 7fca27667740 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140ceaf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.018+0000 7fca27667740 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.018+0000 7fca27667740 1 --2- 172.21.15.38:0/457809493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.018+0000 7fca27667740 1 -- 172.21.15.38:0/457809493 >> 172.21.15.38:0/457809493 conn(0x5598140a8200 msgr2=0x5598140b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.019+0000 7fca27667740 1 -- 172.21.15.38:0/457809493 shutdown_connections 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.019+0000 7fca27667740 1 -- 172.21.15.38:0/457809493 wait complete. 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.019+0000 7fca27667740 1 -- start start 2024-09-12T12:27:02.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.019+0000 7fca27667740 1 Processor -- start 2024-09-12T12:27:02.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca27667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca27667740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca27667740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140bb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca27667740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b68e0 con 0x5598140ac590 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca27667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b6210 con 0x5598140abc70 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca27667740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b3450 con 0x5598140b6e50 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca27667740 10 client.0 _ll_register_callbacks cb 0x7fca100d7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca1d400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca1de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca1d400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140bad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45378/0 (socket says 172.21.15.38:45378) 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca1d400640 1 -- 172.21.15.38:0/2042255165 learned_addr learned my addr 172.21.15.38:0/2042255165 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.020+0000 7fca1e800640 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fca1e800640 1 -- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 msgr2=0x5598140ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fca1e800640 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fca1e800640 1 -- 172.21.15.38:0/2042255165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 msgr2=0x5598140bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fca1e800640 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140bad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fca1e800640 1 -- 172.21.15.38:0/2042255165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598140a8e90 con 0x5598140b6e50 2024-09-12T12:27:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fca1de00640 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fca1e800640 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140bb270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca18025000 tx=0x7fca18009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b808756b868abd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.021+0000 7fc9ff400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:27:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fc9ff400640 1 -- 172.21.15.38:0/2042255165 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18004a40 con 0x5598140b6e50 2024-09-12T12:27:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fc9ff400640 1 -- 172.21.15.38:0/2042255165 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fca18004be0 con 0x5598140b6e50 2024-09-12T12:27:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca18026aa0 con 0x5598140b6e50 2024-09-12T12:27:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fc9ff400640 1 -- 172.21.15.38:0/2042255165 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fca18039050 con 0x5598140b6e50 2024-09-12T12:27:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 10 client.25492 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5598140a3770 con 0x5598140b6e50 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fc9ff400640 1 -- 172.21.15.38:0/2042255165 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca18026aa0 con 0x5598140b6e50 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fc9ff400640 1 -- 172.21.15.38:0/2042255165 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fca18018070 con 0x5598140b6e50 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 10 client.25492 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 10 client.25492 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 20 client.25492 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x559814131aa0 0x559814133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 4 client.25492 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.022+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559814019e60 con 0x559814131aa0 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.023+0000 7fca1de00640 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x559814131aa0 0x559814133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fc9ff400640 10 client.25492 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca1de00640 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x559814131aa0 0x559814133ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc014f698406bf08 server_cookie=cecf1a02422fef33 in_seq=0 out_seq=0 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fc9ff400640 1 -- 172.21.15.38:0/2042255165 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559814019e60 con 0x559814131aa0 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fc9ff400640 10 client.25492 handle_command_reply: tid=0 2024-09-12T12:27:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 client.25492 shutdown 2024-09-12T12:27:02.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 msgr2=0x5598140bb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:02.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140bb270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca18025000 tx=0x7fca18009fd0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 shutdown_connections 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x559814131aa0 0x559814133ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598140b6e50 0x5598140bb270 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598140ac590 0x5598140bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 --2- 172.21.15.38:0/2042255165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598140abc70 0x5598140ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 >> 172.21.15.38:0/2042255165 conn(0x5598140a8200 msgr2=0x5598140a6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fc9ff400640 0 client.25492 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.024+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 shutdown_connections 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.025+0000 7fca27667740 1 -- 172.21.15.38:0/2042255165 wait complete. 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.025+0000 7fca27667740 20 client.25492 trim_cache size 0 max 16384 2024-09-12T12:27:02.027 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.025+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca040a2c00 msgr2=0x7fca040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.025+0000 7fca24a00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca040a2c00 0x7fca040a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fca2006b460 tx=0x7fca18009500 comp rx=0 tx=0).stop 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20076720 msgr2=0x7fca201a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20076720 0x7fca201a4720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca10004770 tx=0x7fca10003c10 comp rx=0 tx=0).stop 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 shutdown_connections 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fca040a2c00 0x7fca040a50c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca20112a30 0x7fca2019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20077040 0x7fca201a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 --2- 172.21.15.38:0/533198003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca20076720 0x7fca201a4720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 >> 172.21.15.38:0/533198003 conn(0x7fca200ffa90 msgr2=0x7fca20101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 shutdown_connections 2024-09-12T12:27:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:02.026+0000 7fca24a00640 1 -- 172.21.15.38:0/533198003 wait complete. 2024-09-12T12:27:02.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:01 smithi154 ceph-mon[35578]: pgmap v426: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T12:27:02.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:01 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:27:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:01 smithi071 ceph-mon[34859]: pgmap v426: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T12:27:02.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:01 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:27:02.767 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 60% (7847/12903) Updating files: 61% (7871/12903) Updating files: 62% (8000/12903) Updating files: 63% (8129/12903) Updating files: 64% (8258/12903) Updating files: 65% (8387/12903) Updating files: 66% (8516/12903) Updating files: 67% (8646/12903) Updating files: 68% (8775/12903) Updating files: 69% (8904/12903) Updating files: 70% (9033/12903) Updating files: 71% (9162/12903) Updating files: 72% (9291/12903) Updating files: 73% (9420/12903) Updating files: 74% (9549/12903) Updating files: 75% (9678/12903) Updating files: 76% (9807/12903) Updating files: 77% (9936/12903) Updating files: 78% (10065/12903) Updating files: 79% (10194/12903) Updating files: 80% (10323/12903) Updating files: 81% (10452/12903) Updating files: 82% (10581/12903) Updating files: 83% (10710/12903) Updating files: 84% (10839/12903) Updating files: 85% (10968/12903) Updating files: 86% (11097/12903) Updating files: 87% (11226/12903) Updating files: 88% (11355/12903) Updating files: 89% (11484/12903) Updating files: 90% (11613/12903) Updating files: 90% (11686/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T12:27:03.010 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:27:03.409 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:03.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:27:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:27:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:27:03.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:27:03.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:27:03.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:27:03.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:27:03.870 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T12:27:03.870 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:03.870 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T12:27:03.870 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T12:27:03.870 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:03.871 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T12:27:03.886 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T12:27:03.968 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T12:27:03.973 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T12:27:03.973 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 -- 172.21.15.38:0/3618271282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 msgr2=0x7f05a8110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 --2- 172.21.15.38:0/3618271282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a8110cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009900 tx=0x7f05a002a410 comp rx=0 tx=0).stop 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 -- 172.21.15.38:0/3618271282 shutdown_connections 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 --2- 172.21.15.38:0/3618271282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a8110cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 --2- 172.21.15.38:0/3618271282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a81049c0 0x7f05a8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 --2- 172.21.15.38:0/3618271282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a8104010 0x7f05a81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 -- 172.21.15.38:0/3618271282 >> 172.21.15.38:0/3618271282 conn(0x7f05a80ffa50 msgr2=0x7f05a8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 -- 172.21.15.38:0/3618271282 shutdown_connections 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.081+0000 7f05b0000640 1 -- 172.21.15.38:0/3618271282 wait complete. 2024-09-12T12:27:04.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 Processor -- start 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 -- start start 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a8104010 0x7f05a819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a81049c0 0x7f05a819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8114170 con 0x7f05a8109140 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8113ff0 con 0x7f05a8104010 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.082+0000 7f05b0000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81142f0 con 0x7f05a81049c0 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ad600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a8104010 0x7f05a819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45404/0 (socket says 172.21.15.38:45404) 2024-09-12T12:27:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 -- 172.21.15.38:0/2820580802 learned_addr learned my addr 172.21.15.38:0/2820580802 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05acc00640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a81049c0 0x7f05a819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 -- 172.21.15.38:0/2820580802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a81049c0 msgr2=0x7f05a819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a81049c0 0x7f05a819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 -- 172.21.15.38:0/2820580802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a8104010 msgr2=0x7f05a819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a8104010 0x7f05a819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 -- 172.21.15.38:0/2820580802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a819f5c0 con 0x7f05a8109140 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.083+0000 7f05ae000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a819eee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f05a0005ab0 tx=0x7f05a0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.084+0000 7f05a6000640 1 -- 172.21.15.38:0/2820580802 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a003f030 con 0x7f05a8109140 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.084+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a819f850 con 0x7f05a8109140 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.084+0000 7f05a6000640 1 -- 172.21.15.38:0/2820580802 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a0004440 con 0x7f05a8109140 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.084+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a81a7190 con 0x7f05a8109140 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.084+0000 7f05a6000640 1 -- 172.21.15.38:0/2820580802 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0049060 con 0x7f05a8109140 2024-09-12T12:27:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 Processor -- start 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05a6000640 1 -- 172.21.15.38:0/2820580802 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f05a0042030 con 0x7f05a8109140 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 -- start start 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b58050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b62910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b65240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5569e7abe3e0 con 0x5569e7b57c70 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5569e7a65d80 con 0x5569e7b58590 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.087+0000 7f05b2a71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569e7aba3a0 con 0x5569e7b62e50 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05acc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b58050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b62910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b62910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57490/0 (socket says 172.21.15.38:57490) 2024-09-12T12:27:04.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05acc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b58050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45416/0 (socket says 172.21.15.38:45416) 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 -- 172.21.15.38:0/3737239344 learned_addr learned my addr 172.21.15.38:0/3737239344 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05acc00640 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b65240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 -- 172.21.15.38:0/3737239344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 msgr2=0x5569e7b65240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b65240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 -- 172.21.15.38:0/3737239344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 msgr2=0x5569e7b58050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b58050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 -- 172.21.15.38:0/3737239344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569e7a84ae0 con 0x5569e7b58590 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05acc00640 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b65240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.088+0000 7f05ad600640 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b62910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f059c0114f0 tx=0x7f059c0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a35bba55a8e051f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.089+0000 7f05a6000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05900a2b80 0x7f05900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.089+0000 7f059a600640 1 -- 172.21.15.38:0/3737239344 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c004d20 con 0x5569e7b58590 2024-09-12T12:27:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.089+0000 7f059a600640 1 -- 172.21.15.38:0/3737239344 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f059c004050 con 0x5569e7b58590 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.089+0000 7f059a600640 1 -- 172.21.15.38:0/3737239344 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c00f7c0 con 0x5569e7b58590 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.089+0000 7f05a6000640 1 -- 172.21.15.38:0/2820580802 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f05a00efa40 con 0x7f05a8109140 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.089+0000 7f05acc00640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05900a2b80 0x7f05900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 -- 172.21.15.38:0/3737239344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 msgr2=0x5569e7b62910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05acc00640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05900a2b80 0x7f05900a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5569e7b55580 tx=0x7f05940096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b62910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f059c0114f0 tx=0x7f059c0119b0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 -- 172.21.15.38:0/3737239344 shutdown_connections 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b65240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b62910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 --2- 172.21.15.38:0/3737239344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b58050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 -- 172.21.15.38:0/3737239344 >> 172.21.15.38:0/3737239344 conn(0x5569e7b54200 msgr2=0x5569e7b545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 -- 172.21.15.38:0/3737239344 shutdown_connections 2024-09-12T12:27:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 -- 172.21.15.38:0/3737239344 wait complete. 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 -- start start 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.090+0000 7f05b2a71740 1 Processor -- start 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b5fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b60230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b60770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05b2a71740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5569e7b65a20 con 0x5569e7b57c70 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05b2a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5569e7a790f0 con 0x5569e7b58590 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05b2a71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569e7b65ba0 con 0x5569e7b62e50 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05b2a71740 10 client.0 _ll_register_callbacks cb 0x5569e7a60bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05ad600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b5fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05ad600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b5fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45426/0 (socket says 172.21.15.38:45426) 2024-09-12T12:27:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05ad600640 1 -- 172.21.15.38:0/808009311 learned_addr learned my addr 172.21.15.38:0/808009311 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05ae000640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b60770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.091+0000 7f05acc00640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b60230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05ad600640 1 -- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 msgr2=0x5569e7b60770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05ad600640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b60770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05ad600640 1 -- 172.21.15.38:0/808009311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 msgr2=0x5569e7b60230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05ad600640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b60230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05ad600640 1 -- 172.21.15.38:0/808009311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569e782f3c0 con 0x5569e7b57c70 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05ae000640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b60770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05ad600640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b5fcf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f059c01b040 tx=0x7f059c004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48379d31d585157b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f058ea00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f058ea00640 1 -- 172.21.15.38:0/808009311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c028020 con 0x5569e7b57c70 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f058ea00640 1 -- 172.21.15.38:0/808009311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f059c004410 con 0x5569e7b57c70 2024-09-12T12:27:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.092+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f059c004050 con 0x5569e7b57c70 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f058ea00640 1 -- 172.21.15.38:0/808009311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f059c033050 con 0x5569e7b57c70 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 10 client.15519 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5569e7b71980 con 0x5569e7b57c70 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f058ea00640 1 -- 172.21.15.38:0/808009311 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f059c004050 con 0x5569e7b57c70 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f058ea00640 1 -- 172.21.15.38:0/808009311 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f059c005040 con 0x5569e7b57c70 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 10 client.15519 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 10 client.15519 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 20 client.15519 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7b72de0 0x5569e7b751d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 4 client.15519 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.093+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569e7acb950 con 0x5569e7b72de0 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.094+0000 7f05acc00640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7b72de0 0x5569e7b751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.094+0000 7f05acc00640 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7b72de0 0x5569e7b751d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f25f3fb64d269901 server_cookie=a03792af4022a51e in_seq=0 out_seq=0 2024-09-12T12:27:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.094+0000 7f058ea00640 10 client.15519 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f058ea00640 1 -- 172.21.15.38:0/808009311 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569e7acb950 con 0x5569e7b72de0 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f058ea00640 10 client.15519 handle_command_reply: tid=0 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 client.15519 shutdown 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 msgr2=0x5569e7b5fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b5fcf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f059c01b040 tx=0x7f059c004c70 comp rx=0 tx=0).stop 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 shutdown_connections 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7b72de0 0x5569e7b751d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b62e50 0x5569e7b60770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b60230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 --2- 172.21.15.38:0/808009311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b57c70 0x5569e7b5fcf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 >> 172.21.15.38:0/808009311 conn(0x5569e7b54200 msgr2=0x5569e7b59f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f058ea00640 0 client.15519 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.095+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 shutdown_connections 2024-09-12T12:27:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.096+0000 7f05b2a71740 1 -- 172.21.15.38:0/808009311 wait complete. 2024-09-12T12:27:04.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.096+0000 7f05b2a71740 20 client.15519 trim_cache size 0 max 16384 2024-09-12T12:27:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 Processor -- start 2024-09-12T12:27:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 -- start start 2024-09-12T12:27:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b5a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b7a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b62e50 0x5569e7b7aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81b0ef0 con 0x5569e7b62e50 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81b2a30 con 0x5569e7b58590 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.110+0000 7f05b2a71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81b15c0 con 0x5569e7b57c70 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b5a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b5a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:47924/0 (socket says 172.21.15.38:47924) 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 -- 172.21.15.38:0/469630171 learned_addr learned my addr 172.21.15.38:0/469630171 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05acc00640 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b7a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ae000640 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b62e50 0x5569e7b7aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 -- 172.21.15.38:0/469630171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 msgr2=0x5569e7b7a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b7a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 -- 172.21.15.38:0/469630171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b62e50 msgr2=0x5569e7b7aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b62e50 0x5569e7b7aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 -- 172.21.15.38:0/469630171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569e7b54030 con 0x5569e7b57c70 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.111+0000 7f05ad600640 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b5a6d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f059c005410 tx=0x7f059c009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6855b3a703b6168a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f0599c00640 1 -- 172.21.15.38:0/469630171 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c028040 con 0x5569e7b57c70 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f0599c00640 1 -- 172.21.15.38:0/469630171 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f059c0051c0 con 0x5569e7b57c70 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f0599c00640 1 -- 172.21.15.38:0/469630171 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c004670 con 0x5569e7b57c70 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 -- 172.21.15.38:0/469630171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 msgr2=0x5569e7b5a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b5a6d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f059c005410 tx=0x7f059c009ea0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 -- 172.21.15.38:0/469630171 shutdown_connections 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b62e50 0x5569e7b7aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b58590 0x5569e7b7a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 --2- 172.21.15.38:0/469630171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b5a6d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 -- 172.21.15.38:0/469630171 >> 172.21.15.38:0/469630171 conn(0x5569e7b54200 msgr2=0x5569e7b61d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.112+0000 7f05b2a71740 1 -- 172.21.15.38:0/469630171 shutdown_connections 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.113+0000 7f05b2a71740 1 -- 172.21.15.38:0/469630171 wait complete. 2024-09-12T12:27:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.113+0000 7f05b2a71740 1 -- start start 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.113+0000 7f05b2a71740 1 Processor -- start 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b65e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b58590 0x5569e7b66390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05b2a71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b62e50 0x5569e7b668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05b2a71740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81b2360 con 0x5569e7b58590 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05b2a71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81b1c90 con 0x5569e7b62e50 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05b2a71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81aeed0 con 0x5569e7b57c70 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05b2a71740 10 client.0 _ll_register_callbacks cb 0x7f05940097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b58590 0x5569e7b66390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b58590 0x5569e7b66390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45456/0 (socket says 172.21.15.38:45456) 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 -- 172.21.15.38:0/2346102353 learned_addr learned my addr 172.21.15.38:0/2346102353 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05ad600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b65e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05ae000640 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b62e50 0x5569e7b668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 -- 172.21.15.38:0/2346102353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 msgr2=0x5569e7b65e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b65e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 -- 172.21.15.38:0/2346102353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b62e50 msgr2=0x5569e7b668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b62e50 0x5569e7b668d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05acc00640 1 -- 172.21.15.38:0/2346102353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569e7bdbc10 con 0x5569e7b58590 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.114+0000 7f05ae000640 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b62e50 0x5569e7b668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f05acc00640 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b58590 0x5569e7b66390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0594009730 tx=0x7f0594004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b9ab531e59c8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f058ea00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f058ea00640 1 -- 172.21.15.38:0/2346102353 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594004030 con 0x5569e7b58590 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f058ea00640 1 -- 172.21.15.38:0/2346102353 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f05940041d0 con 0x5569e7b58590 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f059c0051c0 con 0x5569e7b58590 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f058ea00640 1 -- 172.21.15.38:0/2346102353 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f059403a050 con 0x5569e7b58590 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f05b2a71740 10 client.15525 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.115+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5569e7bdcfa0 con 0x5569e7b58590 2024-09-12T12:27:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f058ea00640 1 -- 172.21.15.38:0/2346102353 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f059c0051c0 con 0x5569e7b58590 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f058ea00640 1 -- 172.21.15.38:0/2346102353 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f05940053e0 con 0x5569e7b58590 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f05b2a71740 10 client.15525 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f05b2a71740 10 client.15525 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f05b2a71740 20 client.15525 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f05b2a71740 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7bdd7a0 0x5569e7bdfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f05b2a71740 4 client.15525 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569e7ac5e60 con 0x5569e7bdd7a0 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.116+0000 7f05ad600640 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7bdd7a0 0x5569e7bdfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05ad600640 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7bdd7a0 0x5569e7bdfbc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76ccfdd83d28ec30 server_cookie=5cb0338d7551b513 in_seq=0 out_seq=0 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f058ea00640 10 client.15525 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f058ea00640 1 -- 172.21.15.38:0/2346102353 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569e7ac5e60 con 0x5569e7bdd7a0 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f058ea00640 10 client.15525 handle_command_reply: tid=0 2024-09-12T12:27:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 client.15525 shutdown 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b58590 msgr2=0x5569e7b66390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b58590 0x5569e7b66390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0594009730 tx=0x7f0594004730 comp rx=0 tx=0).stop 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 shutdown_connections 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x5569e7bdd7a0 0x5569e7bdfbc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5569e7b62e50 0x5569e7b668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5569e7b58590 0x5569e7b66390 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 --2- 172.21.15.38:0/2346102353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569e7b57c70 0x5569e7b65e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 >> 172.21.15.38:0/2346102353 conn(0x5569e7b54200 msgr2=0x5569e7b61550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.117+0000 7f058ea00640 0 client.15525 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 shutdown_connections 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b2a71740 1 -- 172.21.15.38:0/2346102353 wait complete. 2024-09-12T12:27:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b2a71740 20 client.15525 trim_cache size 0 max 16384 2024-09-12T12:27:04.130 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:04.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05900a2b80 msgr2=0x7f05900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05900a2b80 0x7f05900a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5569e7b55580 tx=0x7f05940096c0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 msgr2=0x7f05a819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a819eee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f05a0005ab0 tx=0x7f05a0004040 comp rx=0 tx=0).stop 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 shutdown_connections 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f05900a2b80 0x7f05900a5040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05a8109140 0x7f05a819eee0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.118+0000 7f05b0000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a81049c0 0x7f05a819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.119+0000 7f05b0000640 1 --2- 172.21.15.38:0/2820580802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05a8104010 0x7f05a819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.119+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 >> 172.21.15.38:0/2820580802 conn(0x7f05a80ffa50 msgr2=0x7f05a8100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.119+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 shutdown_connections 2024-09-12T12:27:04.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:04.119+0000 7f05b0000640 1 -- 172.21.15.38:0/2820580802 wait complete. 2024-09-12T12:27:04.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:04 smithi038 ceph-mon[30810]: pgmap v427: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-09-12T12:27:04.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:04 smithi154 ceph-mon[35578]: pgmap v427: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-09-12T12:27:04.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:04 smithi071 ceph-mon[34859]: pgmap v427: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-09-12T12:27:05.282 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:27:05.668 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T12:27:05.670 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:05.772 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T12:27:05.839 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T12:27:05.843 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T12:27:05.843 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T12:27:05.910 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T12:27:05.918 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:27:05.918 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T12:27:05.954 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-12T12:27:05.955 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-12T12:27:05.956 DEBUG:teuthology.orchestra.run.smithi038:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T12:27:06.044 INFO:tasks.workunit.client.0.smithi038.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-12T12:27:06.065 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:06 smithi038 ceph-mon[30810]: pgmap v428: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:27:06.071 INFO:tasks.workunit.client.0.smithi038.stderr:--2024-09-12 12:27:06-- http://download.ceph.com/qa/fsync-tester.c 2024-09-12T12:27:06.072 INFO:tasks.workunit.client.0.smithi038.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-12T12:27:06.094 INFO:tasks.workunit.client.0.smithi038.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-12T12:27:06.114 INFO:tasks.workunit.client.0.smithi038.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T12:27:06.115 INFO:tasks.workunit.client.0.smithi038.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-12T12:27:06.116 INFO:tasks.workunit.client.0.smithi038.stderr:Saving to: ‘fsync-tester.c’ 2024-09-12T12:27:06.121 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:06.121 INFO:tasks.workunit.client.0.smithi038.stderr: 0K .. 100% 226M=0s 2024-09-12T12:27:06.121 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:06.121 INFO:tasks.workunit.client.0.smithi038.stderr:2024-09-12 12:27:06 (226 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-12T12:27:06.121 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-12T12:27:06.122 INFO:tasks.workunit.client.0.smithi038.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 -- 172.21.15.38:0/3300396228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e8103ff0 msgr2=0x7f56e81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 --2- 172.21.15.38:0/3300396228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e8103ff0 0x7f56e81043d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009860 tx=0x7f56d802a340 comp rx=0 tx=0).stop 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 -- 172.21.15.38:0/3300396228 shutdown_connections 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 --2- 172.21.15.38:0/3300396228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56e8109120 0x7f56e8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 --2- 172.21.15.38:0/3300396228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e81049a0 0x7f56e81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 --2- 172.21.15.38:0/3300396228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e8103ff0 0x7f56e81043d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 -- 172.21.15.38:0/3300396228 >> 172.21.15.38:0/3300396228 conn(0x7f56e80ffa90 msgr2=0x7f56e8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 -- 172.21.15.38:0/3300396228 shutdown_connections 2024-09-12T12:27:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.306+0000 7f56eec00640 1 -- 172.21.15.38:0/3300396228 wait complete. 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.307+0000 7f56eec00640 1 Processor -- start 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.307+0000 7f56eec00640 1 -- start start 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56eec00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56e8103ff0 0x7f56e819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56eec00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e81049a0 0x7f56e819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56eec00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8109120 0x7f56e819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56eec00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8114120 con 0x7f56e8103ff0 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56eec00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8113fa0 con 0x7f56e81049a0 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56eec00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81142a0 con 0x7f56e8109120 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56e8103ff0 0x7f56e819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56e8103ff0 0x7f56e819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53520/0 (socket says 172.21.15.38:53520) 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56e7e00640 1 -- 172.21.15.38:0/1445598220 learned_addr learned my addr 172.21.15.38:0/1445598220 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56e7400640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e81049a0 0x7f56e819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.308+0000 7f56ecc00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8109120 0x7f56e819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e7400640 1 -- 172.21.15.38:0/1445598220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8109120 msgr2=0x7f56e819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e7400640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8109120 0x7f56e819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e7400640 1 -- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56e8103ff0 msgr2=0x7f56e819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e7400640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56e8103ff0 0x7f56e819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e7400640 1 -- 172.21.15.38:0/1445598220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e819f5b0 con 0x7f56e81049a0 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e7400640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e81049a0 0x7f56e819ab40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56d400e9f0 tx=0x7f56d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e4c00640 1 -- 172.21.15.38:0/1445598220 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d400ccc0 con 0x7f56e81049a0 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e819f8a0 con 0x7f56e81049a0 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e4c00640 1 -- 172.21.15.38:0/1445598220 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d4010910 con 0x7f56e81049a0 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56e4c00640 1 -- 172.21.15.38:0/1445598220 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4018960 con 0x7f56e81049a0 2024-09-12T12:27:06.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.309+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e81a7180 con 0x7f56e81049a0 2024-09-12T12:27:06.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.313+0000 7f56e4c00640 1 -- 172.21.15.38:0/1445598220 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f56d4010ac0 con 0x7f56e81049a0 2024-09-12T12:27:06.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.313+0000 7f56f1687740 1 Processor -- start 2024-09-12T12:27:06.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.313+0000 7f56f1687740 1 -- start start 2024-09-12T12:27:06.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56f1687740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56f1687740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c9590 0x555b927d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56f1687740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56f1687740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555b9272f3e0 con 0x555b927c9590 2024-09-12T12:27:06.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56f1687740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555b926d6d80 con 0x555b927d3e50 2024-09-12T12:27:06.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56f1687740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555b9272b3a0 con 0x555b927c8c70 2024-09-12T12:27:06.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56ecc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56e7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c9590 0x555b927d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56ecc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:54546/0 (socket says 172.21.15.38:54546) 2024-09-12T12:27:06.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56ecc00640 1 -- 172.21.15.38:0/4043396004 learned_addr learned my addr 172.21.15.38:0/4043396004 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.314+0000 7f56e7400640 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56ecc00640 1 -- 172.21.15.38:0/4043396004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 msgr2=0x555b927d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56ecc00640 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56ecc00640 1 -- 172.21.15.38:0/4043396004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c9590 msgr2=0x555b927d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56ecc00640 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c9590 0x555b927d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56ecc00640 1 -- 172.21.15.38:0/4043396004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b926f5ae0 con 0x555b927c8c70 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56e7e00640 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c9590 0x555b927d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56ecc00640 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927c9050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009ee0 tx=0x7f56e000f7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d3d766b6796499 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56e4c00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f56cc0a2b80 0x7f56cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56dd200640 1 -- 172.21.15.38:0/4043396004 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e001d070 con 0x555b927c8c70 2024-09-12T12:27:06.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56dd200640 1 -- 172.21.15.38:0/4043396004 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e000dad0 con 0x555b927c8c70 2024-09-12T12:27:06.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.315+0000 7f56dd200640 1 -- 172.21.15.38:0/4043396004 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0018d00 con 0x555b927c8c70 2024-09-12T12:27:06.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56e4c00640 1 -- 172.21.15.38:0/1445598220 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f56d40cf890 con 0x7f56e81049a0 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56f1687740 1 -- 172.21.15.38:0/4043396004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 msgr2=0x555b927c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56f1687740 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927c9050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009ee0 tx=0x7f56e000f7d0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56e7e00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f56cc0a2b80 0x7f56cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56f1687740 1 -- 172.21.15.38:0/4043396004 shutdown_connections 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56f1687740 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56f1687740 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c9590 0x555b927d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56f1687740 1 --2- 172.21.15.38:0/4043396004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927c9050 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.316+0000 7f56f1687740 1 -- 172.21.15.38:0/4043396004 >> 172.21.15.38:0/4043396004 conn(0x555b927c5200 msgr2=0x555b927c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.317+0000 7f56f1687740 1 -- 172.21.15.38:0/4043396004 shutdown_connections 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.317+0000 7f56f1687740 1 -- 172.21.15.38:0/4043396004 wait complete. 2024-09-12T12:27:06.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.317+0000 7f56e7e00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f56cc0a2b80 0x7f56cc0a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x555b927c6060 tx=0x7f56d802c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:06.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.317+0000 7f56f1687740 1 -- start start 2024-09-12T12:27:06.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 1 Processor -- start 2024-09-12T12:27:06.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555b927d6a20 con 0x555b927c8c70 2024-09-12T12:27:06.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555b926ea0f0 con 0x555b927d3e50 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555b927d6ba0 con 0x555b927c9590 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.318+0000 7f56f1687740 10 client.0 _ll_register_callbacks cb 0x555b926d1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:54554/0 (socket says 172.21.15.38:54554) 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 -- 172.21.15.38:0/464248645 learned_addr learned my addr 172.21.15.38:0/464248645 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7e00640 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56ecc00640 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 -- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 msgr2=0x555b927d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 -- 172.21.15.38:0/464248645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 msgr2=0x555b927d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 -- 172.21.15.38:0/464248645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b924a03c0 con 0x555b927c9590 2024-09-12T12:27:06.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56e7400640 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d12f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f56d40a4420 tx=0x7f56d4098040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cadf42d563bff2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:06.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.319+0000 7f56d1600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:27:06.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.320+0000 7f56d1600640 1 -- 172.21.15.38:0/464248645 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d409c3e0 con 0x555b927c9590 2024-09-12T12:27:06.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.320+0000 7f56d1600640 1 -- 172.21.15.38:0/464248645 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f56d409b130 con 0x555b927c9590 2024-09-12T12:27:06.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.320+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e000dad0 con 0x555b927c9590 2024-09-12T12:27:06.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.320+0000 7f56d1600640 1 -- 172.21.15.38:0/464248645 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f56d409bce0 con 0x555b927c9590 2024-09-12T12:27:06.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.320+0000 7f56f1687740 10 client.25519 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:06.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.320+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555b927e2ae0 con 0x555b927c9590 2024-09-12T12:27:06.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.320+0000 7f56d1600640 1 -- 172.21.15.38:0/464248645 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e000dad0 con 0x555b927c9590 2024-09-12T12:27:06.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56d1600640 1 -- 172.21.15.38:0/464248645 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f56d4018c90 con 0x555b927c9590 2024-09-12T12:27:06.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56f1687740 10 client.25519 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:06.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56f1687740 10 client.25519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:06.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56f1687740 20 client.25519 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56f1687740 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b927e3fa0 0x555b927e6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56f1687740 4 client.25519 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b9273c950 con 0x555b927e3fa0 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.321+0000 7f56e7e00640 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b927e3fa0 0x555b927e6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.322+0000 7f56e7e00640 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b927e3fa0 0x555b927e6390 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1c3874f10c5e114 server_cookie=632fbf2a1aa16e20 in_seq=0 out_seq=0 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.322+0000 7f56d1600640 10 client.25519 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56d1600640 1 -- 172.21.15.38:0/464248645 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b9273c950 con 0x555b927e3fa0 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56d1600640 10 client.25519 handle_command_reply: tid=0 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 client.25519 shutdown 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 msgr2=0x555b927d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d12f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f56d40a4420 tx=0x7f56d4098040 comp rx=0 tx=0).stop 2024-09-12T12:27:06.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 shutdown_connections 2024-09-12T12:27:06.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b927e3fa0 0x555b927e6390 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d12f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 --2- 172.21.15.38:0/464248645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56d1600640 0 client.25519 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:06.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 >> 172.21.15.38:0/464248645 conn(0x555b927c5200 msgr2=0x555b927caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:06.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 shutdown_connections 2024-09-12T12:27:06.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.323+0000 7f56f1687740 1 -- 172.21.15.38:0/464248645 wait complete. 2024-09-12T12:27:06.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.324+0000 7f56f1687740 20 client.25519 trim_cache size 0 max 16384 2024-09-12T12:27:06.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 Processor -- start 2024-09-12T12:27:06.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 -- start start 2024-09-12T12:27:06.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927c9590 0x555b927ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927d3e50 0x555b927ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b0ff0 con 0x555b927d3e50 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b2b30 con 0x555b927c9590 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.338+0000 7f56f1687740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b16c0 con 0x555b927c8c70 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927d2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:54564/0 (socket says 172.21.15.38:54564) 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 -- 172.21.15.38:0/870499885 learned_addr learned my addr 172.21.15.38:0/870499885 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7400640 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927c9590 0x555b927ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56ecc00640 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927d3e50 0x555b927ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 -- 172.21.15.38:0/870499885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927c9590 msgr2=0x555b927ebc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927c9590 0x555b927ebc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 -- 172.21.15.38:0/870499885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927d3e50 msgr2=0x555b927ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927d3e50 0x555b927ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56e7e00640 1 -- 172.21.15.38:0/870499885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b927c62b0 con 0x555b927c8c70 2024-09-12T12:27:06.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.339+0000 7f56ecc00640 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927d3e50 0x555b927ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.340+0000 7f56e7e00640 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927d2d20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009830 tx=0x7f56d803c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=286467938e0717de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.340+0000 7f56d3e00640 1 -- 172.21.15.38:0/870499885 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8057070 con 0x555b927c8c70 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.340+0000 7f56d3e00640 1 -- 172.21.15.38:0/870499885 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d8042040 con 0x555b927c8c70 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.340+0000 7f56d3e00640 1 -- 172.21.15.38:0/870499885 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8037040 con 0x555b927c8c70 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 -- 172.21.15.38:0/870499885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 msgr2=0x555b927d2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927d2d20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009830 tx=0x7f56d803c000 comp rx=0 tx=0).stop 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 -- 172.21.15.38:0/870499885 shutdown_connections 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927d3e50 0x555b927ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927c9590 0x555b927ebc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 --2- 172.21.15.38:0/870499885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c8c70 0x555b927d2d20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 -- 172.21.15.38:0/870499885 >> 172.21.15.38:0/870499885 conn(0x555b927c5200 msgr2=0x555b927d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:06.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 -- 172.21.15.38:0/870499885 shutdown_connections 2024-09-12T12:27:06.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 -- 172.21.15.38:0/870499885 wait complete. 2024-09-12T12:27:06.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 -- start start 2024-09-12T12:27:06.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.341+0000 7f56f1687740 1 Processor -- start 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.342+0000 7f56f1687740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927dc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.342+0000 7f56f1687740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.342+0000 7f56f1687740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.342+0000 7f56f1687740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b2460 con 0x555b927c8c70 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.342+0000 7f56f1687740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b1d90 con 0x555b927d3e50 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.342+0000 7f56f1687740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81aefd0 con 0x555b927c9590 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.342+0000 7f56f1687740 10 client.0 _ll_register_callbacks cb 0x7f56d40d5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56ecc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56ecc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:44834/0 (socket says 172.21.15.38:44834) 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56ecc00640 1 -- 172.21.15.38:0/1068780840 learned_addr learned my addr 172.21.15.38:0/1068780840 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56e7400640 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56e7e00640 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56e7400640 1 -- 172.21.15.38:0/1068780840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 msgr2=0x555b927d7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56e7400640 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56e7400640 1 -- 172.21.15.38:0/1068780840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 msgr2=0x555b927dc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56e7400640 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927dc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.343+0000 7f56e7400640 1 -- 172.21.15.38:0/1068780840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b927d8530 con 0x555b927c9590 2024-09-12T12:27:06.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56e7400640 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d77c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x555b927d2360 tx=0x7f56d4010660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a9df9a8086d8cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:06.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56d1600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:27:06.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56d1600640 1 -- 172.21.15.38:0/1068780840 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d409b820 con 0x555b927c9590 2024-09-12T12:27:06.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56d1600640 1 -- 172.21.15.38:0/1068780840 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f56d409aba0 con 0x555b927c9590 2024-09-12T12:27:06.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d8042040 con 0x555b927c9590 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56d1600640 1 -- 172.21.15.38:0/1068780840 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f56d409c3e0 con 0x555b927c9590 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56f1687740 10 client.25525 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.344+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555b9284eba0 con 0x555b927c9590 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56d1600640 1 -- 172.21.15.38:0/1068780840 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d8042040 con 0x555b927c9590 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56d1600640 1 -- 172.21.15.38:0/1068780840 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f56d407ab50 con 0x555b927c9590 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56f1687740 10 client.25525 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56f1687740 10 client.25525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56f1687740 20 client.25525 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56f1687740 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b9284f140 0x555b92851560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56f1687740 4 client.25525 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.345+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b92736e60 con 0x555b9284f140 2024-09-12T12:27:06.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.346+0000 7f56e7e00640 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b9284f140 0x555b92851560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.346+0000 7f56e7e00640 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b9284f140 0x555b92851560 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc6056a0e030cfab server_cookie=4bac964bb0cd688b in_seq=0 out_seq=0 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.346+0000 7f56d1600640 10 client.25525 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.346+0000 7f56d1600640 1 -- 172.21.15.38:0/1068780840 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b92736e60 con 0x555b9284f140 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.346+0000 7f56d1600640 10 client.25525 handle_command_reply: tid=0 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.346+0000 7f56f1687740 1 client.25525 shutdown 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 msgr2=0x555b927d77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d77c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x555b927d2360 tx=0x7f56d4010660 comp rx=0 tx=0).stop 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 shutdown_connections 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555b9284f140 0x555b92851560 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b927d3e50 0x555b927d7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b927c9590 0x555b927d77c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56d1600640 0 client.25525 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 --2- 172.21.15.38:0/1068780840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b927c8c70 0x555b927dc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 >> 172.21.15.38:0/1068780840 conn(0x555b927c5200 msgr2=0x555b927d2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:06.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 shutdown_connections 2024-09-12T12:27:06.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 1 -- 172.21.15.38:0/1068780840 wait complete. 2024-09-12T12:27:06.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.347+0000 7f56f1687740 20 client.25525 trim_cache size 0 max 16384 2024-09-12T12:27:06.350 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f56cc0a2b80 msgr2=0x7f56cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f56cc0a2b80 0x7f56cc0a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x555b927c6060 tx=0x7f56d802c040 comp rx=0 tx=0).stop 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e81049a0 msgr2=0x7f56e819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e81049a0 0x7f56e819ab40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56d400e9f0 tx=0x7f56d400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 shutdown_connections 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f56cc0a2b80 0x7f56cc0a5040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8109120 0x7f56e819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e81049a0 0x7f56e819ab40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 --2- 172.21.15.38:0/1445598220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56e8103ff0 0x7f56e819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:06.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 >> 172.21.15.38:0/1445598220 conn(0x7f56e80ffa90 msgr2=0x7f56e8100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:06.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 shutdown_connections 2024-09-12T12:27:06.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:06.348+0000 7f56eec00640 1 -- 172.21.15.38:0/1445598220 wait complete. 2024-09-12T12:27:06.352 INFO:tasks.workunit.client.0.smithi038.stderr:+ ./fsync-tester 2024-09-12T12:27:06.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:06 smithi154 ceph-mon[35578]: pgmap v428: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:27:06.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:06 smithi071 ceph-mon[34859]: pgmap v428: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:27:08.171 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:27:08.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:27:08.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:08 smithi154 ceph-mon[35578]: pgmap v429: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:27:08.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:08 smithi038 ceph-mon[30810]: pgmap v429: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:27:08.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:08 smithi071 ceph-mon[34859]: pgmap v429: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:27:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:09.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 -- 172.21.15.38:0/585992385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4100980 msgr2=0x7f89b4100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 --2- 172.21.15.38:0/585992385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4100980 0x7f89b4100d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009900 tx=0x7f89a402a470 comp rx=0 tx=0).stop 2024-09-12T12:27:09.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 -- 172.21.15.38:0/585992385 shutdown_connections 2024-09-12T12:27:09.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 --2- 172.21.15.38:0/585992385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4105d90 0x7f89b4106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 --2- 172.21.15.38:0/585992385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b41012a0 0x7f89b4105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 --2- 172.21.15.38:0/585992385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4100980 0x7f89b4100d60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 -- 172.21.15.38:0/585992385 >> 172.21.15.38:0/585992385 conn(0x7f89b40fc610 msgr2=0x7f89b40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:09.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.113+0000 7f89b8a00640 1 -- 172.21.15.38:0/585992385 shutdown_connections 2024-09-12T12:27:09.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.114+0000 7f89b8a00640 1 -- 172.21.15.38:0/585992385 wait complete. 2024-09-12T12:27:09.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.115+0000 7f89b8a00640 1 Processor -- start 2024-09-12T12:27:09.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.115+0000 7f89b8a00640 1 -- start start 2024-09-12T12:27:09.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b8a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4100980 0x7f89b41a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b41012a0 0x7f89b41a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4105d90 0x7f89b419e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b8a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41183c0 con 0x7f89b4105d90 2024-09-12T12:27:09.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b8a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89b4118240 con 0x7f89b41012a0 2024-09-12T12:27:09.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b8a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89b4118540 con 0x7f89b4100980 2024-09-12T12:27:09.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b3200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4105d90 0x7f89b419e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b3200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4105d90 0x7f89b419e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53578/0 (socket says 172.21.15.38:53578) 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b3200640 1 -- 172.21.15.38:0/2396925986 learned_addr learned my addr 172.21.15.38:0/2396925986 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89abe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b41012a0 0x7f89b41a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.116+0000 7f89b2800640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4100980 0x7f89b41a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89b3200640 1 -- 172.21.15.38:0/2396925986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4100980 msgr2=0x7f89b41a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89b3200640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4100980 0x7f89b41a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89b3200640 1 -- 172.21.15.38:0/2396925986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b41012a0 msgr2=0x7f89b41a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89b3200640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b41012a0 0x7f89b41a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89b3200640 1 -- 172.21.15.38:0/2396925986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b419eee0 con 0x7f89b4105d90 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89abe00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b41012a0 0x7f89b41a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89b3200640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4105d90 0x7f89b419e670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00eb10 tx=0x7f89ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89ab400640 1 -- 172.21.15.38:0/2396925986 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac004b20 con 0x7f89b4105d90 2024-09-12T12:27:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89ab400640 1 -- 172.21.15.38:0/2396925986 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89ac004cc0 con 0x7f89b4105d90 2024-09-12T12:27:09.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b419f1d0 con 0x7f89b4105d90 2024-09-12T12:27:09.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.117+0000 7f89ab400640 1 -- 172.21.15.38:0/2396925986 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac010760 con 0x7f89b4105d90 2024-09-12T12:27:09.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.118+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b41ab520 con 0x7f89b4105d90 2024-09-12T12:27:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.121+0000 7f89ab400640 1 -- 172.21.15.38:0/2396925986 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f89ac005020 con 0x7f89b4105d90 2024-09-12T12:27:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.121+0000 7f89bc02e740 1 Processor -- start 2024-09-12T12:27:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.121+0000 7f89bc02e740 1 -- start start 2024-09-12T12:27:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e797090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e7a4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89bc02e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55911e6fd290 con 0x55911e7975d0 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89bc02e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55911e6a4b40 con 0x55911e7a1e90 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89bc02e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55911e6f9250 con 0x55911e796cb0 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89b2800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89b2800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53594/0 (socket says 172.21.15.38:53594) 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89abe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e797090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89b2800640 1 -- 172.21.15.38:0/3746101090 learned_addr learned my addr 172.21.15.38:0/3746101090 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.122+0000 7f89abe00640 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e7a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89b2800640 1 -- 172.21.15.38:0/3746101090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 msgr2=0x55911e797090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89b2800640 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e797090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89b2800640 1 -- 172.21.15.38:0/3746101090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 msgr2=0x55911e7a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89b2800640 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e7a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89b2800640 1 -- 172.21.15.38:0/3746101090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55911e46e6a0 con 0x55911e7975d0 2024-09-12T12:27:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89ab400640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f89980a2b80 0x7f89980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89ab400640 1 -- 172.21.15.38:0/2396925986 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f89ac0cfa90 con 0x7f89b4105d90 2024-09-12T12:27:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89b2800640 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a1950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009900 tx=0x7f89a4005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f73586b7d98f043 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.123+0000 7f89abe00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f89980a2b80 0x7f89980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.124+0000 7f89a3400640 1 -- 172.21.15.38:0/3746101090 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4040070 con 0x55911e7975d0 2024-09-12T12:27:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.124+0000 7f89a3400640 1 -- 172.21.15.38:0/3746101090 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a4031870 con 0x55911e7975d0 2024-09-12T12:27:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.124+0000 7f89a3400640 1 -- 172.21.15.38:0/3746101090 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4035040 con 0x55911e7975d0 2024-09-12T12:27:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.124+0000 7f89bc02e740 1 -- 172.21.15.38:0/3746101090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 msgr2=0x55911e7a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.124+0000 7f89bc02e740 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a1950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009900 tx=0x7f89a4005be0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.124+0000 7f89abe00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f89980a2b80 0x7f89980a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55911e7945c0 tx=0x7f899c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 -- 172.21.15.38:0/3746101090 shutdown_connections 2024-09-12T12:27:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e7a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a1950 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 --2- 172.21.15.38:0/3746101090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e797090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 -- 172.21.15.38:0/3746101090 >> 172.21.15.38:0/3746101090 conn(0x55911e793240 msgr2=0x55911e793620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 -- 172.21.15.38:0/3746101090 shutdown_connections 2024-09-12T12:27:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 -- 172.21.15.38:0/3746101090 wait complete. 2024-09-12T12:27:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.125+0000 7f89bc02e740 1 -- start start 2024-09-12T12:27:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 1 Processor -- start 2024-09-12T12:27:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e7a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e79e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e79eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55911e7a4b00 con 0x55911e7975d0 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55911e6b7fa0 con 0x55911e7a1e90 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55911e7a4c80 con 0x55911e796cb0 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89bc02e740 10 client.0 _ll_register_callbacks cb 0x55911e40bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89abe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e79e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89abe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e79e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53598/0 (socket says 172.21.15.38:53598) 2024-09-12T12:27:09.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89b3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e79eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.126+0000 7f89abe00640 1 -- 172.21.15.38:0/37261640 learned_addr learned my addr 172.21.15.38:0/37261640 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f89b2800640 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e7a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f89b3200640 1 -- 172.21.15.38:0/37261640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 msgr2=0x55911e7a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f89b3200640 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e7a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f89b3200640 1 -- 172.21.15.38:0/37261640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 msgr2=0x55911e79e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f89b3200640 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e79e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f89b3200640 1 -- 172.21.15.38:0/37261640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55911e79f6e0 con 0x55911e7a1e90 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f89b3200640 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e79eed0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0049d0 tx=0x7f89ac09b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf8fa6a3e20b6e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f8997e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.127+0000 7f8997e00640 1 -- 172.21.15.38:0/37261640 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac005510 con 0x55911e7a1e90 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89a4031870 con 0x55911e7a1e90 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f8997e00640 1 -- 172.21.15.38:0/37261640 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f89ac09b330 con 0x55911e7a1e90 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f8997e00640 1 -- 172.21.15.38:0/37261640 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f89ac0a0290 con 0x55911e7a1e90 2024-09-12T12:27:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 10 client.25562 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55911e7b09a0 con 0x55911e7a1e90 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f8997e00640 1 -- 172.21.15.38:0/37261640 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a4031870 con 0x55911e7a1e90 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f8997e00640 1 -- 172.21.15.38:0/37261640 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f89ac097df0 con 0x55911e7a1e90 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 10 client.25562 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 20 client.25562 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e7b1db0 0x55911e7b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 4 client.25562 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.128+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55911e70a800 con 0x55911e7b1db0 2024-09-12T12:27:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.129+0000 7f89b2800640 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e7b1db0 0x55911e7b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.129+0000 7f89b2800640 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e7b1db0 0x55911e7b4250 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216e86a838db8a27 server_cookie=94dc01569c4a0abd in_seq=0 out_seq=0 2024-09-12T12:27:09.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.129+0000 7f8997e00640 10 client.25562 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.130+0000 7f8997e00640 1 -- 172.21.15.38:0/37261640 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55911e70a800 con 0x55911e7b1db0 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.130+0000 7f8997e00640 10 client.25562 handle_command_reply: tid=0 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.130+0000 7f89bc02e740 1 client.25562 shutdown 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.130+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 msgr2=0x55911e79eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.130+0000 7f89bc02e740 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e79eed0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0049d0 tx=0x7f89ac09b840 comp rx=0 tx=0).stop 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 shutdown_connections 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e7b1db0 0x55911e7b4250 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7a1e90 0x55911e79eed0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e79e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 --2- 172.21.15.38:0/37261640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e796cb0 0x55911e7a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 >> 172.21.15.38:0/37261640 conn(0x55911e793240 msgr2=0x55911e798f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f8997e00640 0 client.25562 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 shutdown_connections 2024-09-12T12:27:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 1 -- 172.21.15.38:0/37261640 wait complete. 2024-09-12T12:27:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.131+0000 7f89bc02e740 20 client.25562 trim_cache size 0 max 16384 2024-09-12T12:27:09.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.149+0000 7f89bc02e740 1 Processor -- start 2024-09-12T12:27:09.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.149+0000 7f89bc02e740 1 -- start start 2024-09-12T12:27:09.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e796cb0 0x55911e792160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7975d0 0x55911e7b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e7ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89bc02e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b5140 con 0x55911e796cb0 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89bc02e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b6c80 con 0x55911e7975d0 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89bc02e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b5810 con 0x55911e7a1e90 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89b2800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e796cb0 0x55911e792160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89abe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7975d0 0x55911e7b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89b2800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e796cb0 0x55911e792160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53606/0 (socket says 172.21.15.38:53606) 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89b2800640 1 -- 172.21.15.38:0/4169687653 learned_addr learned my addr 172.21.15.38:0/4169687653 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:09.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.150+0000 7f89b3200640 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e7ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89abe00640 1 -- 172.21.15.38:0/4169687653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 msgr2=0x55911e7ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89abe00640 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e7ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89abe00640 1 -- 172.21.15.38:0/4169687653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e796cb0 msgr2=0x55911e792160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89abe00640 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e796cb0 0x55911e792160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89abe00640 1 -- 172.21.15.38:0/4169687653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55911e79d940 con 0x55911e7975d0 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89b2800640 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e796cb0 0x55911e792160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89b3200640 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e7ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89abe00640 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7975d0 0x55911e7b9b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55911e79ff40 tx=0x7f899c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598ec71df32b4b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89a2a00640 1 -- 172.21.15.38:0/4169687653 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c0204d0 con 0x55911e7975d0 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89a2a00640 1 -- 172.21.15.38:0/4169687653 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f899c031070 con 0x55911e7975d0 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.151+0000 7f89a2a00640 1 -- 172.21.15.38:0/4169687653 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c02c9c0 con 0x55911e7975d0 2024-09-12T12:27:09.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 -- 172.21.15.38:0/4169687653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7975d0 msgr2=0x55911e7b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7975d0 0x55911e7b9b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55911e79ff40 tx=0x7f899c004730 comp rx=0 tx=0).stop 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 -- 172.21.15.38:0/4169687653 shutdown_connections 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e7ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e7975d0 0x55911e7b9b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 --2- 172.21.15.38:0/4169687653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e796cb0 0x55911e792160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 -- 172.21.15.38:0/4169687653 >> 172.21.15.38:0/4169687653 conn(0x55911e793240 msgr2=0x55911e791a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 -- 172.21.15.38:0/4169687653 shutdown_connections 2024-09-12T12:27:09.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.152+0000 7f89bc02e740 1 -- 172.21.15.38:0/4169687653 wait complete. 2024-09-12T12:27:09.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.153+0000 7f89bc02e740 1 -- start start 2024-09-12T12:27:09.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.153+0000 7f89bc02e740 1 Processor -- start 2024-09-12T12:27:09.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.153+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e796cb0 0x55911e7a8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89bc02e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e81bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89bc02e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b65b0 con 0x55911e7975d0 2024-09-12T12:27:09.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89bc02e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b5ee0 con 0x55911e796cb0 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89bc02e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b3120 con 0x55911e7a1e90 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89bc02e740 10 client.0 _ll_register_callbacks cb 0x7f89ac09bcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e796cb0 0x55911e7a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e796cb0 0x55911e7a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:44890/0 (socket says 172.21.15.38:44890) 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 -- 172.21.15.38:0/2547040937 learned_addr learned my addr 172.21.15.38:0/2547040937 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89abe00640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b3200640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e81bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 -- 172.21.15.38:0/2547040937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 msgr2=0x55911e81bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e81bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 -- 172.21.15.38:0/2547040937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 msgr2=0x55911e7a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89b2800640 1 -- 172.21.15.38:0/2547040937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55911e81c040 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.154+0000 7f89abe00640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f89b2800640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e796cb0 0x55911e7a8410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009900 tx=0x7f89a4005380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f165d114e1939e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f8997e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f8997e00640 1 -- 172.21.15.38:0/2547040937 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4040040 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f8997e00640 1 -- 172.21.15.38:0/2547040937 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f89a4004040 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f899c031070 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f8997e00640 1 -- 172.21.15.38:0/2547040937 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f89a4060050 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f89bc02e740 10 client.25568 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.155+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55911e81d3e0 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f8997e00640 1 -- 172.21.15.38:0/2547040937 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f899c031070 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f8997e00640 1 -- 172.21.15.38:0/2547040937 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f89a4050420 con 0x55911e796cb0 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f89bc02e740 10 client.25568 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:09.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f89bc02e740 10 client.25568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:09.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f89bc02e740 20 client.25568 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:09.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f89bc02e740 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e81d7e0 0x55911e81fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:09.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f89bc02e740 4 client.25568 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:27:09.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55911e704d10 con 0x55911e81d7e0 2024-09-12T12:27:09.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.156+0000 7f89abe00640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e81d7e0 0x55911e81fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:09.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.157+0000 7f89abe00640 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e81d7e0 0x55911e81fbd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f35be2815d7b89b2 server_cookie=673639d9154875d7 in_seq=0 out_seq=0 2024-09-12T12:27:09.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.157+0000 7f8997e00640 10 client.25568 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:09.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f8997e00640 1 -- 172.21.15.38:0/2547040937 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55911e704d10 con 0x55911e81d7e0 2024-09-12T12:27:09.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f8997e00640 10 client.25568 handle_command_reply: tid=0 2024-09-12T12:27:09.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 client.25568 shutdown 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e796cb0 msgr2=0x55911e7a8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e796cb0 0x55911e7a8410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009900 tx=0x7f89a4005380 comp rx=0 tx=0).stop 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 shutdown_connections 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55911e81d7e0 0x55911e81fbd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55911e7a1e90 0x55911e81bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55911e7975d0 0x55911e7a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 --2- 172.21.15.38:0/2547040937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55911e796cb0 0x55911e7a8410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 >> 172.21.15.38:0/2547040937 conn(0x55911e793240 msgr2=0x55911e792270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.158+0000 7f8997e00640 0 client.25568 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.159+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 shutdown_connections 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.159+0000 7f89bc02e740 1 -- 172.21.15.38:0/2547040937 wait complete. 2024-09-12T12:27:09.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.159+0000 7f89bc02e740 20 client.25568 trim_cache size 0 max 16384 2024-09-12T12:27:09.162 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:27:09.162 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-12T12:27:09.162 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "c4ad40f7-1837-4e0c-a6c4-6fcf3a78c68b", 2024-09-12T12:27:09.162 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-12T12:27:09.162 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:27:09.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.159+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f89980a2b80 msgr2=0x7f89980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f89980a2b80 0x7f89980a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55911e7945c0 tx=0x7f899c005f90 comp rx=0 tx=0).stop 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4105d90 msgr2=0x7f89b419e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4105d90 0x7f89b419e670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00eb10 tx=0x7f89ac00c2d0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 shutdown_connections 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f89980a2b80 0x7f89980a5040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89b4105d90 0x7f89b419e670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b41012a0 0x7f89b41a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 --2- 172.21.15.38:0/2396925986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b4100980 0x7f89b41a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 >> 172.21.15.38:0/2396925986 conn(0x7f89b40fc610 msgr2=0x7f89b4103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 shutdown_connections 2024-09-12T12:27:09.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:09.160+0000 7f89b8a00640 1 -- 172.21.15.38:0/2396925986 wait complete. 2024-09-12T12:27:10.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:27:10.407 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:10.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:10 smithi154 ceph-mon[35578]: pgmap v430: 129 pgs: 129 active+clean; 1.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 171 KiB/s wr, 12 op/s 2024-09-12T12:27:10.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:10 smithi038 ceph-mon[30810]: pgmap v430: 129 pgs: 129 active+clean; 1.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 171 KiB/s wr, 12 op/s 2024-09-12T12:27:10.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:10 smithi071 ceph-mon[34859]: pgmap v430: 129 pgs: 129 active+clean; 1.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 171 KiB/s wr, 12 op/s 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 -- 172.21.15.38:0/3042141584 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40101dd0 msgr2=0x7f2e401021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 --2- 172.21.15.38:0/3042141584 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40101dd0 0x7f2e401021b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009900 tx=0x7f2e3002a410 comp rx=0 tx=0).stop 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 -- 172.21.15.38:0/3042141584 shutdown_connections 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 --2- 172.21.15.38:0/3042141584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e40106f00 0x7f2e4010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 --2- 172.21.15.38:0/3042141584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e40102780 0x7f2e401067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 --2- 172.21.15.38:0/3042141584 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40101dd0 0x7f2e401021b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 -- 172.21.15.38:0/3042141584 >> 172.21.15.38:0/3042141584 conn(0x7f2e400fd8b0 msgr2=0x7f2e400ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 -- 172.21.15.38:0/3042141584 shutdown_connections 2024-09-12T12:27:10.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.953+0000 7f2e45200640 1 -- 172.21.15.38:0/3042141584 wait complete. 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 Processor -- start 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 -- start start 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e40101dd0 0x7f2e4019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40102780 0x7f2e4019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e40106f00 0x7f2e4019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e40111fb0 con 0x7f2e40102780 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e40111e30 con 0x7f2e40101dd0 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.954+0000 7f2e45200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e40112130 con 0x7f2e40106f00 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40102780 0x7f2e4019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e3de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e40101dd0 0x7f2e4019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40102780 0x7f2e4019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53636/0 (socket says 172.21.15.38:53636) 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 -- 172.21.15.38:0/3546662848 learned_addr learned my addr 172.21.15.38:0/3546662848 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e3e800640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e40106f00 0x7f2e4019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 -- 172.21.15.38:0/3546662848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e40106f00 msgr2=0x7f2e4019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e40106f00 0x7f2e4019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 -- 172.21.15.38:0/3546662848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e40101dd0 msgr2=0x7f2e4019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e40101dd0 0x7f2e4019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e37e00640 1 -- 172.21.15.38:0/3546662848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4019f660 con 0x7f2e40102780 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.955+0000 7f2e3e800640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e40106f00 0x7f2e4019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.956+0000 7f2e37e00640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40102780 0x7f2e4019abf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800e9f0 tx=0x7f2e2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:10.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.956+0000 7f2e36a00640 1 -- 172.21.15.38:0/3546662848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800cd80 con 0x7f2e40102780 2024-09-12T12:27:10.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.956+0000 7f2e36a00640 1 -- 172.21.15.38:0/3546662848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e28005500 con 0x7f2e40102780 2024-09-12T12:27:10.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.956+0000 7f2e36a00640 1 -- 172.21.15.38:0/3546662848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28010690 con 0x7f2e40102780 2024-09-12T12:27:10.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.956+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4019f950 con 0x7f2e40102780 2024-09-12T12:27:10.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.956+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e401a7230 con 0x7f2e40102780 2024-09-12T12:27:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.959+0000 7f2e36a00640 1 -- 172.21.15.38:0/3546662848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2e280046c0 con 0x7f2e40102780 2024-09-12T12:27:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.959+0000 7f2e47c65740 1 Processor -- start 2024-09-12T12:27:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.959+0000 7f2e47c65740 1 -- start start 2024-09-12T12:27:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e9228f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e9233830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9236160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e47c65740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5650e918f3e0 con 0x5650e92294b0 2024-09-12T12:27:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e47c65740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5650e9136d80 con 0x5650e9228b90 2024-09-12T12:27:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e47c65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5650e918b3a0 con 0x5650e9233d70 2024-09-12T12:27:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e3de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e9233830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e3de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e9233830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53648/0 (socket says 172.21.15.38:53648) 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e3de00640 1 -- 172.21.15.38:0/803901187 learned_addr learned my addr 172.21.15.38:0/803901187 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e37e00640 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9236160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.960+0000 7f2e3e800640 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e9228f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e3de00640 1 -- 172.21.15.38:0/803901187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 msgr2=0x5650e9236160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e3de00640 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9236160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e3de00640 1 -- 172.21.15.38:0/803901187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 msgr2=0x5650e9228f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e3de00640 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e9228f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e3de00640 1 -- 172.21.15.38:0/803901187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e9155ae0 con 0x5650e92294b0 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e36a00640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2e240a2b80 0x7f2e240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e36a00640 1 -- 172.21.15.38:0/3546662848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2e280cf830 con 0x7f2e40102780 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e3de00640 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e9233830 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009900 tx=0x7f2e30004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5363a2c7171a3ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.961+0000 7f2e3e800640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2e240a2b80 0x7f2e240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.962+0000 7f2e2f400640 1 -- 172.21.15.38:0/803901187 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30035040 con 0x5650e92294b0 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.962+0000 7f2e2f400640 1 -- 172.21.15.38:0/803901187 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e30005520 con 0x5650e92294b0 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.962+0000 7f2e2f400640 1 -- 172.21.15.38:0/803901187 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30003850 con 0x5650e92294b0 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.962+0000 7f2e47c65740 1 -- 172.21.15.38:0/803901187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 msgr2=0x5650e9233830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.962+0000 7f2e47c65740 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e9233830 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009900 tx=0x7f2e30004040 comp rx=0 tx=0).stop 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.962+0000 7f2e3e800640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2e240a2b80 0x7f2e240a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2e38005fd0 tx=0x7f2e38009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 -- 172.21.15.38:0/803901187 shutdown_connections 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9236160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e9233830 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 --2- 172.21.15.38:0/803901187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e9228f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 -- 172.21.15.38:0/803901187 >> 172.21.15.38:0/803901187 conn(0x5650e9225120 msgr2=0x5650e9225500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:10.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 -- 172.21.15.38:0/803901187 shutdown_connections 2024-09-12T12:27:10.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 -- 172.21.15.38:0/803901187 wait complete. 2024-09-12T12:27:10.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.963+0000 7f2e47c65740 1 -- start start 2024-09-12T12:27:10.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 1 Processor -- start 2024-09-12T12:27:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9228b90 0x5650e9230c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e92294b0 0x5650e9231170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9233d70 0x5650e92316b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5650e92369e0 con 0x5650e9228b90 2024-09-12T12:27:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5650e914a0f0 con 0x5650e9233d70 2024-09-12T12:27:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5650e9236b60 con 0x5650e92294b0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.964+0000 7f2e47c65740 10 client.0 _ll_register_callbacks cb 0x5650e913b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e92294b0 0x5650e9231170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e92294b0 0x5650e9231170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:54660/0 (socket says 172.21.15.38:54660) 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 -- 172.21.15.38:0/3421447122 learned_addr learned my addr 172.21.15.38:0/3421447122 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e3e800640 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9233d70 0x5650e92316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e3de00640 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9228b90 0x5650e9230c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 -- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9233d70 msgr2=0x5650e92316b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9233d70 0x5650e92316b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 -- 172.21.15.38:0/3421447122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9228b90 msgr2=0x5650e9230c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9228b90 0x5650e9230c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.965+0000 7f2e37e00640 1 -- 172.21.15.38:0/3421447122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e8f003c0 con 0x5650e92294b0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e37e00640 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e92294b0 0x5650e9231170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2e2809b980 tx=0x7f2e28097fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b799d9e8d07e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e23e00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:27:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e23e00640 1 -- 172.21.15.38:0/3421447122 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e280a4660 con 0x5650e92294b0 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e23e00640 1 -- 172.21.15.38:0/3421447122 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2e2809b0d0 con 0x5650e92294b0 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e30005520 con 0x5650e92294b0 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e23e00640 1 -- 172.21.15.38:0/3421447122 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2e2809c380 con 0x5650e92294b0 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e47c65740 10 client.25555 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5650e9242710 con 0x5650e92294b0 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.966+0000 7f2e23e00640 1 -- 172.21.15.38:0/3421447122 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e30005520 con 0x5650e92294b0 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e23e00640 1 -- 172.21.15.38:0/3421447122 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f2e2809ab40 con 0x5650e92294b0 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e47c65740 10 client.25555 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e47c65740 10 client.25555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e47c65740 20 client.25555 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e47c65740 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e9243b20 0x5650e9245f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e47c65740 4 client.25555 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650e919c950 con 0x5650e9243b20 2024-09-12T12:27:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.967+0000 7f2e3de00640 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e9243b20 0x5650e9245f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.968+0000 7f2e3de00640 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e9243b20 0x5650e9245f10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d856b854e96c506 server_cookie=65bbcb5801588009 in_seq=0 out_seq=0 2024-09-12T12:27:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.968+0000 7f2e23e00640 10 client.25555 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.969+0000 7f2e23e00640 1 -- 172.21.15.38:0/3421447122 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650e919c950 con 0x5650e9243b20 2024-09-12T12:27:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.969+0000 7f2e23e00640 10 client.25555 handle_command_reply: tid=0 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.969+0000 7f2e47c65740 1 client.25555 shutdown 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.969+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e92294b0 msgr2=0x5650e9231170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.969+0000 7f2e47c65740 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e92294b0 0x5650e9231170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2e2809b980 tx=0x7f2e28097fe0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 shutdown_connections 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e9243b20 0x5650e9245f10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9233d70 0x5650e92316b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e92294b0 0x5650e9231170 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 --2- 172.21.15.38:0/3421447122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9228b90 0x5650e9230c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e23e00640 0 client.25555 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 >> 172.21.15.38:0/3421447122 conn(0x5650e9225120 msgr2=0x5650e922ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 shutdown_connections 2024-09-12T12:27:10.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.970+0000 7f2e47c65740 1 -- 172.21.15.38:0/3421447122 wait complete. 2024-09-12T12:27:10.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.971+0000 7f2e47c65740 20 client.25555 trim_cache size 0 max 16384 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.990+0000 7f2e47c65740 1 Processor -- start 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.990+0000 7f2e47c65740 1 -- start start 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9228b90 0x5650e9225500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e92294b0 0x5650e924b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9233d70 0x5650e924bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e47c65740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e401b0f10 con 0x5650e9233d70 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e47c65740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e401b2a50 con 0x5650e92294b0 2024-09-12T12:27:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e47c65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e401b15e0 con 0x5650e9228b90 2024-09-12T12:27:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3e800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9233d70 0x5650e924bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9228b90 0x5650e9225500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e92294b0 0x5650e924b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9228b90 0x5650e9225500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:54664/0 (socket says 172.21.15.38:54664) 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3e800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9233d70 0x5650e924bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53676/0 (socket says 172.21.15.38:53676) 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 -- 172.21.15.38:0/4032156556 learned_addr learned my addr 172.21.15.38:0/4032156556 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 -- 172.21.15.38:0/4032156556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e92294b0 msgr2=0x5650e924b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 --2- 172.21.15.38:0/4032156556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e92294b0 0x5650e924b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 -- 172.21.15.38:0/4032156556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9233d70 msgr2=0x5650e924bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 --2- 172.21.15.38:0/4032156556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9233d70 0x5650e924bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.991+0000 7f2e3de00640 1 -- 172.21.15.38:0/4032156556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e922fc00 con 0x5650e9228b90 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.992+0000 7f2e3de00640 1 --2- 172.21.15.38:0/4032156556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9228b90 0x5650e9225500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5650e9225f80 tx=0x7f2e30004cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a166e0e6ccd5a8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.992+0000 7f2e2ea00640 1 -- 172.21.15.38:0/4032156556 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30035030 con 0x5650e9228b90 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.992+0000 7f2e2ea00640 1 -- 172.21.15.38:0/4032156556 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e300048c0 con 0x5650e9228b90 2024-09-12T12:27:10.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.992+0000 7f2e2ea00640 1 -- 172.21.15.38:0/4032156556 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30031810 con 0x5650e9228b90 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 -- 172.21.15.38:0/4032156556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9228b90 msgr2=0x5650e9225500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 --2- 172.21.15.38:0/4032156556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9228b90 0x5650e9225500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5650e9225f80 tx=0x7f2e30004cc0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 -- 172.21.15.38:0/4032156556 shutdown_connections 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 --2- 172.21.15.38:0/4032156556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e9233d70 0x5650e924bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 --2- 172.21.15.38:0/4032156556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e92294b0 0x5650e924b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 --2- 172.21.15.38:0/4032156556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9228b90 0x5650e9225500 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 -- 172.21.15.38:0/4032156556 >> 172.21.15.38:0/4032156556 conn(0x5650e9225120 msgr2=0x5650e9232cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 -- 172.21.15.38:0/4032156556 shutdown_connections 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.993+0000 7f2e47c65740 1 -- 172.21.15.38:0/4032156556 wait complete. 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 -- start start 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 Processor -- start 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e923bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e923c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9238d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e401b2380 con 0x5650e92294b0 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e401b1cb0 con 0x5650e9228b90 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e401aeef0 con 0x5650e9233d70 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e47c65740 10 client.0 _ll_register_callbacks cb 0x7f2e280056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.994+0000 7f2e3de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e923bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e923c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e923bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:44928/0 (socket says 172.21.15.38:44928) 2024-09-12T12:27:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 -- 172.21.15.38:0/699085372 learned_addr learned my addr 172.21.15.38:0/699085372 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3e800640 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9238d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 -- 172.21.15.38:0/699085372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 msgr2=0x5650e9238d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9238d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 -- 172.21.15.38:0/699085372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 msgr2=0x5650e923c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e923c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 -- 172.21.15.38:0/699085372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e9246280 con 0x5650e9228b90 2024-09-12T12:27:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e37e00640 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e923c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e3de00640 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e923bdb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2e3002a930 tx=0x7f2e30031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bd8e134a8222bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.995+0000 7f2e23e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.996+0000 7f2e23e00640 1 -- 172.21.15.38:0/699085372 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30035040 con 0x5650e9228b90 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.996+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e300048c0 con 0x5650e9228b90 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.996+0000 7f2e23e00640 1 -- 172.21.15.38:0/699085372 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f2e30004a70 con 0x5650e9228b90 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.996+0000 7f2e23e00640 1 -- 172.21.15.38:0/699085372 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2e30065050 con 0x5650e9228b90 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.996+0000 7f2e47c65740 10 client.25586 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.996+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5650e92aec20 con 0x5650e9228b90 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.996+0000 7f2e23e00640 1 -- 172.21.15.38:0/699085372 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e300048c0 con 0x5650e9228b90 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e23e00640 1 -- 172.21.15.38:0/699085372 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f2e30031bf0 con 0x5650e9228b90 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e47c65740 10 client.25586 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e47c65740 10 client.25586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e47c65740 20 client.25586 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e47c65740 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e92aee50 0x5650e92b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e47c65740 4 client.25586 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5650e9196e60 con 0x5650e92aee50 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.997+0000 7f2e37e00640 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e92aee50 0x5650e92b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e37e00640 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e92aee50 0x5650e92b1240 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56a081442c8ccac2 server_cookie=36082185c78280d in_seq=0 out_seq=0 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e23e00640 10 client.25586 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e23e00640 1 -- 172.21.15.38:0/699085372 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5650e9196e60 con 0x5650e92aee50 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e23e00640 10 client.25586 handle_command_reply: tid=0 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 client.25586 shutdown 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 msgr2=0x5650e923bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e923bdb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2e3002a930 tx=0x7f2e30031400 comp rx=0 tx=0).stop 2024-09-12T12:27:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 shutdown_connections 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5650e92aee50 0x5650e92b1240 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650e9233d70 0x5650e9238d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650e92294b0 0x5650e923c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 --2- 172.21.15.38:0/699085372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650e9228b90 0x5650e923bdb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 >> 172.21.15.38:0/699085372 conn(0x5650e9225120 msgr2=0x5650e9230bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e23e00640 0 client.25586 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 shutdown_connections 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.998+0000 7f2e47c65740 1 -- 172.21.15.38:0/699085372 wait complete. 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e47c65740 20 client.25586 trim_cache size 0 max 16384 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:27:11.002 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: "c4ad40f7-1837-4e0c-a6c4-6fcf3a78c68b": { 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "c4ad40f7-1837-4e0c-a6c4-6fcf3a78c68b", 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:27:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2e240a2b80 msgr2=0x7f2e240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2e240a2b80 0x7f2e240a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2e38005fd0 tx=0x7f2e38009600 comp rx=0 tx=0).stop 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40102780 msgr2=0x7f2e4019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40102780 0x7f2e4019abf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800e9f0 tx=0x7f2e2800edf0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 shutdown_connections 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f2e240a2b80 0x7f2e240a5040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e40106f00 0x7f2e4019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e40102780 0x7f2e4019abf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 --2- 172.21.15.38:0/3546662848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e40101dd0 0x7f2e4019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:10.999+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 >> 172.21.15.38:0/3546662848 conn(0x7f2e400fd8b0 msgr2=0x7f2e400feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:11.000+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 shutdown_connections 2024-09-12T12:27:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:11.000+0000 7f2e45200640 1 -- 172.21.15.38:0/3546662848 wait complete. 2024-09-12T12:27:11.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:11 smithi038 ceph-mon[30810]: scrub queued for path: / 2024-09-12T12:27:11.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:11 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:11.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:11 smithi038 ceph-mon[30810]: scrub summary: active paths [/] 2024-09-12T12:27:11.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:11 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:11.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:11 smithi154 ceph-mon[35578]: scrub queued for path: / 2024-09-12T12:27:11.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:11 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:11.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:11 smithi154 ceph-mon[35578]: scrub summary: active paths [/] 2024-09-12T12:27:11.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:11 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:11 smithi071 ceph-mon[34859]: scrub queued for path: / 2024-09-12T12:27:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:11 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:11 smithi071 ceph-mon[34859]: scrub summary: active paths [/] 2024-09-12T12:27:11.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:11 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:11.796 INFO:tasks.cephfs.filesystem:scrub status for tag:c4ad40f7-1837-4e0c-a6c4-6fcf3a78c68b - {'path': '/', 'tag': 'c4ad40f7-1837-4e0c-a6c4-6fcf3a78c68b', 'options': 'recursive,force'} 2024-09-12T12:27:12.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:12 smithi154 ceph-mon[35578]: pgmap v431: 129 pgs: 129 active+clean; 1.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 171 KiB/s wr, 8 op/s 2024-09-12T12:27:12.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:12 smithi038 ceph-mon[30810]: pgmap v431: 129 pgs: 129 active+clean; 1.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 171 KiB/s wr, 8 op/s 2024-09-12T12:27:12.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:12 smithi071 ceph-mon[34859]: pgmap v431: 129 pgs: 129 active+clean; 1.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 171 KiB/s wr, 8 op/s 2024-09-12T12:27:14.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:14 smithi154 ceph-mon[35578]: pgmap v432: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 177 KiB/s wr, 13 op/s 2024-09-12T12:27:14.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:14 smithi154 ceph-mon[35578]: scrub summary: idle 2024-09-12T12:27:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:14 smithi038 ceph-mon[30810]: pgmap v432: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 177 KiB/s wr, 13 op/s 2024-09-12T12:27:14.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:14 smithi038 ceph-mon[30810]: scrub summary: idle 2024-09-12T12:27:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:14 smithi071 ceph-mon[34859]: pgmap v432: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 177 KiB/s wr, 13 op/s 2024-09-12T12:27:14.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:14 smithi071 ceph-mon[34859]: scrub summary: idle 2024-09-12T12:27:16.416 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:16 smithi154 ceph-mon[35578]: pgmap v433: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 519 KiB/s wr, 12 op/s 2024-09-12T12:27:16.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:16 smithi038 ceph-mon[30810]: pgmap v433: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 519 KiB/s wr, 12 op/s 2024-09-12T12:27:16.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:16 smithi071 ceph-mon[34859]: pgmap v433: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 519 KiB/s wr, 12 op/s 2024-09-12T12:27:18.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:18 smithi154 ceph-mon[35578]: pgmap v434: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 519 KiB/s wr, 11 op/s 2024-09-12T12:27:18.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:18 smithi038 ceph-mon[30810]: pgmap v434: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 519 KiB/s wr, 11 op/s 2024-09-12T12:27:18.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:18 smithi071 ceph-mon[34859]: pgmap v434: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 519 KiB/s wr, 11 op/s 2024-09-12T12:27:20.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:20 smithi154 ceph-mon[35578]: pgmap v435: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 948 KiB/s wr, 16 op/s 2024-09-12T12:27:20.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:20 smithi038 ceph-mon[30810]: pgmap v435: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 948 KiB/s wr, 16 op/s 2024-09-12T12:27:20.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:20 smithi071 ceph-mon[34859]: pgmap v435: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 948 KiB/s wr, 16 op/s 2024-09-12T12:27:22.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:22 smithi154 ceph-mon[35578]: pgmap v436: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 777 KiB/s wr, 12 op/s 2024-09-12T12:27:22.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:22 smithi038 ceph-mon[30810]: pgmap v436: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 777 KiB/s wr, 12 op/s 2024-09-12T12:27:22.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:22 smithi071 ceph-mon[34859]: pgmap v436: 129 pgs: 129 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 777 KiB/s wr, 12 op/s 2024-09-12T12:27:24.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:24 smithi154 ceph-mon[35578]: pgmap v437: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 780 KiB/s wr, 15 op/s 2024-09-12T12:27:24.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:24 smithi038 ceph-mon[30810]: pgmap v437: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 780 KiB/s wr, 15 op/s 2024-09-12T12:27:24.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:24 smithi071 ceph-mon[34859]: pgmap v437: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 780 KiB/s wr, 15 op/s 2024-09-12T12:27:25.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:25 smithi154 ceph-mon[35578]: pgmap v438: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-12T12:27:25.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:25 smithi038 ceph-mon[30810]: pgmap v438: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-12T12:27:25.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:25 smithi071 ceph-mon[34859]: pgmap v438: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-12T12:27:27.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:27 smithi038 ceph-mon[30810]: pgmap v439: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 859 KiB/s wr, 10 op/s 2024-09-12T12:27:27.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:27 smithi071 ceph-mon[34859]: pgmap v439: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 859 KiB/s wr, 10 op/s 2024-09-12T12:27:27.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:27 smithi154 ceph-mon[35578]: pgmap v439: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 859 KiB/s wr, 10 op/s 2024-09-12T12:27:29.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:29 smithi038 ceph-mon[30810]: pgmap v440: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T12:27:29.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:29 smithi071 ceph-mon[34859]: pgmap v440: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T12:27:29.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:29 smithi154 ceph-mon[35578]: pgmap v440: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T12:27:31.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:31 smithi038 ceph-mon[30810]: pgmap v441: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:27:31.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:31 smithi071 ceph-mon[34859]: pgmap v441: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:27:31.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:31 smithi154 ceph-mon[35578]: pgmap v441: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:27:33.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:33 smithi038 ceph-mon[30810]: pgmap v442: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-12T12:27:33.513 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:33 smithi071 ceph-mon[34859]: pgmap v442: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-12T12:27:33.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:33 smithi154 ceph-mon[35578]: pgmap v442: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-12T12:27:35.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:35 smithi038 ceph-mon[30810]: pgmap v443: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-12T12:27:35.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:35 smithi071 ceph-mon[34859]: pgmap v443: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-12T12:27:35.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:35 smithi154 ceph-mon[35578]: pgmap v443: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-12T12:27:37.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:37 smithi038 ceph-mon[30810]: pgmap v444: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:27:37.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:37 smithi071 ceph-mon[34859]: pgmap v444: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:27:37.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:37 smithi154 ceph-mon[35578]: pgmap v444: 129 pgs: 129 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:27:39.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:39 smithi038 ceph-mon[30810]: pgmap v445: 129 pgs: 129 active+clean; 122 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-09-12T12:27:39.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:39 smithi071 ceph-mon[34859]: pgmap v445: 129 pgs: 129 active+clean; 122 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-09-12T12:27:39.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:39 smithi154 ceph-mon[35578]: pgmap v445: 129 pgs: 129 active+clean; 122 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-09-12T12:27:41.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:41 smithi071 ceph-mon[34859]: pgmap v446: 129 pgs: 129 active+clean; 122 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-12T12:27:41.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:41 smithi154 ceph-mon[35578]: pgmap v446: 129 pgs: 129 active+clean; 122 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-12T12:27:41.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:41 smithi038 ceph-mon[30810]: pgmap v446: 129 pgs: 129 active+clean; 122 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-12T12:27:41.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:27:42.199 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.778+0000 7ff161200640 1 -- 172.21.15.38:0/449309954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 msgr2=0x7ff15c110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.778+0000 7ff161200640 1 --2- 172.21.15.38:0/449309954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 0x7ff15c110cc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff154009ca0 tx=0x7ff15402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.779+0000 7ff161200640 1 -- 172.21.15.38:0/449309954 shutdown_connections 2024-09-12T12:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.779+0000 7ff161200640 1 --2- 172.21.15.38:0/449309954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 0x7ff15c110cc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.779+0000 7ff161200640 1 --2- 172.21.15.38:0/449309954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c1049c0 0x7ff15c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.779+0000 7ff161200640 1 --2- 172.21.15.38:0/449309954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff15c104010 0x7ff15c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.779+0000 7ff161200640 1 -- 172.21.15.38:0/449309954 >> 172.21.15.38:0/449309954 conn(0x7ff15c0ffa50 msgr2=0x7ff15c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.779+0000 7ff161200640 1 -- 172.21.15.38:0/449309954 shutdown_connections 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.779+0000 7ff161200640 1 -- 172.21.15.38:0/449309954 wait complete. 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 Processor -- start 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 -- start start 2024-09-12T12:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c104010 0x7ff15c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff15c1049c0 0x7ff15c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 0x7ff15c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1141c0 con 0x7ff15c109140 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c114040 con 0x7ff15c104010 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.780+0000 7ff161200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c114340 con 0x7ff15c1049c0 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c104010 0x7ff15c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff15c1049c0 0x7ff15c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c104010 0x7ff15c19a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:48818/0 (socket says 172.21.15.38:48818) 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 -- 172.21.15.38:0/4250151572 learned_addr learned my addr 172.21.15.38:0/4250151572 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff15a800640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 0x7ff15c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 -- 172.21.15.38:0/4250151572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff15c1049c0 msgr2=0x7ff15c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff15c1049c0 0x7ff15c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 -- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 msgr2=0x7ff15c19ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 0x7ff15c19ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 -- 172.21.15.38:0/4250151572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15c19f670 con 0x7ff15c104010 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.781+0000 7ff159e00640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c104010 0x7ff15c19a6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00d770 tx=0x7ff14c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.782+0000 7ff152a00640 1 -- 172.21.15.38:0/4250151572 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c017070 con 0x7ff15c104010 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.782+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15c19f960 con 0x7ff15c104010 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.782+0000 7ff152a00640 1 -- 172.21.15.38:0/4250151572 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c005500 con 0x7ff15c104010 2024-09-12T12:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.782+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15c1a7240 con 0x7ff15c104010 2024-09-12T12:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.782+0000 7ff152a00640 1 -- 172.21.15.38:0/4250151572 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c020060 con 0x7ff15c104010 2024-09-12T12:27:42.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.785+0000 7ff163dea740 1 Processor -- start 2024-09-12T12:27:42.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.785+0000 7ff152a00640 1 -- 172.21.15.38:0/4250151572 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff14c009c30 con 0x7ff15c104010 2024-09-12T12:27:42.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.785+0000 7ff163dea740 1 -- start start 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff163dea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d4191b90 0x5637d4191f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff163dea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d419c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff163dea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d419f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff163dea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5637d40f83e0 con 0x5637d4191b90 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff163dea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5637d409fd80 con 0x5637d419cd70 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff163dea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5637d40f43a0 con 0x5637d41924b0 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff159e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff15a800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d4191b90 0x5637d4191f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff15a800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d4191b90 0x5637d4191f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59210/0 (socket says 172.21.15.38:59210) 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff15a800640 1 -- 172.21.15.38:0/135298502 learned_addr learned my addr 172.21.15.38:0/135298502 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.786+0000 7ff159400640 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d419f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff159e00640 1 -- 172.21.15.38:0/135298502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 msgr2=0x5637d419f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff159e00640 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d419f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff159e00640 1 -- 172.21.15.38:0/135298502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d4191b90 msgr2=0x5637d4191f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff159e00640 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d4191b90 0x5637d4191f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff159e00640 1 -- 172.21.15.38:0/135298502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d40beae0 con 0x5637d41924b0 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff159400640 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff159e00640 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d419c830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0cc3b0 tx=0x7ff14c0d2ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afbb547ea865e983 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff152a00640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1400a2c00 0x7ff1400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff152a00640 1 -- 172.21.15.38:0/4250151572 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff14c0ced20 con 0x7ff15c104010 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.787+0000 7ff147400640 1 -- 172.21.15.38:0/135298502 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c097410 con 0x5637d41924b0 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.788+0000 7ff15a800640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1400a2c00 0x7ff1400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.788+0000 7ff147400640 1 -- 172.21.15.38:0/135298502 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c0dc070 con 0x5637d41924b0 2024-09-12T12:27:42.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.788+0000 7ff147400640 1 -- 172.21.15.38:0/135298502 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c09aad0 con 0x5637d41924b0 2024-09-12T12:27:42.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 -- 172.21.15.38:0/135298502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 msgr2=0x5637d419c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff15a800640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1400a2c00 0x7ff1400a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff15402f540 tx=0x7ff15402f3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d419c830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0cc3b0 tx=0x7ff14c0d2ee0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 -- 172.21.15.38:0/135298502 shutdown_connections 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d419c830 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 --2- 172.21.15.38:0/135298502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d4191b90 0x5637d4191f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 -- 172.21.15.38:0/135298502 >> 172.21.15.38:0/135298502 conn(0x5637d418e120 msgr2=0x5637d418e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 -- 172.21.15.38:0/135298502 shutdown_connections 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.789+0000 7ff163dea740 1 -- 172.21.15.38:0/135298502 wait complete. 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.790+0000 7ff163dea740 1 -- start start 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.790+0000 7ff163dea740 1 Processor -- start 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff163dea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d4199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff163dea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff163dea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d419cd70 0x5637d419a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff163dea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5637d419f9e0 con 0x5637d41924b0 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff163dea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5637d40b30f0 con 0x5637d4191b90 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff163dea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5637d419fb60 con 0x5637d419cd70 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff163dea740 10 client.0 _ll_register_callbacks cb 0x5637d40a49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff159e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d4199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff159e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d4199cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:48850/0 (socket says 172.21.15.38:48850) 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff159e00640 1 -- 172.21.15.38:0/3474072004 learned_addr learned my addr 172.21.15.38:0/3474072004 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff159400640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.791+0000 7ff15a800640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d419cd70 0x5637d419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff159400640 1 -- 172.21.15.38:0/3474072004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d419cd70 msgr2=0x5637d419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff159400640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d419cd70 0x5637d419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff159400640 1 -- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 msgr2=0x5637d4199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff159400640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d4199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff159400640 1 -- 172.21.15.38:0/3474072004 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d3e693c0 con 0x5637d41924b0 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff159e00640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d4199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff159400640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d419a1f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff15c10aab0 tx=0x7ff148012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5ece9d01247d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff13be00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff13be00640 1 -- 172.21.15.38:0/3474072004 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148004050 con 0x5637d41924b0 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff13be00640 1 -- 172.21.15.38:0/3474072004 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff1480041f0 con 0x5637d41924b0 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.792+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff14c0dc070 con 0x5637d41924b0 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff13be00640 1 -- 172.21.15.38:0/3474072004 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff148025050 con 0x5637d41924b0 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 10 client.15591 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5637d41ab7e0 con 0x5637d41924b0 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff13be00640 1 -- 172.21.15.38:0/3474072004 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c0dc070 con 0x5637d41924b0 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff13be00640 1 -- 172.21.15.38:0/3474072004 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff14800f820 con 0x5637d41924b0 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 10 client.15591 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 20 client.15591 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d41acca0 0x5637d41af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 4 client.15591 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.793+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637d4105950 con 0x5637d41acca0 2024-09-12T12:27:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.794+0000 7ff159e00640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d41acca0 0x5637d41af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.795+0000 7ff159e00640 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d41acca0 0x5637d41af0b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7da8a90fa170ab1 server_cookie=664776dd227d240a in_seq=0 out_seq=0 2024-09-12T12:27:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.795+0000 7ff13be00640 10 client.15591 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.795+0000 7ff13be00640 1 -- 172.21.15.38:0/3474072004 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637d4105950 con 0x5637d41acca0 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.795+0000 7ff13be00640 10 client.15591 handle_command_reply: tid=0 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.795+0000 7ff163dea740 1 client.15591 shutdown 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 msgr2=0x5637d419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d419a1f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff15c10aab0 tx=0x7ff148012aa0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 shutdown_connections 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d41acca0 0x5637d41af0b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d419cd70 0x5637d419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d419a1f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 --2- 172.21.15.38:0/3474072004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d4199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff13be00640 0 client.15591 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 >> 172.21.15.38:0/3474072004 conn(0x5637d418e120 msgr2=0x5637d4193e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 shutdown_connections 2024-09-12T12:27:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 1 -- 172.21.15.38:0/3474072004 wait complete. 2024-09-12T12:27:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.796+0000 7ff163dea740 20 client.15591 trim_cache size 0 max 16384 2024-09-12T12:27:42.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 Processor -- start 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 -- start start 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d41b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d41b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d419cd70 0x5637d4196f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c00fbd0 con 0x5637d419cd70 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c011710 con 0x5637d4191b90 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.815+0000 7ff163dea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c0102a0 con 0x5637d41924b0 2024-09-12T12:27:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d41b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d41b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:48862/0 (socket says 172.21.15.38:48862) 2024-09-12T12:27:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 -- 172.21.15.38:0/3959747036 learned_addr learned my addr 172.21.15.38:0/3959747036 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff15a800640 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d419cd70 0x5637d4196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159400640 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d41b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 -- 172.21.15.38:0/3959747036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 msgr2=0x5637d41b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d41b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 -- 172.21.15.38:0/3959747036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d419cd70 msgr2=0x5637d4196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d419cd70 0x5637d4196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 -- 172.21.15.38:0/3959747036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d419f4a0 con 0x5637d4191b90 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.816+0000 7ff159e00640 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d41b49c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00dfd0 tx=0x7ff14c0bb040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=707ecd3367aa6706 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.817+0000 7ff146a00640 1 -- 172.21.15.38:0/3959747036 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b3020 con 0x5637d4191b90 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.817+0000 7ff146a00640 1 -- 172.21.15.38:0/3959747036 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c0dc040 con 0x5637d4191b90 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.817+0000 7ff146a00640 1 -- 172.21.15.38:0/3959747036 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0d1040 con 0x5637d4191b90 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.817+0000 7ff163dea740 1 -- 172.21.15.38:0/3959747036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 msgr2=0x5637d41b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.817+0000 7ff163dea740 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d41b49c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00dfd0 tx=0x7ff14c0bb040 comp rx=0 tx=0).stop 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 -- 172.21.15.38:0/3959747036 shutdown_connections 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d419cd70 0x5637d4196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d41924b0 0x5637d41b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 --2- 172.21.15.38:0/3959747036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d4191b90 0x5637d41b49c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 -- 172.21.15.38:0/3959747036 >> 172.21.15.38:0/3959747036 conn(0x5637d418e120 msgr2=0x5637d4193e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 -- 172.21.15.38:0/3959747036 shutdown_connections 2024-09-12T12:27:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 -- 172.21.15.38:0/3959747036 wait complete. 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 -- start start 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.818+0000 7ff163dea740 1 Processor -- start 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff163dea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d4191b90 0x5637d41a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff163dea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d41a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff163dea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d41a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff163dea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c011040 con 0x5637d41924b0 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff163dea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c010970 con 0x5637d419cd70 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff163dea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c00dbb0 con 0x5637d4191b90 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff163dea740 10 client.0 _ll_register_callbacks cb 0x7ff148009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff159400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d41a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff159400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d41a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59232/0 (socket says 172.21.15.38:59232) 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff159400640 1 -- 172.21.15.38:0/492282333 learned_addr learned my addr 172.21.15.38:0/492282333 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.819+0000 7ff15a800640 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d41a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff159400640 1 -- 172.21.15.38:0/492282333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d4191b90 msgr2=0x5637d41a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff159400640 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d4191b90 0x5637d41a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff159400640 1 -- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 msgr2=0x5637d41a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff159400640 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d41a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff159400640 1 -- 172.21.15.38:0/492282333 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d41a1b00 con 0x5637d41924b0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff159400640 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d41a5390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5637d419b260 tx=0x7ff1480053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c163d9d47f580bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff13be00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff13be00640 1 -- 172.21.15.38:0/492282333 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14800f9f0 con 0x5637d41924b0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff13be00640 1 -- 172.21.15.38:0/492282333 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff1480035f0 con 0x5637d41924b0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.820+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff14c0dc040 con 0x5637d41924b0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff13be00640 1 -- 172.21.15.38:0/492282333 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff148038050 con 0x5637d41924b0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 10 client.15597 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5637d4218420 con 0x5637d41924b0 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff13be00640 1 -- 172.21.15.38:0/492282333 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c0dc040 con 0x5637d41924b0 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff13be00640 1 -- 172.21.15.38:0/492282333 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff148028040 con 0x5637d41924b0 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 10 client.15597 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 20 client.15597 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d4218bc0 0x5637d421afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 4 client.15597 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.821+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5637d40ffe60 con 0x5637d4218bc0 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.822+0000 7ff159e00640 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d4218bc0 0x5637d421afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.822+0000 7ff159e00640 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d4218bc0 0x5637d421afe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f6c1dd0a8a8433 server_cookie=8d7ecae0c879e313 in_seq=0 out_seq=0 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.822+0000 7ff13be00640 10 client.15597 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.822+0000 7ff13be00640 1 -- 172.21.15.38:0/492282333 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5637d40ffe60 con 0x5637d4218bc0 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.822+0000 7ff13be00640 10 client.15597 handle_command_reply: tid=0 2024-09-12T12:27:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.822+0000 7ff163dea740 1 client.15597 shutdown 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 msgr2=0x5637d41a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d41a5390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5637d419b260 tx=0x7ff1480053e0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 shutdown_connections 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x5637d4218bc0 0x5637d421afe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637d419cd70 0x5637d41a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637d41924b0 0x5637d41a5390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 --2- 172.21.15.38:0/492282333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d4191b90 0x5637d41a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 >> 172.21.15.38:0/492282333 conn(0x5637d418e120 msgr2=0x5637d4199c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff13be00640 0 client.15597 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 shutdown_connections 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 1 -- 172.21.15.38:0/492282333 wait complete. 2024-09-12T12:27:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.823+0000 7ff163dea740 20 client.15597 trim_cache size 0 max 16384 2024-09-12T12:27:42.827 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:27:42.827 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-12T12:27:42.827 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2024-09-12T12:27:42.827 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1400a2c00 msgr2=0x7ff1400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1400a2c00 0x7ff1400a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff15402f540 tx=0x7ff15402f3b0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c104010 msgr2=0x7ff15c19a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c104010 0x7ff15c19a6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00d770 tx=0x7ff14c00dc30 comp rx=0 tx=0).stop 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 shutdown_connections 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff1400a2c00 0x7ff1400a50c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff15c109140 0x7ff15c19ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff15c1049c0 0x7ff15c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 --2- 172.21.15.38:0/4250151572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff15c104010 0x7ff15c19a6c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 >> 172.21.15.38:0/4250151572 conn(0x7ff15c0ffa50 msgr2=0x7ff15c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 shutdown_connections 2024-09-12T12:27:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:42.824+0000 7ff161200640 1 -- 172.21.15.38:0/4250151572 wait complete. 2024-09-12T12:27:43.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:43 smithi071 ceph-mon[34859]: pgmap v447: 129 pgs: 129 active+clean; 238 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 25 op/s 2024-09-12T12:27:43.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:43 smithi154 ceph-mon[35578]: pgmap v447: 129 pgs: 129 active+clean; 238 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 25 op/s 2024-09-12T12:27:43.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:43 smithi038 ceph-mon[30810]: pgmap v447: 129 pgs: 129 active+clean; 238 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 25 op/s 2024-09-12T12:27:43.719 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:27:43.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:27:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 -- 172.21.15.38:0/3847028829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788102790 msgr2=0x7fd7881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 --2- 172.21.15.38:0/3847028829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788102790 0x7fd7881067e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd774009900 tx=0x7fd77402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 -- 172.21.15.38:0/3847028829 shutdown_connections 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 --2- 172.21.15.38:0/3847028829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd788106f10 0x7fd78810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 --2- 172.21.15.38:0/3847028829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788102790 0x7fd7881067e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 --2- 172.21.15.38:0/3847028829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 0x7fd7881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 -- 172.21.15.38:0/3847028829 >> 172.21.15.38:0/3847028829 conn(0x7fd7880fd8c0 msgr2=0x7fd7880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 -- 172.21.15.38:0/3847028829 shutdown_connections 2024-09-12T12:27:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.705+0000 7fd78f600640 1 -- 172.21.15.38:0/3847028829 wait complete. 2024-09-12T12:27:44.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.706+0000 7fd78f600640 1 Processor -- start 2024-09-12T12:27:44.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.706+0000 7fd78f600640 1 -- start start 2024-09-12T12:27:44.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.706+0000 7fd78f600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 0x7fd78819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:44.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78f600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd788102790 0x7fd78819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:44.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78f600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788106f10 0x7fd78819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78f600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd788111f70 con 0x7fd788106f10 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78f600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd788111df0 con 0x7fd788101de0 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78f600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881120f0 con 0x7fd788102790 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 0x7fd78819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd787e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd788102790 0x7fd78819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788106f10 0x7fd78819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 0x7fd78819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:48884/0 (socket says 172.21.15.38:48884) 2024-09-12T12:27:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78cc00640 1 -- 172.21.15.38:0/3740769822 learned_addr learned my addr 172.21.15.38:0/3740769822 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.707+0000 7fd78cc00640 1 -- 172.21.15.38:0/3740769822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd788102790 msgr2=0x7fd78819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd78cc00640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd788102790 0x7fd78819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd78cc00640 1 -- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788106f10 msgr2=0x7fd78819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd78cc00640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788106f10 0x7fd78819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd78cc00640 1 -- 172.21.15.38:0/3740769822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78819f6a0 con 0x7fd788101de0 2024-09-12T12:27:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd78cc00640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 0x7fd78819a6f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00d950 tx=0x7fd77c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd785600640 1 -- 172.21.15.38:0/3740769822 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c017030 con 0x7fd788101de0 2024-09-12T12:27:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78819f990 con 0x7fd788101de0 2024-09-12T12:27:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd785600640 1 -- 172.21.15.38:0/3740769822 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd77c004020 con 0x7fd788101de0 2024-09-12T12:27:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd785600640 1 -- 172.21.15.38:0/3740769822 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0047a0 con 0x7fd788101de0 2024-09-12T12:27:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.708+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7881a7270 con 0x7fd788101de0 2024-09-12T12:27:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.710+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7881021c0 con 0x7fd788101de0 2024-09-12T12:27:44.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.712+0000 7fd785600640 1 -- 172.21.15.38:0/3740769822 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd77c0041d0 con 0x7fd788101de0 2024-09-12T12:27:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.713+0000 7fd785600640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd7700a2c00 0x7fd7700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.713+0000 7fd785600640 1 -- 172.21.15.38:0/3740769822 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fd77c0cefc0 con 0x7fd788101de0 2024-09-12T12:27:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.713+0000 7fd787e00640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd7700a2c00 0x7fd7700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.714+0000 7fd787e00640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd7700a2c00 0x7fd7700a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd774009230 tx=0x7fd7740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:44.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.715+0000 7fd785600640 1 -- 172.21.15.38:0/3740769822 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd77c09bb90 con 0x7fd788101de0 2024-09-12T12:27:44.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.939+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7881a74a0 con 0x7fd788101de0 2024-09-12T12:27:44.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.940+0000 7fd785600640 1 -- 172.21.15.38:0/3740769822 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7fd77c09b490 con 0x7fd788101de0 2024-09-12T12:27:44.941 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:27:44.941 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:27:44.941 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd7700a2c00 msgr2=0x7fd7700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd7700a2c00 0x7fd7700a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd774009230 tx=0x7fd7740058d0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 msgr2=0x7fd78819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 0x7fd78819a6f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00d950 tx=0x7fd77c00de10 comp rx=0 tx=0).stop 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 shutdown_connections 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fd7700a2c00 0x7fd7700a50c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788106f10 0x7fd78819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd788102790 0x7fd78819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 --2- 172.21.15.38:0/3740769822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd788101de0 0x7fd78819a6f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:44.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.942+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 >> 172.21.15.38:0/3740769822 conn(0x7fd7880fd8c0 msgr2=0x7fd7880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:44.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.943+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 shutdown_connections 2024-09-12T12:27:44.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:44.943+0000 7fd78f600640 1 -- 172.21.15.38:0/3740769822 wait complete. 2024-09-12T12:27:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:45 smithi071 ceph-mon[34859]: pgmap v448: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 MiB/s wr, 28 op/s 2024-09-12T12:27:45.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:45 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3740769822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:27:45.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:45 smithi154 ceph-mon[35578]: pgmap v448: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 MiB/s wr, 28 op/s 2024-09-12T12:27:45.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:45 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3740769822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:27:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:45 smithi038 ceph-mon[30810]: pgmap v448: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 MiB/s wr, 28 op/s 2024-09-12T12:27:45.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:45 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3740769822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:27:45.860 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T12:27:46.269 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.864+0000 7fb015a00640 1 -- 172.21.15.38:0/791614573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 msgr2=0x7fb0101124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.864+0000 7fb015a00640 1 --2- 172.21.15.38:0/791614573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 0x7fb0101124f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faff8009900 tx=0x7faff802a410 comp rx=0 tx=0).stop 2024-09-12T12:27:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.865+0000 7fb015a00640 1 -- 172.21.15.38:0/791614573 shutdown_connections 2024-09-12T12:27:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.865+0000 7fb015a00640 1 --2- 172.21.15.38:0/791614573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010112a30 0x7fb010114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.865+0000 7fb015a00640 1 --2- 172.21.15.38:0/791614573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 0x7fb0101124f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.865+0000 7fb015a00640 1 --2- 172.21.15.38:0/791614573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb010076720 0x7fb010076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.865+0000 7fb015a00640 1 -- 172.21.15.38:0/791614573 >> 172.21.15.38:0/791614573 conn(0x7fb0100ffa90 msgr2=0x7fb010101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.865+0000 7fb015a00640 1 -- 172.21.15.38:0/791614573 shutdown_connections 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.865+0000 7fb015a00640 1 -- 172.21.15.38:0/791614573 wait complete. 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 Processor -- start 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 -- start start 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010076720 0x7fb0101a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 0x7fb0101a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb010112a30 0x7fb01019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb010118610 con 0x7fb010077040 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb010118490 con 0x7fb010076720 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.866+0000 7fb015a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb010118790 con 0x7fb010112a30 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb007e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 0x7fb0101a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010076720 0x7fb0101a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010076720 0x7fb0101a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56566/0 (socket says 172.21.15.38:56566) 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 -- 172.21.15.38:0/3571435960 learned_addr learned my addr 172.21.15.38:0/3571435960 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00f400640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb010112a30 0x7fb01019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 -- 172.21.15.38:0/3571435960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb010112a30 msgr2=0x7fb01019e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb010112a30 0x7fb01019e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 -- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 msgr2=0x7fb0101a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 0x7fb0101a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 -- 172.21.15.38:0/3571435960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01019f020 con 0x7fb010076720 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00f400640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb010112a30 0x7fb01019e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.867+0000 7fb00ea00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010076720 0x7fb0101a4730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb00000e9f0 tx=0x7fb00000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.868+0000 7fb007400640 1 -- 172.21.15.38:0/3571435960 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00000cd80 con 0x7fb010076720 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.868+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01019f310 con 0x7fb010076720 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.868+0000 7fb007400640 1 -- 172.21.15.38:0/3571435960 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb000005500 con 0x7fb010076720 2024-09-12T12:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.868+0000 7fb007400640 1 -- 172.21.15.38:0/3571435960 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000010690 con 0x7fb010076720 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.868+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0101ab600 con 0x7fb010076720 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.871+0000 7fb007400640 1 -- 172.21.15.38:0/3571435960 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb0000046c0 con 0x7fb010076720 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 Processor -- start 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 -- start start 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb007400640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faff40a2c00 0x7faff40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb007400640 1 -- 172.21.15.38:0/3571435960 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fb0000cf880 con 0x7fb010076720 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e521050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e521590 0x562f8e52b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e52be50 0x562f8e52e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562f8e4873e0 con 0x562f8e521590 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f8e42ed80 con 0x562f8e520c70 2024-09-12T12:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb0185de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562f8e4833a0 con 0x562f8e52be50 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.873+0000 7fb00f400640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faff40a2c00 0x7faff40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e521590 0x562f8e52b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb00ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e521050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e521590 0x562f8e52b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36200/0 (socket says 172.21.15.38:36200) 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 -- 172.21.15.38:0/979416546 learned_addr learned my addr 172.21.15.38:0/979416546 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb00f400640 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e52be50 0x562f8e52e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 -- 172.21.15.38:0/979416546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e52be50 msgr2=0x562f8e52e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e52be50 0x562f8e52e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 -- 172.21.15.38:0/979416546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 msgr2=0x562f8e521050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e521050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb007e00640 1 -- 172.21.15.38:0/979416546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f8e44dae0 con 0x562f8e521590 2024-09-12T12:27:46.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.874+0000 7fb00ea00640 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e521050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.875+0000 7fb007e00640 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e521590 0x562f8e52b910 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff8009900 tx=0x7faff8005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9f226b129e5e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.875+0000 7fb00f400640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faff40a2c00 0x7faff40a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb01006b460 tx=0x7fb008012b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.875+0000 7fafffe00640 1 -- 172.21.15.38:0/979416546 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8035040 con 0x562f8e521590 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.875+0000 7fafffe00640 1 -- 172.21.15.38:0/979416546 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff8004400 con 0x562f8e521590 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.875+0000 7fafffe00640 1 -- 172.21.15.38:0/979416546 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff80035f0 con 0x562f8e521590 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 -- 172.21.15.38:0/979416546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e521590 msgr2=0x562f8e52b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e521590 0x562f8e52b910 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff8009900 tx=0x7faff8005de0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 -- 172.21.15.38:0/979416546 shutdown_connections 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e52be50 0x562f8e52e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e521590 0x562f8e52b910 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 --2- 172.21.15.38:0/979416546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e521050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 -- 172.21.15.38:0/979416546 >> 172.21.15.38:0/979416546 conn(0x562f8e51d200 msgr2=0x562f8e51d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:46.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 -- 172.21.15.38:0/979416546 shutdown_connections 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.876+0000 7fb0185de740 1 -- 172.21.15.38:0/979416546 wait complete. 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 -- start start 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 Processor -- start 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e528ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e529220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e529760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562f8e52ea20 con 0x562f8e520c70 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f8e4420f0 con 0x562f8e52be50 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562f8e52eba0 con 0x562f8e521590 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.877+0000 7fb0185de740 10 client.0 _ll_register_callbacks cb 0x562f8e429bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e529220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e529220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:44684/0 (socket says 172.21.15.38:44684) 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 -- 172.21.15.38:0/6504054 learned_addr learned my addr 172.21.15.38:0/6504054 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:46.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb00f400640 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e529760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb00ea00640 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e528ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 -- 172.21.15.38:0/6504054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 msgr2=0x562f8e529760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e529760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 -- 172.21.15.38:0/6504054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 msgr2=0x562f8e528ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e528ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.878+0000 7fb007e00640 1 -- 172.21.15.38:0/6504054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f8e1f83c0 con 0x562f8e521590 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7fb007e00640 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e529220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faff8005c40 tx=0x7faff8004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=659cf554b0ead866 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7faffcc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7faffcc00640 1 -- 172.21.15.38:0/6504054 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8052060 con 0x562f8e521590 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff8004400 con 0x562f8e521590 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7faffcc00640 1 -- 172.21.15.38:0/6504054 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faff8004200 con 0x562f8e521590 2024-09-12T12:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7faffcc00640 1 -- 172.21.15.38:0/6504054 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faff8059050 con 0x562f8e521590 2024-09-12T12:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7fb0185de740 10 client.25594 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.879+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562f8e52ea20 con 0x562f8e521590 2024-09-12T12:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7faffcc00640 1 -- 172.21.15.38:0/6504054 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff8004400 con 0x562f8e521590 2024-09-12T12:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7faffcc00640 1 -- 172.21.15.38:0/6504054 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7faff8031ae0 con 0x562f8e521590 2024-09-12T12:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7fb0185de740 10 client.25594 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7fb0185de740 10 client.25594 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7fb0185de740 20 client.25594 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7fb0185de740 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e53bba0 0x562f8e53df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7fb0185de740 4 client.25594 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f8e494950 con 0x562f8e53bba0 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.880+0000 7fb00ea00640 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e53bba0 0x562f8e53df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.881+0000 7fb00ea00640 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e53bba0 0x562f8e53df90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bdacaf68b1b03f1a server_cookie=b956658048ece3f2 in_seq=0 out_seq=0 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.881+0000 7faffcc00640 10 client.25594 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7faffcc00640 1 -- 172.21.15.38:0/6504054 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f8e494950 con 0x562f8e53bba0 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7faffcc00640 10 client.25594 handle_command_reply: tid=0 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 client.25594 shutdown 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 msgr2=0x562f8e529220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e529220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faff8005c40 tx=0x7faff8004a80 comp rx=0 tx=0).stop 2024-09-12T12:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 shutdown_connections 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e53bba0 0x562f8e53df90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e529760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7faffcc00640 0 client.25594 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e529220 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 --2- 172.21.15.38:0/6504054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e528ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 >> 172.21.15.38:0/6504054 conn(0x562f8e51d200 msgr2=0x562f8e522f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 shutdown_connections 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.882+0000 7fb0185de740 1 -- 172.21.15.38:0/6504054 wait complete. 2024-09-12T12:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.883+0000 7fb0185de740 20 client.25594 trim_cache size 0 max 16384 2024-09-12T12:27:46.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.896+0000 7fb0185de740 1 Processor -- start 2024-09-12T12:27:46.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb0185de740 1 -- start start 2024-09-12T12:27:46.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb0185de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e543640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb0185de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e543b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb0185de740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e52be50 0x562f8e52a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb0185de740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb0101b5380 con 0x562f8e52be50 2024-09-12T12:27:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb0185de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0101b6ec0 con 0x562f8e520c70 2024-09-12T12:27:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb0185de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0101b5a50 con 0x562f8e521590 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb00ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e543640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb00f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e52be50 0x562f8e52a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb00ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e543640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56592/0 (socket says 172.21.15.38:56592) 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.897+0000 7fb00ea00640 1 -- 172.21.15.38:0/38216613 learned_addr learned my addr 172.21.15.38:0/38216613 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fb007e00640 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e543b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fb00ea00640 1 -- 172.21.15.38:0/38216613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 msgr2=0x562f8e543b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fb00ea00640 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e543b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fb00ea00640 1 -- 172.21.15.38:0/38216613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e52be50 msgr2=0x562f8e52a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fb00ea00640 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e52be50 0x562f8e52a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fb00ea00640 1 -- 172.21.15.38:0/38216613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f8e51d030 con 0x562f8e520c70 2024-09-12T12:27:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fb00ea00640 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e543640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0000986a0 tx=0x7fb000004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec54ec23c576179 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fafff400640 1 -- 172.21.15.38:0/38216613 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0000a0080 con 0x562f8e520c70 2024-09-12T12:27:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fafff400640 1 -- 172.21.15.38:0/38216613 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0000a4940 con 0x562f8e520c70 2024-09-12T12:27:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.898+0000 7fafff400640 1 -- 172.21.15.38:0/38216613 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0000a4b90 con 0x562f8e520c70 2024-09-12T12:27:46.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.899+0000 7fb0185de740 1 -- 172.21.15.38:0/38216613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 msgr2=0x562f8e543640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.899+0000 7fb0185de740 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e543640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0000986a0 tx=0x7fb000004b60 comp rx=0 tx=0).stop 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.899+0000 7fb0185de740 1 -- 172.21.15.38:0/38216613 shutdown_connections 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.899+0000 7fb0185de740 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e52be50 0x562f8e52a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.899+0000 7fb0185de740 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e543b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.899+0000 7fb0185de740 1 --2- 172.21.15.38:0/38216613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e520c70 0x562f8e543640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.899+0000 7fb0185de740 1 -- 172.21.15.38:0/38216613 >> 172.21.15.38:0/38216613 conn(0x562f8e51d200 msgr2=0x562f8e527dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.900+0000 7fb0185de740 1 -- 172.21.15.38:0/38216613 shutdown_connections 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.900+0000 7fb0185de740 1 -- 172.21.15.38:0/38216613 wait complete. 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.900+0000 7fb0185de740 1 -- start start 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.900+0000 7fb0185de740 1 Processor -- start 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb0185de740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e534460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb0185de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e525910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb0185de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e525e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb0185de740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb0101b67f0 con 0x562f8e520c70 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb0185de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0101b6120 con 0x562f8e52be50 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb0185de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0101b3360 con 0x562f8e521590 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb0185de740 10 client.0 _ll_register_callbacks cb 0x7fb0000056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e534460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e534460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36216/0 (socket says 172.21.15.38:36216) 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 -- 172.21.15.38:0/861229602 learned_addr learned my addr 172.21.15.38:0/861229602 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb007e00640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e525910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00f400640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e525e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 -- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 msgr2=0x562f8e525910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e525910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 -- 172.21.15.38:0/861229602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 msgr2=0x562f8e525e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e525e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.901+0000 7fb00ea00640 1 -- 172.21.15.38:0/861229602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f8e526540 con 0x562f8e520c70 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.902+0000 7fb00f400640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e525e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.902+0000 7fb00ea00640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e534460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb00009b9d0 tx=0x7fb000005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a568e8667f569a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.902+0000 7faffcc00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.902+0000 7faffcc00640 1 -- 172.21.15.38:0/861229602 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0000a0080 con 0x562f8e520c70 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.902+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0000a4940 con 0x562f8e520c70 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.902+0000 7faffcc00640 1 -- 172.21.15.38:0/861229602 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fb0000a45b0 con 0x562f8e520c70 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7faffcc00640 1 -- 172.21.15.38:0/861229602 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb00008b050 con 0x562f8e520c70 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 10 client.15621 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562f8e5a6560 con 0x562f8e520c70 2024-09-12T12:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7faffcc00640 1 -- 172.21.15.38:0/861229602 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0000a4940 con 0x562f8e520c70 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7faffcc00640 1 -- 172.21.15.38:0/861229602 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb00009ab90 con 0x562f8e520c70 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 10 client.15621 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 10 client.15621 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 20 client.15621 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e5a6cb0 0x562f8e5a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 4 client.15621 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.903+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f8e48ee60 con 0x562f8e5a6cb0 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7fb007e00640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e5a6cb0 0x562f8e5a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7fb007e00640 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e5a6cb0 0x562f8e5a90d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9bab11a5897cb25 server_cookie=3433533eda70060e in_seq=0 out_seq=0 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7faffcc00640 10 client.15621 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7faffcc00640 1 -- 172.21.15.38:0/861229602 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f8e48ee60 con 0x562f8e5a6cb0 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7faffcc00640 10 client.15621 handle_command_reply: tid=0 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7fb0185de740 1 client.15621 shutdown 2024-09-12T12:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 msgr2=0x562f8e534460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.904+0000 7fb0185de740 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e534460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb00009b9d0 tx=0x7fb000005760 comp rx=0 tx=0).stop 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 shutdown_connections 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x562f8e5a6cb0 0x562f8e5a90d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f8e52be50 0x562f8e525e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562f8e521590 0x562f8e525910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 --2- 172.21.15.38:0/861229602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562f8e520c70 0x562f8e534460 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 >> 172.21.15.38:0/861229602 conn(0x562f8e51d200 msgr2=0x562f8e51bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7faffcc00640 0 client.15621 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 shutdown_connections 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 1 -- 172.21.15.38:0/861229602 wait complete. 2024-09-12T12:27:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.905+0000 7fb0185de740 20 client.15621 trim_cache size 0 max 16384 2024-09-12T12:27:46.909 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:46.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faff40a2c00 msgr2=0x7faff40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faff40a2c00 0x7faff40a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb01006b460 tx=0x7fb008012b30 comp rx=0 tx=0).stop 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010076720 msgr2=0x7fb0101a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010076720 0x7fb0101a4730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb00000e9f0 tx=0x7fb00000edf0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 shutdown_connections 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faff40a2c00 0x7faff40a50c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb010112a30 0x7fb01019e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb010077040 0x7fb0101a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 --2- 172.21.15.38:0/3571435960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb010076720 0x7fb0101a4730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 >> 172.21.15.38:0/3571435960 conn(0x7fb0100ffa90 msgr2=0x7fb010101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 shutdown_connections 2024-09-12T12:27:46.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:46.906+0000 7fb015a00640 1 -- 172.21.15.38:0/3571435960 wait complete. 2024-09-12T12:27:47.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:47 smithi071 ceph-mon[34859]: pgmap v449: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 26 op/s 2024-09-12T12:27:47.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:47 smithi154 ceph-mon[35578]: pgmap v449: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 26 op/s 2024-09-12T12:27:47.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:47 smithi038 ceph-mon[30810]: pgmap v449: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 26 op/s 2024-09-12T12:27:47.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T12:27:48.170 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 -- 172.21.15.38:0/1923722343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01079c0 msgr2=0x7f3cb0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 --2- 172.21.15.38:0/1923722343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01079c0 0x7f3cb0107da0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009be0 tx=0x7f3ca002a6c0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 -- 172.21.15.38:0/1923722343 shutdown_connections 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 --2- 172.21.15.38:0/1923722343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb0102360 0x7f3cb010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 --2- 172.21.15.38:0/1923722343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb01019c0 0x7f3cb0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 --2- 172.21.15.38:0/1923722343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01079c0 0x7f3cb0107da0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 -- 172.21.15.38:0/1923722343 >> 172.21.15.38:0/1923722343 conn(0x7f3cb00fd740 msgr2=0x7f3cb00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 -- 172.21.15.38:0/1923722343 shutdown_connections 2024-09-12T12:27:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.724+0000 7f3cafe00640 1 -- 172.21.15.38:0/1923722343 wait complete. 2024-09-12T12:27:48.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 Processor -- start 2024-09-12T12:27:48.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 -- start start 2024-09-12T12:27:48.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01019c0 0x7f3cb01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0102360 0x7f3cb0198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb01079c0 0x7f3cb019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0111d70 con 0x7f3cb01079c0 2024-09-12T12:27:48.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0111bf0 con 0x7f3cb01019c0 2024-09-12T12:27:48.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.726+0000 7f3cafe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0111ef0 con 0x7f3cb0102360 2024-09-12T12:27:48.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01019c0 0x7f3cb01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01019c0 0x7f3cb01982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56614/0 (socket says 172.21.15.38:56614) 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 -- 172.21.15.38:0/3140092240 learned_addr learned my addr 172.21.15.38:0/3140092240 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caf400640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb01079c0 0x7f3cb019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3ca6000640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0102360 0x7f3cb0198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 -- 172.21.15.38:0/3140092240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0102360 msgr2=0x7f3cb0198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0102360 0x7f3cb0198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 -- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb01079c0 msgr2=0x7f3cb019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb01079c0 0x7f3cb019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 -- 172.21.15.38:0/3140092240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb019d2a0 con 0x7f3cb01019c0 2024-09-12T12:27:48.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.727+0000 7f3caea00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01019c0 0x7f3cb01982f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0004af0 tx=0x7f3ca0030cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:48.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.728+0000 7f3ca7e00640 1 -- 172.21.15.38:0/3140092240 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0041020 con 0x7f3cb01019c0 2024-09-12T12:27:48.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.728+0000 7f3ca7e00640 1 -- 172.21.15.38:0/3140092240 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca0037040 con 0x7f3cb01019c0 2024-09-12T12:27:48.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.728+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb019d530 con 0x7f3cb01019c0 2024-09-12T12:27:48.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.728+0000 7f3ca7e00640 1 -- 172.21.15.38:0/3140092240 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0036070 con 0x7f3cb01019c0 2024-09-12T12:27:48.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.728+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb01a4e70 con 0x7f3cb01019c0 2024-09-12T12:27:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.731+0000 7f3cb842e740 1 Processor -- start 2024-09-12T12:27:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.731+0000 7f3ca7e00640 1 -- 172.21.15.38:0/3140092240 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3ca0044020 con 0x7f3cb01019c0 2024-09-12T12:27:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.731+0000 7f3cb842e740 1 -- start start 2024-09-12T12:27:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.731+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f6ee40 0x5631f9f6f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f79ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f7a020 0x5631f9f7c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3cb842e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5631f9ed53e0 con 0x5631f9f6f760 2024-09-12T12:27:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3cb842e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5631f9e7cd80 con 0x5631f9f6ee40 2024-09-12T12:27:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3cb842e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5631f9ed13a0 con 0x5631f9f7a020 2024-09-12T12:27:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3caea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f79ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3caea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f79ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36256/0 (socket says 172.21.15.38:36256) 2024-09-12T12:27:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3caea00640 1 -- 172.21.15.38:0/610317737 learned_addr learned my addr 172.21.15.38:0/610317737 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3caf400640 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f6ee40 0x5631f9f6f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.732+0000 7f3ca6000640 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f7a020 0x5631f9f7c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3caf400640 1 -- 172.21.15.38:0/610317737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f7a020 msgr2=0x5631f9f7c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3caf400640 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f7a020 0x5631f9f7c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3caf400640 1 -- 172.21.15.38:0/610317737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 msgr2=0x5631f9f79ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3caf400640 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f79ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3caf400640 1 -- 172.21.15.38:0/610317737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f9e9bae0 con 0x5631f9f6ee40 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3caf400640 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f6ee40 0x5631f9f6f220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8005fd0 tx=0x7f3ca8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad7848e8b23a710 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3ca7e00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3c940a2c00 0x7f3c940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3c9fe00640 1 -- 172.21.15.38:0/610317737 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8009d30 con 0x5631f9f6ee40 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3c9fe00640 1 -- 172.21.15.38:0/610317737 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca8005500 con 0x5631f9f6ee40 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3ca7e00640 1 -- 172.21.15.38:0/3140092240 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f3ca00efeb0 con 0x7f3cb01019c0 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3c9fe00640 1 -- 172.21.15.38:0/610317737 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8019670 con 0x5631f9f6ee40 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.733+0000 7f3caea00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3c940a2c00 0x7f3c940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3caea00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3c940a2c00 0x7f3c940a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00bc060 tx=0x7f3ca00f3990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 -- 172.21.15.38:0/610317737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f6ee40 msgr2=0x5631f9f6f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f6ee40 0x5631f9f6f220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8005fd0 tx=0x7f3ca8011810 comp rx=0 tx=0).stop 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 -- 172.21.15.38:0/610317737 shutdown_connections 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f7a020 0x5631f9f7c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f79ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 --2- 172.21.15.38:0/610317737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f6ee40 0x5631f9f6f220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 -- 172.21.15.38:0/610317737 >> 172.21.15.38:0/610317737 conn(0x5631f9f6b3d0 msgr2=0x5631f9f6b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 -- 172.21.15.38:0/610317737 shutdown_connections 2024-09-12T12:27:48.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.734+0000 7f3cb842e740 1 -- 172.21.15.38:0/610317737 wait complete. 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.735+0000 7f3cb842e740 1 -- start start 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.735+0000 7f3cb842e740 1 Processor -- start 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f76f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f77460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f779a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3cb842e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5631f9f7cbf0 con 0x5631f9f6f760 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3cb842e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5631f9e900f0 con 0x5631f9f7a020 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3cb842e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5631f9f7cd70 con 0x5631f9f6ee40 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3cb842e740 10 client.0 _ll_register_callbacks cb 0x5631f9e77bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3ca6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f77460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3ca6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f77460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36264/0 (socket says 172.21.15.38:36264) 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3ca6000640 1 -- 172.21.15.38:0/2653457681 learned_addr learned my addr 172.21.15.38:0/2653457681 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3caf400640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f76f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.736+0000 7f3caf400640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3ca6000640 1 -- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 msgr2=0x5631f9f76f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3ca6000640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f76f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3ca6000640 1 -- 172.21.15.38:0/2653457681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 msgr2=0x5631f9f779a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3ca6000640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f779a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3ca6000640 1 -- 172.21.15.38:0/2653457681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f9c463c0 con 0x5631f9f6f760 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3caf400640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f76f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3ca6000640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f77460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3c98012700 tx=0x7f3c98012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3932bf2a007e7e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3c9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2653457681 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004050 con 0x5631f9f6f760 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2653457681 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f3c980041f0 con 0x5631f9f6f760 2024-09-12T12:27:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.737+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca8005500 con 0x5631f9f6f760 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2653457681 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3c98025050 con 0x5631f9f6f760 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 10 client.15633 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5631f9f88ca0 con 0x5631f9f6f760 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2653457681 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca8005500 con 0x5631f9f6f760 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2653457681 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f3c980039c0 con 0x5631f9f6f760 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 10 client.15633 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 10 client.15633 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 20 client.15633 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9f8a1b0 0x5631f9f8c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 4 client.15633 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.738+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631f9ee2950 con 0x5631f9f8a1b0 2024-09-12T12:27:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.739+0000 7f3caf400640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9f8a1b0 0x5631f9f8c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.740+0000 7f3caf400640 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9f8a1b0 0x5631f9f8c5d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=871f4c6393255568 server_cookie=56e3cd90300bbcff in_seq=0 out_seq=0 2024-09-12T12:27:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.740+0000 7f3c9cc00640 10 client.15633 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.740+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2653457681 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631f9ee2950 con 0x5631f9f8a1b0 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.740+0000 7f3c9cc00640 10 client.15633 handle_command_reply: tid=0 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.740+0000 7f3cb842e740 1 client.15633 shutdown 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 msgr2=0x5631f9f77460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f77460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3c98012700 tx=0x7f3c98012bc0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 shutdown_connections 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9f8a1b0 0x5631f9f8c5d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f779a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f77460 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2653457681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f76f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 >> 172.21.15.38:0/2653457681 conn(0x5631f9f6b3d0 msgr2=0x5631f9f71100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3c9cc00640 0 client.15633 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 shutdown_connections 2024-09-12T12:27:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 1 -- 172.21.15.38:0/2653457681 wait complete. 2024-09-12T12:27:48.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.741+0000 7f3cb842e740 20 client.15633 trim_cache size 0 max 16384 2024-09-12T12:27:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.768+0000 7f3cb842e740 1 Processor -- start 2024-09-12T12:27:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3cb842e740 1 -- start start 2024-09-12T12:27:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f91ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f923e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3cb842e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01aebd0 con 0x5631f9f6f760 2024-09-12T12:27:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3cb842e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01b0710 con 0x5631f9f7a020 2024-09-12T12:27:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3cb842e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01af2a0 con 0x5631f9f6ee40 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3ca6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f91ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3ca6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f91ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36280/0 (socket says 172.21.15.38:36280) 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.769+0000 7f3ca6000640 1 -- 172.21.15.38:0/3637093075 learned_addr learned my addr 172.21.15.38:0/3637093075 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3caf400640 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3caf400640 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3ca6000640 1 -- 172.21.15.38:0/3637093075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 msgr2=0x5631f9f777f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3ca6000640 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f777f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3ca6000640 1 -- 172.21.15.38:0/3637093075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 msgr2=0x5631f9f923e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3ca6000640 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f923e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3ca6000640 1 -- 172.21.15.38:0/3637093075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f9f6f590 con 0x5631f9f6f760 2024-09-12T12:27:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3caf400640 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3ca6000640 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f91ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3c98003de0 tx=0x7f3c980106f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35da15522a2dced server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.770+0000 7f3c9f400640 1 -- 172.21.15.38:0/3637093075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c980050e0 con 0x5631f9f6f760 2024-09-12T12:27:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.771+0000 7f3c9f400640 1 -- 172.21.15.38:0/3637093075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c9800f920 con 0x5631f9f6f760 2024-09-12T12:27:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.771+0000 7f3c9f400640 1 -- 172.21.15.38:0/3637093075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98003750 con 0x5631f9f6f760 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.771+0000 7f3cb842e740 1 -- 172.21.15.38:0/3637093075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 msgr2=0x5631f9f91ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.771+0000 7f3cb842e740 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f91ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3c98003de0 tx=0x7f3c980106f0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 -- 172.21.15.38:0/3637093075 shutdown_connections 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f923e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6f760 0x5631f9f91ea0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 --2- 172.21.15.38:0/3637093075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6ee40 0x5631f9f777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 -- 172.21.15.38:0/3637093075 >> 172.21.15.38:0/3637093075 conn(0x5631f9f6b3d0 msgr2=0x5631f9f76010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 -- 172.21.15.38:0/3637093075 shutdown_connections 2024-09-12T12:27:48.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 -- 172.21.15.38:0/3637093075 wait complete. 2024-09-12T12:27:48.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.772+0000 7f3cb842e740 1 -- start start 2024-09-12T12:27:48.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 1 Processor -- start 2024-09-12T12:27:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6ee40 0x5631f9f823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6f760 0x5631f9f828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f7d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01b0040 con 0x5631f9f6ee40 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01af970 con 0x5631f9f7a020 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01acbb0 con 0x5631f9f6f760 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.773+0000 7f3cb842e740 10 client.0 _ll_register_callbacks cb 0x7f3c980097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3caf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6ee40 0x5631f9f823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6f760 0x5631f9f828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6f760 0x5631f9f828f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:44750/0 (socket says 172.21.15.38:44750) 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3caf400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6ee40 0x5631f9f823b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36294/0 (socket says 172.21.15.38:36294) 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 -- 172.21.15.38:0/2695236338 learned_addr learned my addr 172.21.15.38:0/2695236338 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3caf400640 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f7d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 -- 172.21.15.38:0/2695236338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 msgr2=0x5631f9f7d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f7d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 -- 172.21.15.38:0/2695236338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6ee40 msgr2=0x5631f9f823b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6ee40 0x5631f9f823b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3ca6000640 1 -- 172.21.15.38:0/2695236338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f9f7e160 con 0x5631f9f6f760 2024-09-12T12:27:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.774+0000 7f3caf400640 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f7d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.775+0000 7f3ca6000640 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6f760 0x5631f9f828f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c98012420 tx=0x7f3c9800fd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c74c800bc1b149a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.775+0000 7f3c9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:27:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.775+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2695236338 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9802d070 con 0x5631f9f6f760 2024-09-12T12:27:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.775+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2695236338 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f3c98018040 con 0x5631f9f6f760 2024-09-12T12:27:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.775+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c9800f920 con 0x5631f9f6f760 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2695236338 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3c9803c050 con 0x5631f9f6f760 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3cb842e740 10 client.25618 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5631f9ff4b20 con 0x5631f9f6f760 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2695236338 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c9800f920 con 0x5631f9f6f760 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2695236338 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f3c98029430 con 0x5631f9f6f760 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3cb842e740 10 client.25618 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3cb842e740 10 client.25618 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3cb842e740 20 client.25618 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9ff51e0 0x5631f9ff7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.776+0000 7f3cb842e740 4 client.25618 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.777+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631f9edce60 con 0x5631f9ff51e0 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.777+0000 7f3caf400640 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9ff51e0 0x5631f9ff7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.777+0000 7f3caf400640 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9ff51e0 0x5631f9ff7600 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec1d74d0534e3a1a server_cookie=a8f762dc6f1c23bf in_seq=0 out_seq=0 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.777+0000 7f3c9cc00640 10 client.25618 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3c9cc00640 1 -- 172.21.15.38:0/2695236338 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631f9edce60 con 0x5631f9ff51e0 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3c9cc00640 10 client.25618 handle_command_reply: tid=0 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 client.25618 shutdown 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6f760 msgr2=0x5631f9f828f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6f760 0x5631f9f828f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c98012420 tx=0x7f3c9800fd80 comp rx=0 tx=0).stop 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 shutdown_connections 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x5631f9ff51e0 0x5631f9ff7600 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5631f9f7a020 0x5631f9f7d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631f9f6f760 0x5631f9f828f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 --2- 172.21.15.38:0/2695236338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5631f9f6ee40 0x5631f9f823b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3c9cc00640 0 client.25618 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 >> 172.21.15.38:0/2695236338 conn(0x5631f9f6b3d0 msgr2=0x5631f9f69c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 shutdown_connections 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 1 -- 172.21.15.38:0/2695236338 wait complete. 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.778+0000 7f3cb842e740 20 client.25618 trim_cache size 0 max 16384 2024-09-12T12:27:48.781 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3c940a2c00 msgr2=0x7f3c940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3c940a2c00 0x7f3c940a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00bc060 tx=0x7f3ca00f3990 comp rx=0 tx=0).stop 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01019c0 msgr2=0x7f3cb01982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01019c0 0x7f3cb01982f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0004af0 tx=0x7f3ca0030cb0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 shutdown_connections 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f3c940a2c00 0x7f3c940a50c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb01079c0 0x7f3cb019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0102360 0x7f3cb0198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 --2- 172.21.15.38:0/3140092240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb01019c0 0x7f3cb01982f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:48.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.779+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 >> 172.21.15.38:0/3140092240 conn(0x7f3cb00fd740 msgr2=0x7f3cb00ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:48.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.780+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 shutdown_connections 2024-09-12T12:27:48.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:48.780+0000 7f3cafe00640 1 -- 172.21.15.38:0/3140092240 wait complete. 2024-09-12T12:27:49.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:49 smithi038 ceph-mon[30810]: pgmap v450: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 32 op/s 2024-09-12T12:27:49.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:49 smithi071 ceph-mon[34859]: pgmap v450: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 32 op/s 2024-09-12T12:27:49.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:49 smithi154 ceph-mon[35578]: pgmap v450: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 32 op/s 2024-09-12T12:27:49.678 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:27:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:50.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 -- 172.21.15.38:0/2963830632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 msgr2=0x7ff41810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 --2- 172.21.15.38:0/2963830632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41810e890 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff410009cd0 tx=0x7ff41002a8e0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 -- 172.21.15.38:0/2963830632 shutdown_connections 2024-09-12T12:27:50.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 --2- 172.21.15.38:0/2963830632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41810e890 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 --2- 172.21.15.38:0/2963830632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4181019c0 0x7ff418101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 --2- 172.21.15.38:0/2963830632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4181079c0 0x7ff418107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 -- 172.21.15.38:0/2963830632 >> 172.21.15.38:0/2963830632 conn(0x7ff4180fd740 msgr2=0x7ff4180ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:50.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 -- 172.21.15.38:0/2963830632 shutdown_connections 2024-09-12T12:27:50.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.633+0000 7ff41ce00640 1 -- 172.21.15.38:0/2963830632 wait complete. 2024-09-12T12:27:50.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.634+0000 7ff41ce00640 1 Processor -- start 2024-09-12T12:27:50.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff41ce00640 1 -- start start 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff41ce00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4181019c0 0x7ff41819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff41ce00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff41ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4181079c0 0x7ff41819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff41ce00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff418111dc0 con 0x7ff418102360 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff41ce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff418111c40 con 0x7ff4181079c0 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff41ce00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff418111f40 con 0x7ff4181019c0 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff416a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff416a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36304/0 (socket says 172.21.15.38:36304) 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.635+0000 7ff416a00640 1 -- 172.21.15.38:0/241931897 learned_addr learned my addr 172.21.15.38:0/241931897 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff417400640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4181019c0 0x7ff41819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff417e00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4181079c0 0x7ff41819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff416a00640 1 -- 172.21.15.38:0/241931897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4181019c0 msgr2=0x7ff41819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff416a00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4181019c0 0x7ff41819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff416a00640 1 -- 172.21.15.38:0/241931897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4181079c0 msgr2=0x7ff41819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff416a00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4181079c0 0x7ff41819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff416a00640 1 -- 172.21.15.38:0/241931897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41819f460 con 0x7ff418102360 2024-09-12T12:27:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff417400640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4181019c0 0x7ff41819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.636+0000 7ff416a00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41819a9f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff40400d950 tx=0x7ff40400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:50.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.637+0000 7ff40fe00640 1 -- 172.21.15.38:0/241931897 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404017030 con 0x7ff418102360 2024-09-12T12:27:50.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.637+0000 7ff40fe00640 1 -- 172.21.15.38:0/241931897 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff404004020 con 0x7ff418102360 2024-09-12T12:27:50.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.637+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41819f750 con 0x7ff418102360 2024-09-12T12:27:50.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.637+0000 7ff40fe00640 1 -- 172.21.15.38:0/241931897 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4040047a0 con 0x7ff418102360 2024-09-12T12:27:50.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.637+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4181a7030 con 0x7ff418102360 2024-09-12T12:27:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.640+0000 7ff421016740 1 Processor -- start 2024-09-12T12:27:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.640+0000 7ff421016740 1 -- start start 2024-09-12T12:27:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.640+0000 7ff40fe00640 1 -- 172.21.15.38:0/241931897 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff4040041d0 con 0x7ff418102360 2024-09-12T12:27:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff421016740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64403e40 0x55ff64404220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff421016740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64404760 0x55ff6440eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff421016740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64411410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff421016740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ff6436a3e0 con 0x55ff6440f020 2024-09-12T12:27:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff421016740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff64311d80 con 0x55ff64403e40 2024-09-12T12:27:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff421016740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ff643663a0 con 0x55ff64404760 2024-09-12T12:27:50.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff416a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64411410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff417e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64403e40 0x55ff64404220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff417e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64403e40 0x55ff64404220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56680/0 (socket says 172.21.15.38:56680) 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff417e00640 1 -- 172.21.15.38:0/816098425 learned_addr learned my addr 172.21.15.38:0/816098425 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.641+0000 7ff417400640 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64404760 0x55ff6440eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff417e00640 1 -- 172.21.15.38:0/816098425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64404760 msgr2=0x55ff6440eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff417e00640 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64404760 0x55ff6440eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff417e00640 1 -- 172.21.15.38:0/816098425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 msgr2=0x55ff64411410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff417e00640 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64411410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff417e00640 1 -- 172.21.15.38:0/816098425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff64330ae0 con 0x55ff64403e40 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff416a00640 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64411410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff417e00640 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64403e40 0x55ff64404220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff410009cd0 tx=0x7ff410009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=446a37e5214fa3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:50.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.642+0000 7ff40fe00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3fc0a2b80 0x7ff3fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.643+0000 7ff40cc00640 1 -- 172.21.15.38:0/816098425 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410048070 con 0x55ff64403e40 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.643+0000 7ff40fe00640 1 -- 172.21.15.38:0/241931897 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff4040cedb0 con 0x7ff418102360 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.643+0000 7ff40cc00640 1 -- 172.21.15.38:0/816098425 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff410036070 con 0x55ff64403e40 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.643+0000 7ff40cc00640 1 -- 172.21.15.38:0/816098425 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410004470 con 0x55ff64403e40 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.643+0000 7ff417400640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3fc0a2b80 0x7ff3fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.643+0000 7ff421016740 1 -- 172.21.15.38:0/816098425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64403e40 msgr2=0x55ff64404220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.643+0000 7ff421016740 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64403e40 0x55ff64404220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff410009cd0 tx=0x7ff410009a20 comp rx=0 tx=0).stop 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff417400640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3fc0a2b80 0x7ff3fc0a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ff64401230 tx=0x7ff408005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff421016740 1 -- 172.21.15.38:0/816098425 shutdown_connections 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff421016740 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64411410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff421016740 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64404760 0x55ff6440eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff421016740 1 --2- 172.21.15.38:0/816098425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64403e40 0x55ff64404220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff421016740 1 -- 172.21.15.38:0/816098425 >> 172.21.15.38:0/816098425 conn(0x55ff644003d0 msgr2=0x55ff644007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:50.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff421016740 1 -- 172.21.15.38:0/816098425 shutdown_connections 2024-09-12T12:27:50.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.644+0000 7ff421016740 1 -- 172.21.15.38:0/816098425 wait complete. 2024-09-12T12:27:50.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.645+0000 7ff421016740 1 -- start start 2024-09-12T12:27:50.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.645+0000 7ff421016740 1 Processor -- start 2024-09-12T12:27:50.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff421016740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff6440bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff421016740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64404760 0x55ff6440c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff421016740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff6440f020 0x55ff6440c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff421016740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ff64411c40 con 0x55ff64404760 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff421016740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff643250f0 con 0x55ff6440f020 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff421016740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ff64411dc0 con 0x55ff64403e40 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff421016740 10 client.0 _ll_register_callbacks cb 0x55ff6430cbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff416a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64404760 0x55ff6440c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff416a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64404760 0x55ff6440c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36316/0 (socket says 172.21.15.38:36316) 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff416a00640 1 -- 172.21.15.38:0/1833464664 learned_addr learned my addr 172.21.15.38:0/1833464664 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff417400640 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff6440bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.646+0000 7ff417e00640 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff6440f020 0x55ff6440c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff416a00640 1 -- 172.21.15.38:0/1833464664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 msgr2=0x55ff6440bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff416a00640 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff6440bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff416a00640 1 -- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff6440f020 msgr2=0x55ff6440c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff416a00640 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff6440f020 0x55ff6440c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff416a00640 1 -- 172.21.15.38:0/1833464664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff640db3c0 con 0x55ff64404760 2024-09-12T12:27:50.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff416a00640 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64404760 0x55ff6440c490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff404009610 tx=0x7ff404005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e5d3298d801158 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:50.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff401600640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff401600640 1 -- 172.21.15.38:0/1833464664 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40409ab60 con 0x55ff64404760 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff401600640 1 -- 172.21.15.38:0/1833464664 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff4040bb070 con 0x55ff64404760 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff410036070 con 0x55ff64404760 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.647+0000 7ff401600640 1 -- 172.21.15.38:0/1833464664 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff40409b900 con 0x55ff64404760 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 10 client.15651 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ff6441dd00 con 0x55ff64404760 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff401600640 1 -- 172.21.15.38:0/1833464664 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff410036070 con 0x55ff64404760 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff401600640 1 -- 172.21.15.38:0/1833464664 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff40409a650 con 0x55ff64404760 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 10 client.15651 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 10 client.15651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 20 client.15651 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:50.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6441f160 0x55ff64421570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 4 client.15651 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:50.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.648+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff64377950 con 0x55ff6441f160 2024-09-12T12:27:50.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.649+0000 7ff417400640 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6441f160 0x55ff64421570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.649+0000 7ff417400640 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6441f160 0x55ff64421570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb848b0507768bfb server_cookie=ca4edacb54c47faf in_seq=0 out_seq=0 2024-09-12T12:27:50.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.649+0000 7ff401600640 10 client.15651 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.650+0000 7ff401600640 1 -- 172.21.15.38:0/1833464664 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff64377950 con 0x55ff6441f160 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.650+0000 7ff401600640 10 client.15651 handle_command_reply: tid=0 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.650+0000 7ff421016740 1 client.15651 shutdown 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.650+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64404760 msgr2=0x55ff6440c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.650+0000 7ff421016740 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64404760 0x55ff6440c490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff404009610 tx=0x7ff404005d90 comp rx=0 tx=0).stop 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 shutdown_connections 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6441f160 0x55ff64421570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff6440f020 0x55ff6440c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64404760 0x55ff6440c490 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 --2- 172.21.15.38:0/1833464664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff6440bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff401600640 0 client.15651 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:50.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 >> 172.21.15.38:0/1833464664 conn(0x55ff644003d0 msgr2=0x55ff644060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:50.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 shutdown_connections 2024-09-12T12:27:50.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 1 -- 172.21.15.38:0/1833464664 wait complete. 2024-09-12T12:27:50.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.651+0000 7ff421016740 20 client.15651 trim_cache size 0 max 16384 2024-09-12T12:27:50.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.678+0000 7ff421016740 1 Processor -- start 2024-09-12T12:27:50.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.678+0000 7ff421016740 1 -- start start 2024-09-12T12:27:50.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff421016740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64403e40 0x55ff64426e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff421016740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64427380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff421016740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff6440f020 0x55ff644091d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff421016740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181b0df0 con 0x55ff64403e40 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff421016740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181b2930 con 0x55ff64404760 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff421016740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181b14c0 con 0x55ff6440f020 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff417400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64403e40 0x55ff64426e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff417400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64403e40 0x55ff64426e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36326/0 (socket says 172.21.15.38:36326) 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff417400640 1 -- 172.21.15.38:0/4008442716 learned_addr learned my addr 172.21.15.38:0/4008442716 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.679+0000 7ff416a00640 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64427380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff417e00640 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff6440f020 0x55ff644091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff416a00640 1 -- 172.21.15.38:0/4008442716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff6440f020 msgr2=0x55ff644091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff416a00640 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff6440f020 0x55ff644091d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff416a00640 1 -- 172.21.15.38:0/4008442716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64403e40 msgr2=0x55ff64426e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff416a00640 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64403e40 0x55ff64426e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff416a00640 1 -- 172.21.15.38:0/4008442716 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff643ffc80 con 0x55ff64404760 2024-09-12T12:27:50.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff417400640 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64403e40 0x55ff64426e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff416a00640 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64427380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff404097660 tx=0x7ff404005130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eeee788f18bd30c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.680+0000 7ff403e00640 1 -- 172.21.15.38:0/4008442716 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40409ab60 con 0x55ff64404760 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.681+0000 7ff403e00640 1 -- 172.21.15.38:0/4008442716 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4040bb0c0 con 0x55ff64404760 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.681+0000 7ff403e00640 1 -- 172.21.15.38:0/4008442716 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40409afd0 con 0x55ff64404760 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.681+0000 7ff421016740 1 -- 172.21.15.38:0/4008442716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 msgr2=0x55ff64427380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.681+0000 7ff421016740 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64427380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff404097660 tx=0x7ff404005130 comp rx=0 tx=0).stop 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 -- 172.21.15.38:0/4008442716 shutdown_connections 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff6440f020 0x55ff644091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64427380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 --2- 172.21.15.38:0/4008442716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff64403e40 0x55ff64426e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 -- 172.21.15.38:0/4008442716 >> 172.21.15.38:0/4008442716 conn(0x55ff644003d0 msgr2=0x55ff6440dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:50.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 -- 172.21.15.38:0/4008442716 shutdown_connections 2024-09-12T12:27:50.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 -- 172.21.15.38:0/4008442716 wait complete. 2024-09-12T12:27:50.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 -- start start 2024-09-12T12:27:50.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.682+0000 7ff421016740 1 Processor -- start 2024-09-12T12:27:50.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff421016740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff64409040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff421016740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64409580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff421016740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64409ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff421016740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181b2260 con 0x55ff6440f020 2024-09-12T12:27:50.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff421016740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181b1b90 con 0x55ff64404760 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff421016740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181aedd0 con 0x55ff64403e40 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff421016740 10 client.0 _ll_register_callbacks cb 0x7ff4040046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff417e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64409ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff417400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff64409040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff417400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff64409040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:44806/0 (socket says 172.21.15.38:44806) 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff417400640 1 -- 172.21.15.38:0/1410248450 learned_addr learned my addr 172.21.15.38:0/1410248450 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff417e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64409ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36336/0 (socket says 172.21.15.38:36336) 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.683+0000 7ff416a00640 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64409580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff417400640 1 -- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 msgr2=0x55ff64409580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff417400640 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64409580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff417400640 1 -- 172.21.15.38:0/1410248450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 msgr2=0x55ff64409ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff417400640 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64409ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff417400640 1 -- 172.21.15.38:0/1410248450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff64488ec0 con 0x55ff64403e40 2024-09-12T12:27:50.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff417400640 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff64409040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff40800f9a0 tx=0x7ff4080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8235a9db19983af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff401600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff401600640 1 -- 172.21.15.38:0/1410248450 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40802b500 con 0x55ff64403e40 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4040bb0c0 con 0x55ff64403e40 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.684+0000 7ff401600640 1 -- 172.21.15.38:0/1410248450 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff40802b6a0 con 0x55ff64403e40 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff401600640 1 -- 172.21.15.38:0/1410248450 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff40803d050 con 0x55ff64403e40 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 10 client.25636 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ff6448a200 con 0x55ff64403e40 2024-09-12T12:27:50.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff401600640 1 -- 172.21.15.38:0/1410248450 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4040bb0c0 con 0x55ff64403e40 2024-09-12T12:27:50.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff401600640 1 -- 172.21.15.38:0/1410248450 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff40801f430 con 0x55ff64403e40 2024-09-12T12:27:50.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 10 client.25636 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:50.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 10 client.25636 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 20 client.25636 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6448a8e0 0x55ff6448cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 4 client.25636 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.685+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff64371e60 con 0x55ff6448a8e0 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.686+0000 7ff416a00640 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6448a8e0 0x55ff6448cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.686+0000 7ff416a00640 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6448a8e0 0x55ff6448cd00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea22c8c6facfa0d3 server_cookie=7b68ac573c745ea0 in_seq=0 out_seq=0 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.686+0000 7ff401600640 10 client.25636 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff401600640 1 -- 172.21.15.38:0/1410248450 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff64371e60 con 0x55ff6448a8e0 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff401600640 10 client.25636 handle_command_reply: tid=0 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 client.25636 shutdown 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 msgr2=0x55ff64409040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff64409040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff40800f9a0 tx=0x7ff4080046c0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 shutdown_connections 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55ff6448a8e0 0x55ff6448cd00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ff6440f020 0x55ff64409ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff64404760 0x55ff64409580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 --2- 172.21.15.38:0/1410248450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ff64403e40 0x55ff64409040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 >> 172.21.15.38:0/1410248450 conn(0x55ff644003d0 msgr2=0x55ff643fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff401600640 0 client.25636 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 shutdown_connections 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 1 -- 172.21.15.38:0/1410248450 wait complete. 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.687+0000 7ff421016740 20 client.25636 trim_cache size 0 max 16384 2024-09-12T12:27:50.690 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:50.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3fc0a2b80 msgr2=0x7ff3fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3fc0a2b80 0x7ff3fc0a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ff64401230 tx=0x7ff408005f90 comp rx=0 tx=0).stop 2024-09-12T12:27:50.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 msgr2=0x7ff41819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:50.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41819a9f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff40400d950 tx=0x7ff40400de10 comp rx=0 tx=0).stop 2024-09-12T12:27:50.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 shutdown_connections 2024-09-12T12:27:50.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff3fc0a2b80 0x7ff3fc0a5040 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4181079c0 0x7ff41819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff418102360 0x7ff41819a9f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 --2- 172.21.15.38:0/241931897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4181019c0 0x7ff41819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:50.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 >> 172.21.15.38:0/241931897 conn(0x7ff4180fd740 msgr2=0x7ff41810cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:50.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 shutdown_connections 2024-09-12T12:27:50.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:50.688+0000 7ff41ce00640 1 -- 172.21.15.38:0/241931897 wait complete. 2024-09-12T12:27:51.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:51 smithi038 ceph-mon[30810]: pgmap v451: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-09-12T12:27:51.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:51 smithi071 ceph-mon[34859]: pgmap v451: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-09-12T12:27:51.605 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:27:51.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:51 smithi154 ceph-mon[35578]: pgmap v451: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 23 op/s 2024-09-12T12:27:51.997 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 -- 172.21.15.38:0/295688915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac1027a0 msgr2=0x7f12ac1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 --2- 172.21.15.38:0/295688915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac1027a0 0x7f12ac1067f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1298009900 tx=0x7f129802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 -- 172.21.15.38:0/295688915 shutdown_connections 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 --2- 172.21.15.38:0/295688915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac106f20 0x7f12ac10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 --2- 172.21.15.38:0/295688915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac1027a0 0x7f12ac1067f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 --2- 172.21.15.38:0/295688915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ac101df0 0x7f12ac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 -- 172.21.15.38:0/295688915 >> 172.21.15.38:0/295688915 conn(0x7f12ac0fd8b0 msgr2=0x7f12ac0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 -- 172.21.15.38:0/295688915 shutdown_connections 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.589+0000 7f12b3800640 1 -- 172.21.15.38:0/295688915 wait complete. 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.590+0000 7f12b3800640 1 Processor -- start 2024-09-12T12:27:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.590+0000 7f12b3800640 1 -- start start 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.590+0000 7f12b3800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ac101df0 0x7f12ac19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b3800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac1027a0 0x7f12ac19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b3800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac106f20 0x7f12ac19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b3800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac111f40 con 0x7f12ac106f20 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b3800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac111dc0 con 0x7f12ac1027a0 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b3800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1120c0 con 0x7f12ac101df0 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b1800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac106f20 0x7f12ac19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac1027a0 0x7f12ac19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac1027a0 0x7f12ac19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56728/0 (socket says 172.21.15.38:56728) 2024-09-12T12:27:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 -- 172.21.15.38:0/2908643908 learned_addr learned my addr 172.21.15.38:0/2908643908 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ac101df0 0x7f12ac19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 -- 172.21.15.38:0/2908643908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ac101df0 msgr2=0x7f12ac19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ac101df0 0x7f12ac19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 -- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac106f20 msgr2=0x7f12ac19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac106f20 0x7f12ac19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12abe00640 1 -- 172.21.15.38:0/2908643908 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac19f5e0 con 0x7f12ac1027a0 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.591+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ac101df0 0x7f12ac19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.592+0000 7f12abe00640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac1027a0 0x7f12ac19ab70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1298006010 tx=0x7f12980042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.592+0000 7f12a9600640 1 -- 172.21.15.38:0/2908643908 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129803f030 con 0x7f12ac1027a0 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.592+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac19f870 con 0x7f12ac1027a0 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.592+0000 7f12a9600640 1 -- 172.21.15.38:0/2908643908 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1298003ce0 con 0x7f12ac1027a0 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.592+0000 7f12a9600640 1 -- 172.21.15.38:0/2908643908 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298035070 con 0x7f12ac1027a0 2024-09-12T12:27:52.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.592+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a71b0 con 0x7f12ac1027a0 2024-09-12T12:27:52.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.595+0000 7f12b62a6740 1 Processor -- start 2024-09-12T12:27:52.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b62a6740 1 -- start start 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12a9600640 1 -- 172.21.15.38:0/2908643908 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1298042030 con 0x7f12ac1027a0 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2c5e50 0x562cba2c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b62a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562cba2213e0 con 0x562cba2c5e50 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b62a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562cba1c8d80 con 0x562cba2bac70 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b62a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cba21d3a0 con 0x562cba2bb590 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12abe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2c5e50 0x562cba2c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b1800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:44828/0 (socket says 172.21.15.38:44828) 2024-09-12T12:27:52.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.596+0000 7f12b0e00640 1 -- 172.21.15.38:0/2789484175 learned_addr learned my addr 172.21.15.38:0/2789484175 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:52.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.597+0000 7f12b0e00640 1 -- 172.21.15.38:0/2789484175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 msgr2=0x562cba2bb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.597+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2789484175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.597+0000 7f12b0e00640 1 -- 172.21.15.38:0/2789484175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2c5e50 msgr2=0x562cba2c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.597+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2789484175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2c5e50 0x562cba2c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.597+0000 7f12b0e00640 1 -- 172.21.15.38:0/2789484175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cba1e7ae0 con 0x562cba2bb590 2024-09-12T12:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.597+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2789484175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c5910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a00115f0 tx=0x7f12a0011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35e8be1daecf19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.598+0000 7f129e000640 1 -- 172.21.15.38:0/2789484175 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a001e070 con 0x562cba2bb590 2024-09-12T12:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.598+0000 7f129e000640 1 -- 172.21.15.38:0/2789484175 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a000fb20 con 0x562cba2bb590 2024-09-12T12:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.598+0000 7f129e000640 1 -- 172.21.15.38:0/2789484175 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0019c40 con 0x562cba2bb590 2024-09-12T12:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.598+0000 7f12a9600640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12940a2c00 0x7f12940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12a9600640 1 -- 172.21.15.38:0/2908643908 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f12980ef880 con 0x7f12ac1027a0 2024-09-12T12:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b1800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12940a2c00 0x7f12940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b62a6740 1 -- 172.21.15.38:0/2789484175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 msgr2=0x562cba2c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2789484175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c5910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a00115f0 tx=0x7f12a0011ab0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b62a6740 1 -- 172.21.15.38:0/2789484175 shutdown_connections 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2789484175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2c5e50 0x562cba2c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2789484175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c5910 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2789484175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.599+0000 7f12b62a6740 1 -- 172.21.15.38:0/2789484175 >> 172.21.15.38:0/2789484175 conn(0x562cba2b7200 msgr2=0x562cba2b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.600+0000 7f12b1800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12940a2c00 0x7f12940a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12a4005fd0 tx=0x7f12a40096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.600+0000 7f12b62a6740 1 -- 172.21.15.38:0/2789484175 shutdown_connections 2024-09-12T12:27:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.600+0000 7f12b62a6740 1 -- 172.21.15.38:0/2789484175 wait complete. 2024-09-12T12:27:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.600+0000 7f12b62a6740 1 -- start start 2024-09-12T12:27:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.600+0000 7f12b62a6740 1 Processor -- start 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bac70 0x562cba2c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2c5e50 0x562cba2c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b62a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562cba2c8a20 con 0x562cba2bac70 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b62a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562cba1dc0f0 con 0x562cba2c5e50 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b62a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cba2c8ba0 con 0x562cba2bb590 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b62a6740 10 client.0 _ll_register_callbacks cb 0x562cba1c3bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bac70 0x562cba2c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bac70 0x562cba2c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36364/0 (socket says 172.21.15.38:36364) 2024-09-12T12:27:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12b0e00640 1 -- 172.21.15.38:0/2738448643 learned_addr learned my addr 172.21.15.38:0/2738448643 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.601+0000 7f12abe00640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b1800640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2c5e50 0x562cba2c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b0e00640 1 -- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 msgr2=0x562cba2c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b0e00640 1 -- 172.21.15.38:0/2738448643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2c5e50 msgr2=0x562cba2c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2c5e50 0x562cba2c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b0e00640 1 -- 172.21.15.38:0/2738448643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb9f923c0 con 0x562cba2bac70 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12abe00640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b1800640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2c5e50 0x562cba2c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bac70 0x562cba2c2cf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12a000f850 tx=0x7f12a000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff73801bf1f53442 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.602+0000 7f1292a00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.603+0000 7f1292a00640 1 -- 172.21.15.38:0/2738448643 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a001e040 con 0x562cba2bac70 2024-09-12T12:27:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.603+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a000fb20 con 0x562cba2bac70 2024-09-12T12:27:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.603+0000 7f1292a00640 1 -- 172.21.15.38:0/2738448643 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f12a00199c0 con 0x562cba2bac70 2024-09-12T12:27:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.603+0000 7f1292a00640 1 -- 172.21.15.38:0/2738448643 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12a0019410 con 0x562cba2bac70 2024-09-12T12:27:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.603+0000 7f12b62a6740 10 client.15669 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.603+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562cba2d4a40 con 0x562cba2bac70 2024-09-12T12:27:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.603+0000 7f1292a00640 1 -- 172.21.15.38:0/2738448643 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a000fb20 con 0x562cba2bac70 2024-09-12T12:27:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f1292a00640 1 -- 172.21.15.38:0/2738448643 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f12a0005150 con 0x562cba2bac70 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f12b62a6740 10 client.15669 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f12b62a6740 10 client.15669 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f12b62a6740 20 client.15669 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba2d5e50 0x562cba2d8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f12b62a6740 4 client.15669 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cba22e950 con 0x562cba2d5e50 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.604+0000 7f12abe00640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba2d5e50 0x562cba2d8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.605+0000 7f12abe00640 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba2d5e50 0x562cba2d8240 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4f6d041fbecaf7b server_cookie=259dc6621c202836 in_seq=0 out_seq=0 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.605+0000 7f1292a00640 10 client.15669 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.605+0000 7f1292a00640 1 -- 172.21.15.38:0/2738448643 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cba22e950 con 0x562cba2d5e50 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.605+0000 7f1292a00640 10 client.15669 handle_command_reply: tid=0 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 client.15669 shutdown 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bac70 msgr2=0x562cba2c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bac70 0x562cba2c2cf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12a000f850 tx=0x7f12a000f880 comp rx=0 tx=0).stop 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 shutdown_connections 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba2d5e50 0x562cba2d8240 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2c5e50 0x562cba2c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2bb590 0x562cba2c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2738448643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bac70 0x562cba2c2cf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 >> 172.21.15.38:0/2738448643 conn(0x562cba2b7200 msgr2=0x562cba2bcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f1292a00640 0 client.15669 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 shutdown_connections 2024-09-12T12:27:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 1 -- 172.21.15.38:0/2738448643 wait complete. 2024-09-12T12:27:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.606+0000 7f12b62a6740 20 client.15669 trim_cache size 0 max 16384 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.620+0000 7f12b62a6740 1 Processor -- start 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.620+0000 7f12b62a6740 1 -- start start 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2dd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b62a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1b0fc0 con 0x562cba2bb590 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b62a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1b2b00 con 0x562cba2bac70 2024-09-12T12:27:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b62a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1b1690 con 0x562cba2c5e50 2024-09-12T12:27:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12abe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12abe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2dd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36370/0 (socket says 172.21.15.38:36370) 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56760/0 (socket says 172.21.15.38:56760) 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12abe00640 1 -- 172.21.15.38:0/4121728222 learned_addr learned my addr 172.21.15.38:0/4121728222 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b1800640 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b0e00640 1 -- 172.21.15.38:0/4121728222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 msgr2=0x562cba2ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b0e00640 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2ddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b0e00640 1 -- 172.21.15.38:0/4121728222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 msgr2=0x562cba2dd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b0e00640 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2dd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.621+0000 7f12b0e00640 1 -- 172.21.15.38:0/4121728222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cba2b7030 con 0x562cba2bac70 2024-09-12T12:27:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.622+0000 7f12b0e00640 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bd6d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f12a00056c0 tx=0x7f12a0004600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba78c5c0341d779c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.622+0000 7f129d600640 1 -- 172.21.15.38:0/4121728222 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0030030 con 0x562cba2bac70 2024-09-12T12:27:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.622+0000 7f129d600640 1 -- 172.21.15.38:0/4121728222 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a0015070 con 0x562cba2bac70 2024-09-12T12:27:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.622+0000 7f129d600640 1 -- 172.21.15.38:0/4121728222 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a001e040 con 0x562cba2bac70 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 -- 172.21.15.38:0/4121728222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 msgr2=0x562cba2bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bd6d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f12a00056c0 tx=0x7f12a0004600 comp rx=0 tx=0).stop 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 -- 172.21.15.38:0/4121728222 shutdown_connections 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2ddec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2dd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 --2- 172.21.15.38:0/4121728222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2bd6d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 -- 172.21.15.38:0/4121728222 >> 172.21.15.38:0/4121728222 conn(0x562cba2b7200 msgr2=0x562cba2c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 -- 172.21.15.38:0/4121728222 shutdown_connections 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 -- 172.21.15.38:0/4121728222 wait complete. 2024-09-12T12:27:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.623+0000 7f12b62a6740 1 -- start start 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 1 Processor -- start 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2bef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1b2430 con 0x562cba2bb590 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1b1d60 con 0x562cba2bac70 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1aefa0 con 0x562cba2c5e50 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b62a6740 10 client.0 _ll_register_callbacks cb 0x7f12a001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.624+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56776/0 (socket says 172.21.15.38:56776) 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12abe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 -- 172.21.15.38:0/2447763858 learned_addr learned my addr 172.21.15.38:0/2447763858 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b1800640 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 -- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 msgr2=0x562cba2bef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2bef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 -- 172.21.15.38:0/2447763858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 msgr2=0x562cba2ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 -- 172.21.15.38:0/2447763858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cba2b2770 con 0x562cba2bac70 2024-09-12T12:27:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f12b0e00640 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2cde20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f12a0011fd0 tx=0x7f12a0005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d2570f535a1be05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.625+0000 7f1292a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f1292a00640 1 -- 172.21.15.38:0/2447763858 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0030030 con 0x562cba2bac70 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f1292a00640 1 -- 172.21.15.38:0/2447763858 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f12a002d040 con 0x562cba2bac70 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a0015070 con 0x562cba2bac70 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f1292a00640 1 -- 172.21.15.38:0/2447763858 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12a0042050 con 0x562cba2bac70 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f12b62a6740 10 client.25682 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562cba33fc60 con 0x562cba2bac70 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f1292a00640 1 -- 172.21.15.38:0/2447763858 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a0015070 con 0x562cba2bac70 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.626+0000 7f1292a00640 1 -- 172.21.15.38:0/2447763858 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f12a0005130 con 0x562cba2bac70 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.627+0000 7f12b62a6740 10 client.25682 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.627+0000 7f12b62a6740 10 client.25682 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:27:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.627+0000 7f12b62a6740 20 client.25682 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.627+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba3402b0 0x562cba3426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.627+0000 7f12b62a6740 4 client.25682 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.627+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cba228e60 con 0x562cba3402b0 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.627+0000 7f12abe00640 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba3402b0 0x562cba3426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12abe00640 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba3402b0 0x562cba3426a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a35699b507b2c20e server_cookie=7becf0fa91cfe0eb in_seq=0 out_seq=0 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f1292a00640 10 client.25682 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f1292a00640 1 -- 172.21.15.38:0/2447763858 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cba228e60 con 0x562cba3402b0 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f1292a00640 10 client.25682 handle_command_reply: tid=0 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 client.25682 shutdown 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 msgr2=0x562cba2cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2cde20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f12a0011fd0 tx=0x7f12a0005d90 comp rx=0 tx=0).stop 2024-09-12T12:27:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 shutdown_connections 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x562cba3402b0 0x562cba3426a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba2c5e50 0x562cba2bef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562cba2bb590 0x562cba2ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f1292a00640 0 client.25682 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 --2- 172.21.15.38:0/2447763858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562cba2bac70 0x562cba2cde20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 >> 172.21.15.38:0/2447763858 conn(0x562cba2b7200 msgr2=0x562cba2c2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 shutdown_connections 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.628+0000 7f12b62a6740 1 -- 172.21.15.38:0/2447763858 wait complete. 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b62a6740 20 client.25682 trim_cache size 0 max 16384 2024-09-12T12:27:52.634 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12940a2c00 msgr2=0x7f12940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12940a2c00 0x7f12940a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12a4005fd0 tx=0x7f12a40096a0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac1027a0 msgr2=0x7f12ac19ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac1027a0 0x7f12ac19ab70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1298006010 tx=0x7f12980042f0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 shutdown_connections 2024-09-12T12:27:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f12940a2c00 0x7f12940a50c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ac106f20 0x7f12ac19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12ac1027a0 0x7f12ac19ab70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 --2- 172.21.15.38:0/2908643908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ac101df0 0x7f12ac19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.629+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 >> 172.21.15.38:0/2908643908 conn(0x7f12ac0fd8b0 msgr2=0x7f12ac0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.630+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 shutdown_connections 2024-09-12T12:27:52.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:52.630+0000 7f12b3800640 1 -- 172.21.15.38:0/2908643908 wait complete. 2024-09-12T12:27:53.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:53 smithi038 ceph-mon[30810]: pgmap v452: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-09-12T12:27:53.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:53 smithi071 ceph-mon[34859]: pgmap v452: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-09-12T12:27:53.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:53 smithi154 ceph-mon[35578]: pgmap v452: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-09-12T12:27:53.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:27:54.166 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 -- 172.21.15.38:0/2413807519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534410c160 msgr2=0x7f534410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 --2- 172.21.15.38:0/2413807519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534410c160 0x7f534410e600 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ca0 tx=0x7f533c02a950 comp rx=0 tx=0).stop 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 -- 172.21.15.38:0/2413807519 shutdown_connections 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 --2- 172.21.15.38:0/2413807519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534410c160 0x7f534410e600 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 --2- 172.21.15.38:0/2413807519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5344103650 0x7f534410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 --2- 172.21.15.38:0/2413807519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5344102d30 0x7f5344103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 -- 172.21.15.38:0/2413807519 >> 172.21.15.38:0/2413807519 conn(0x7f53440fc790 msgr2=0x7f53440febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 -- 172.21.15.38:0/2413807519 shutdown_connections 2024-09-12T12:27:54.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.749+0000 7f5348c00640 1 -- 172.21.15.38:0/2413807519 wait complete. 2024-09-12T12:27:54.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 Processor -- start 2024-09-12T12:27:54.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 -- start start 2024-09-12T12:27:54.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5344102d30 0x7f534419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5344103650 0x7f534419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534410c160 0x7f534419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5344111f90 con 0x7f5344103650 2024-09-12T12:27:54.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5344111e10 con 0x7f5344102d30 2024-09-12T12:27:54.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.751+0000 7f5348c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5344112110 con 0x7f534410c160 2024-09-12T12:27:54.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f533be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5344103650 0x7f534419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f533be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5344103650 0x7f534419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36388/0 (socket says 172.21.15.38:36388) 2024-09-12T12:27:54.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f533be00640 1 -- 172.21.15.38:0/3290619856 learned_addr learned my addr 172.21.15.38:0/3290619856 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:54.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f5342800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534410c160 0x7f534419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f5341e00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5344102d30 0x7f534419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f5341e00640 1 -- 172.21.15.38:0/3290619856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534410c160 msgr2=0x7f534419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f5341e00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534410c160 0x7f534419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f5341e00640 1 -- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5344103650 msgr2=0x7f534419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f5341e00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5344103650 0x7f534419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.752+0000 7f5341e00640 1 -- 172.21.15.38:0/3290619856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534419f630 con 0x7f5344102d30 2024-09-12T12:27:54.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.753+0000 7f5341e00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5344102d30 0x7f534419a680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f533400e9f0 tx=0x7f533400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:54.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.753+0000 7f533aa00640 1 -- 172.21.15.38:0/3290619856 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533400ccc0 con 0x7f5344102d30 2024-09-12T12:27:54.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.753+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534419f920 con 0x7f5344102d30 2024-09-12T12:27:54.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.753+0000 7f533aa00640 1 -- 172.21.15.38:0/3290619856 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5334010910 con 0x7f5344102d30 2024-09-12T12:27:54.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.753+0000 7f533aa00640 1 -- 172.21.15.38:0/3290619856 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334018960 con 0x7f5344102d30 2024-09-12T12:27:54.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.753+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53441a7200 con 0x7f5344102d30 2024-09-12T12:27:54.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.756+0000 7f534b86b740 1 Processor -- start 2024-09-12T12:27:54.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.756+0000 7f534b86b740 1 -- start start 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f534b86b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3ba050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f534b86b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3ba590 0x555aad3c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f534b86b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3c4e50 0x555aad3c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f534b86b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555aad3203e0 con 0x555aad3ba590 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f534b86b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555aad2c7d80 con 0x555aad3b9c70 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f534b86b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555aad31c3a0 con 0x555aad3c4e50 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f5342800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3ba050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f5342800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3ba050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56798/0 (socket says 172.21.15.38:56798) 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f5342800640 1 -- 172.21.15.38:0/1504930655 learned_addr learned my addr 172.21.15.38:0/1504930655 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f533be00640 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3c4e50 0x555aad3c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f5342800640 1 -- 172.21.15.38:0/1504930655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3c4e50 msgr2=0x555aad3c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:54.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f5342800640 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3c4e50 0x555aad3c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f5342800640 1 -- 172.21.15.38:0/1504930655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3ba590 msgr2=0x555aad3c4910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:27:54.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.757+0000 7f5342800640 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3ba590 0x555aad3c4910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.758+0000 7f5342800640 1 -- 172.21.15.38:0/1504930655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aad2e6ae0 con 0x555aad3b9c70 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.758+0000 7f5342800640 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3ba050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ca0 tx=0x7f533c005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3c0178b41cd9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.758+0000 7f533aa00640 1 -- 172.21.15.38:0/3290619856 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5334010ac0 con 0x7f5344102d30 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.758+0000 7f5333000640 1 -- 172.21.15.38:0/1504930655 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c048070 con 0x555aad3b9c70 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.758+0000 7f5333000640 1 -- 172.21.15.38:0/1504930655 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c003e50 con 0x555aad3b9c70 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.758+0000 7f5333000640 1 -- 172.21.15.38:0/1504930655 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c034040 con 0x555aad3b9c70 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.759+0000 7f534b86b740 1 -- 172.21.15.38:0/1504930655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 msgr2=0x555aad3ba050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.759+0000 7f534b86b740 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3ba050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ca0 tx=0x7f533c005f80 comp rx=0 tx=0).stop 2024-09-12T12:27:54.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.759+0000 7f533aa00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f53280a2b80 0x7f53280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.759+0000 7f534b86b740 1 -- 172.21.15.38:0/1504930655 shutdown_connections 2024-09-12T12:27:54.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.759+0000 7f534b86b740 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3c4e50 0x555aad3c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.759+0000 7f534b86b740 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3ba590 0x555aad3c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.760+0000 7f534b86b740 1 --2- 172.21.15.38:0/1504930655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3ba050 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.760+0000 7f534b86b740 1 -- 172.21.15.38:0/1504930655 >> 172.21.15.38:0/1504930655 conn(0x555aad3b6200 msgr2=0x555aad3b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:54.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.760+0000 7f533aa00640 1 -- 172.21.15.38:0/3290619856 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f53340cf7e0 con 0x7f5344102d30 2024-09-12T12:27:54.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.760+0000 7f5342800640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f53280a2b80 0x7f53280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.760+0000 7f534b86b740 1 -- 172.21.15.38:0/1504930655 shutdown_connections 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.760+0000 7f534b86b740 1 -- 172.21.15.38:0/1504930655 wait complete. 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 -- start start 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f5342800640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f53280a2b80 0x7f53280a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f533c005e30 tx=0x7f533c02a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 Processor -- start 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555aad3c7a20 con 0x555aad3c4e50 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555aad2db0f0 con 0x555aad3b9c70 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555aad3c7ba0 con 0x555aad3ba590 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.761+0000 7f534b86b740 10 client.0 _ll_register_callbacks cb 0x555aad2c2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56810/0 (socket says 172.21.15.38:56810) 2024-09-12T12:27:54.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 -- 172.21.15.38:0/254213883 learned_addr learned my addr 172.21.15.38:0/254213883 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f533be00640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5342800640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 -- 172.21.15.38:0/254213883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 msgr2=0x555aad3c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 -- 172.21.15.38:0/254213883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 msgr2=0x555aad3c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 -- 172.21.15.38:0/254213883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aad0913c0 con 0x555aad3b9c70 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5342800640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5341e00640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c1d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f533400e9c0 tx=0x7f533409bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=248d523261ea013e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:54.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.762+0000 7f5327400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.763+0000 7f5327400640 1 -- 172.21.15.38:0/254213883 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533409b330 con 0x555aad3b9c70 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.763+0000 7f5327400640 1 -- 172.21.15.38:0/254213883 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f5334010430 con 0x555aad3b9c70 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.763+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533c003e50 con 0x555aad3b9c70 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.763+0000 7f5327400640 1 -- 172.21.15.38:0/254213883 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5334010630 con 0x555aad3b9c70 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.763+0000 7f534b86b740 10 client.25694 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.763+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555aad3d3ac0 con 0x555aad3b9c70 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.763+0000 7f5327400640 1 -- 172.21.15.38:0/254213883 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c003e50 con 0x555aad3b9c70 2024-09-12T12:27:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f5327400640 1 -- 172.21.15.38:0/254213883 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5334097ac0 con 0x555aad3b9c70 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f534b86b740 10 client.25694 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f534b86b740 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f534b86b740 20 client.25694 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f534b86b740 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad3d4f80 0x555aad3d7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f534b86b740 4 client.25694 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aad32d950 con 0x555aad3d4f80 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.764+0000 7f533be00640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad3d4f80 0x555aad3d7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.765+0000 7f533be00640 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad3d4f80 0x555aad3d7370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7d78a36f00be942 server_cookie=94b14dc3360de914 in_seq=0 out_seq=0 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.765+0000 7f5327400640 10 client.25694 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f5327400640 1 -- 172.21.15.38:0/254213883 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555aad32d950 con 0x555aad3d4f80 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f5327400640 10 client.25694 handle_command_reply: tid=0 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 client.25694 shutdown 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 msgr2=0x555aad3c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c1d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f533400e9c0 tx=0x7f533409bce0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 shutdown_connections 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad3d4f80 0x555aad3d7370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 --2- 172.21.15.38:0/254213883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c1d70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 >> 172.21.15.38:0/254213883 conn(0x555aad3b6200 msgr2=0x555aad3bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f5327400640 0 client.25694 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 shutdown_connections 2024-09-12T12:27:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 1 -- 172.21.15.38:0/254213883 wait complete. 2024-09-12T12:27:54.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.766+0000 7f534b86b740 20 client.25694 trim_cache size 0 max 16384 2024-09-12T12:27:54.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.780+0000 7f534b86b740 1 Processor -- start 2024-09-12T12:27:54.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.780+0000 7f534b86b740 1 -- start start 2024-09-12T12:27:54.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f534b86b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f534b86b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f534b86b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3dcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f534b86b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f53441b0fa0 con 0x555aad3c4e50 2024-09-12T12:27:54.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f534b86b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53441b2ae0 con 0x555aad3b9c70 2024-09-12T12:27:54.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f534b86b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53441b1670 con 0x555aad3ba590 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f5341e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f533be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f5342800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3dcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f5341e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56816/0 (socket says 172.21.15.38:56816) 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f5341e00640 1 -- 172.21.15.38:0/4217679224 learned_addr learned my addr 172.21.15.38:0/4217679224 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.781+0000 7f533be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:44888/0 (socket says 172.21.15.38:44888) 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5341e00640 1 -- 172.21.15.38:0/4217679224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 msgr2=0x555aad3b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5341e00640 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5341e00640 1 -- 172.21.15.38:0/4217679224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 msgr2=0x555aad3dcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5341e00640 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3dcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5341e00640 1 -- 172.21.15.38:0/4217679224 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aad3b1770 con 0x555aad3b9c70 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f533be00640 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:54.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5341e00640 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c2640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53340986b0 tx=0x7f533409a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef9a84e554afa2c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:54.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5332600640 1 -- 172.21.15.38:0/4217679224 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334097a30 con 0x555aad3b9c70 2024-09-12T12:27:54.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5332600640 1 -- 172.21.15.38:0/4217679224 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5334097bd0 con 0x555aad3b9c70 2024-09-12T12:27:54.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.782+0000 7f5332600640 1 -- 172.21.15.38:0/4217679224 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340a14e0 con 0x555aad3b9c70 2024-09-12T12:27:54.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 -- 172.21.15.38:0/4217679224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 msgr2=0x555aad3c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c2640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53340986b0 tx=0x7f533409a1f0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 -- 172.21.15.38:0/4217679224 shutdown_connections 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3dcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 --2- 172.21.15.38:0/4217679224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3c2640 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 -- 172.21.15.38:0/4217679224 >> 172.21.15.38:0/4217679224 conn(0x555aad3b6200 msgr2=0x555aad3b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 -- 172.21.15.38:0/4217679224 shutdown_connections 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.783+0000 7f534b86b740 1 -- 172.21.15.38:0/4217679224 wait complete. 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.784+0000 7f534b86b740 1 -- start start 2024-09-12T12:27:54.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.784+0000 7f534b86b740 1 Processor -- start 2024-09-12T12:27:54.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.784+0000 7f534b86b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f534b86b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f534b86b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f534b86b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f53441b2410 con 0x555aad3c4e50 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f534b86b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53441b1d40 con 0x555aad3b9c70 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f534b86b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53441aef80 con 0x555aad3ba590 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f534b86b740 10 client.0 _ll_register_callbacks cb 0x7f533409b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5342800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:56830/0 (socket says 172.21.15.38:56830) 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 -- 172.21.15.38:0/1452945482 learned_addr learned my addr 172.21.15.38:0/1452945482 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:54.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f533be00640 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 -- 172.21.15.38:0/1452945482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 msgr2=0x555aad3cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 -- 172.21.15.38:0/1452945482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 msgr2=0x555aad3be5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3be5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.785+0000 7f5341e00640 1 -- 172.21.15.38:0/1452945482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aad3bedc0 con 0x555aad3b9c70 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f5341e00640 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3cd000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5334098140 tx=0x7f533409be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0e54468f467c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f5327400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f5327400640 1 -- 172.21.15.38:0/1452945482 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334097a30 con 0x555aad3b9c70 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f5327400640 1 -- 172.21.15.38:0/1452945482 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f533407ad60 con 0x555aad3b9c70 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5334097bd0 con 0x555aad3b9c70 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f5327400640 1 -- 172.21.15.38:0/1452945482 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5334085020 con 0x555aad3b9c70 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f534b86b740 10 client.25700 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:54.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.786+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555aad3bedc0 con 0x555aad3b9c70 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f5327400640 1 -- 172.21.15.38:0/1452945482 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5334097bd0 con 0x555aad3b9c70 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f5327400640 1 -- 172.21.15.38:0/1452945482 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5334086380 con 0x555aad3b9c70 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f534b86b740 10 client.25700 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f534b86b740 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f534b86b740 20 client.25700 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f534b86b740 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad43f850 0x555aad441c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f534b86b740 4 client.25700 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555aad327e60 con 0x555aad43f850 2024-09-12T12:27:54.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.787+0000 7f533be00640 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad43f850 0x555aad441c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:54.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f5327400640 10 client.25700 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f533be00640 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad43f850 0x555aad441c40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84850f11652e6163 server_cookie=d427fa45c8a39458 in_seq=0 out_seq=0 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f5327400640 1 -- 172.21.15.38:0/1452945482 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555aad327e60 con 0x555aad43f850 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f5327400640 10 client.25700 handle_command_reply: tid=0 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 client.25700 shutdown 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 msgr2=0x555aad3cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3cd000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5334098140 tx=0x7f533409be10 comp rx=0 tx=0).stop 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 shutdown_connections 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x555aad43f850 0x555aad441c40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555aad3c4e50 0x555aad3be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aad3ba590 0x555aad3cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 --2- 172.21.15.38:0/1452945482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555aad3b9c70 0x555aad3cd000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 >> 172.21.15.38:0/1452945482 conn(0x555aad3b6200 msgr2=0x555aad3b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:54.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f5327400640 0 client.25700 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:54.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.788+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 shutdown_connections 2024-09-12T12:27:54.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.789+0000 7f534b86b740 1 -- 172.21.15.38:0/1452945482 wait complete. 2024-09-12T12:27:54.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.789+0000 7f534b86b740 20 client.25700 trim_cache size 0 max 16384 2024-09-12T12:27:54.793 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:27:54.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.789+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f53280a2b80 msgr2=0x7f53280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.789+0000 7f5348c00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f53280a2b80 0x7f53280a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f533c005e30 tx=0x7f533c02a950 comp rx=0 tx=0).stop 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.789+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5344102d30 msgr2=0x7f534419a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.789+0000 7f5348c00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5344102d30 0x7f534419a680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f533400e9f0 tx=0x7f533400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 shutdown_connections 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f53280a2b80 0x7f53280a5040 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f534410c160 0x7f534419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5344103650 0x7f534419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 --2- 172.21.15.38:0/3290619856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5344102d30 0x7f534419a680 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 >> 172.21.15.38:0/3290619856 conn(0x7f53440fc790 msgr2=0x7f53441008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 shutdown_connections 2024-09-12T12:27:54.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:54.790+0000 7f5348c00640 1 -- 172.21.15.38:0/3290619856 wait complete. 2024-09-12T12:27:55.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:55 smithi071 ceph-mon[34859]: pgmap v453: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 17 op/s 2024-09-12T12:27:55.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:55 smithi038 ceph-mon[30810]: pgmap v453: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 17 op/s 2024-09-12T12:27:55.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:55 smithi154 ceph-mon[35578]: pgmap v453: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 17 op/s 2024-09-12T12:27:56.651 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:27:56.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:57.472 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:57 smithi038 ceph-mon[30810]: pgmap v454: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 10 op/s 2024-09-12T12:27:57.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:57 smithi071 ceph-mon[34859]: pgmap v454: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 10 op/s 2024-09-12T12:27:57.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 -- 172.21.15.38:0/3987771523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 msgr2=0x7f1714101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 --2- 172.21.15.38:0/3987771523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714101e20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1700009930 tx=0x7f170002a420 comp rx=0 tx=0).stop 2024-09-12T12:27:57.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 -- 172.21.15.38:0/3987771523 shutdown_connections 2024-09-12T12:27:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 --2- 172.21.15.38:0/3987771523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1714102360 0x7f171410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 --2- 172.21.15.38:0/3987771523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714101e20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 --2- 172.21.15.38:0/3987771523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17141079c0 0x7f1714107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 -- 172.21.15.38:0/3987771523 >> 172.21.15.38:0/3987771523 conn(0x7f17140fd740 msgr2=0x7f17140ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 -- 172.21.15.38:0/3987771523 shutdown_connections 2024-09-12T12:27:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.644+0000 7f171ae00640 1 -- 172.21.15.38:0/3987771523 wait complete. 2024-09-12T12:27:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.645+0000 7f171ae00640 1 Processor -- start 2024-09-12T12:27:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.645+0000 7f171ae00640 1 -- start start 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f171ae00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f171ae00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1714102360 0x7f1714198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f171ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17141079c0 0x7f171419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f171ae00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1714111de0 con 0x7f17141019c0 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f171ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1714111c60 con 0x7f17141079c0 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f171ae00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1714111f60 con 0x7f1714102360 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f1719a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f1719a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59984/0 (socket says 172.21.15.38:59984) 2024-09-12T12:27:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f1719a00640 1 -- 172.21.15.38:0/1928695546 learned_addr learned my addr 172.21.15.38:0/1928695546 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f171a400640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17141079c0 0x7f171419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.646+0000 7f1719000640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1714102360 0x7f1714198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1719a00640 1 -- 172.21.15.38:0/1928695546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1714102360 msgr2=0x7f1714198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1719a00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1714102360 0x7f1714198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1719a00640 1 -- 172.21.15.38:0/1928695546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17141079c0 msgr2=0x7f171419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1719a00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17141079c0 0x7f171419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1719a00640 1 -- 172.21.15.38:0/1928695546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171419d2b0 con 0x7f17141019c0 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1719a00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714198300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f170800e9f0 tx=0x7f170800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1712000640 1 -- 172.21.15.38:0/1928695546 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170800cd80 con 0x7f17141019c0 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171419d5a0 con 0x7f17141019c0 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.647+0000 7f1712000640 1 -- 172.21.15.38:0/1928695546 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1708005500 con 0x7f17141019c0 2024-09-12T12:27:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.648+0000 7f1712000640 1 -- 172.21.15.38:0/1928695546 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708010690 con 0x7f17141019c0 2024-09-12T12:27:57.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.648+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17141a4e80 con 0x7f17141019c0 2024-09-12T12:27:57.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.651+0000 7f1712000640 1 -- 172.21.15.38:0/1928695546 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f17080046c0 con 0x7f17141019c0 2024-09-12T12:27:57.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.651+0000 7f171efd7740 1 Processor -- start 2024-09-12T12:27:57.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.651+0000 7f171efd7740 1 -- start start 2024-09-12T12:27:57.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.651+0000 7f171efd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24014af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.651+0000 7f171efd7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b240159d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.651+0000 7f171efd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24015c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.651+0000 7f171efd7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b2400b1290 con 0x55b24014b4d0 2024-09-12T12:27:57.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171efd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b240058b40 con 0x55b24014abb0 2024-09-12T12:27:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171efd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b2400ad250 con 0x55b24015a2a0 2024-09-12T12:27:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f1719a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b240159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24014af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57106/0 (socket says 172.21.15.38:57106) 2024-09-12T12:27:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 -- 172.21.15.38:0/1757274516 learned_addr learned my addr 172.21.15.38:0/1757274516 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f1719000640 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 -- 172.21.15.38:0/1757274516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 msgr2=0x55b24015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24015c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 -- 172.21.15.38:0/1757274516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 msgr2=0x55b240159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b240159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.652+0000 7f171a400640 1 -- 172.21.15.38:0/1757274516 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23fe226a0 con 0x55b24014abb0 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.653+0000 7f1719000640 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.653+0000 7f1712000640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f16fc0a2b80 0x7f16fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.653+0000 7f1712000640 1 -- 172.21.15.38:0/1928695546 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f17080cf7f0 con 0x7f17141019c0 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.653+0000 7f1719a00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f16fc0a2b80 0x7f16fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.653+0000 7f171a400640 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24014af90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f170c010370 tx=0x7f170c010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ec88416418f7c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.653+0000 7f1706a00640 1 -- 172.21.15.38:0/1757274516 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c016070 con 0x55b24014abb0 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.654+0000 7f1706a00640 1 -- 172.21.15.38:0/1757274516 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c004d20 con 0x55b24014abb0 2024-09-12T12:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.654+0000 7f1706a00640 1 -- 172.21.15.38:0/1757274516 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c0053e0 con 0x55b24014abb0 2024-09-12T12:27:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.654+0000 7f171efd7740 1 -- 172.21.15.38:0/1757274516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 msgr2=0x55b24014af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.654+0000 7f171efd7740 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24014af90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f170c010370 tx=0x7f170c010830 comp rx=0 tx=0).stop 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.654+0000 7f1719a00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f16fc0a2b80 0x7f16fc0a5040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f17080980a0 tx=0x7f17080d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 -- 172.21.15.38:0/1757274516 shutdown_connections 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b240159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 --2- 172.21.15.38:0/1757274516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24014af90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 -- 172.21.15.38:0/1757274516 >> 172.21.15.38:0/1757274516 conn(0x55b240147240 msgr2=0x55b240147620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 -- 172.21.15.38:0/1757274516 shutdown_connections 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 -- 172.21.15.38:0/1757274516 wait complete. 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.655+0000 7f171efd7740 1 -- start start 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 1 Processor -- start 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b240159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b240156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b2401573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b24015cf70 con 0x55b24014abb0 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b24006bfa0 con 0x55b24015a2a0 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b24015d0f0 con 0x55b24014b4d0 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.656+0000 7f171efd7740 10 client.0 _ll_register_callbacks cb 0x55b23fdbfba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b240159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b240159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60002/0 (socket says 172.21.15.38:60002) 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 -- 172.21.15.38:0/721748702 learned_addr learned my addr 172.21.15.38:0/721748702 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b2401573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f1719000640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b240156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 -- 172.21.15.38:0/721748702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 msgr2=0x55b240156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b240156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 -- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 msgr2=0x55b2401573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b2401573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f171a400640 1 -- 172.21.15.38:0/721748702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b240157c00 con 0x55b24014abb0 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.657+0000 7f1719000640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b240156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f171a400640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b240159be0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f170c009bf0 tx=0x7f170c012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7d247fcfdde327 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f16fb400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f16fb400640 1 -- 172.21.15.38:0/721748702 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c016070 con 0x55b24014abb0 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f16fb400640 1 -- 172.21.15.38:0/721748702 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f170c012710 con 0x55b24014abb0 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170c004d20 con 0x55b24014abb0 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f16fb400640 1 -- 172.21.15.38:0/721748702 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f170c003e30 con 0x55b24014abb0 2024-09-12T12:27:57.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f171efd7740 10 client.15699 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.658+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b240168ec0 con 0x55b24014abb0 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f16fb400640 1 -- 172.21.15.38:0/721748702 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c004d20 con 0x55b24014abb0 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f16fb400640 1 -- 172.21.15.38:0/721748702 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f170c00f040 con 0x55b24014abb0 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f171efd7740 10 client.15699 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f171efd7740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f171efd7740 20 client.15699 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f171efd7740 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b24016a210 0x55b24016c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f171efd7740 4 client.15699 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:57.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2400be800 con 0x55b24016a210 2024-09-12T12:27:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.659+0000 7f1719000640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b24016a210 0x55b24016c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.660+0000 7f1719000640 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b24016a210 0x55b24016c600 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca86050f1f8bd3e server_cookie=5df8f8ee915ba914 in_seq=0 out_seq=0 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.660+0000 7f16fb400640 10 client.15699 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f16fb400640 1 -- 172.21.15.38:0/721748702 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2400be800 con 0x55b24016a210 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f16fb400640 10 client.15699 handle_command_reply: tid=0 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 client.15699 shutdown 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 msgr2=0x55b240159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b240159be0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f170c009bf0 tx=0x7f170c012f60 comp rx=0 tx=0).stop 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 shutdown_connections 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b24016a210 0x55b24016c600 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b2401573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b240156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 --2- 172.21.15.38:0/721748702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b240159be0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 >> 172.21.15.38:0/721748702 conn(0x55b240147240 msgr2=0x55b24014cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.661+0000 7f16fb400640 0 client.15699 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.662+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 shutdown_connections 2024-09-12T12:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.662+0000 7f171efd7740 1 -- 172.21.15.38:0/721748702 wait complete. 2024-09-12T12:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.662+0000 7f171efd7740 20 client.15699 trim_cache size 0 max 16384 2024-09-12T12:27:57.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:57 smithi154 ceph-mon[35578]: pgmap v454: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 10 op/s 2024-09-12T12:27:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.680+0000 7f171efd7740 1 Processor -- start 2024-09-12T12:27:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.680+0000 7f171efd7740 1 -- start start 2024-09-12T12:27:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171efd7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b24016f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171efd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b24016f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171efd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b240154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171efd7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f17141acab0 con 0x55b24014abb0 2024-09-12T12:27:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171efd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17141ae5f0 con 0x55b24015a2a0 2024-09-12T12:27:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171efd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17141ad180 con 0x55b24014b4d0 2024-09-12T12:27:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b24016f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b24016f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60014/0 (socket says 172.21.15.38:60014) 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171a400640 1 -- 172.21.15.38:0/1590276951 learned_addr learned my addr 172.21.15.38:0/1590276951 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f1719000640 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b24016f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.681+0000 7f171a400640 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b240154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f171a400640 1 -- 172.21.15.38:0/1590276951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 msgr2=0x55b24016f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f171a400640 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b24016f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f171a400640 1 -- 172.21.15.38:0/1590276951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 msgr2=0x55b240154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f171a400640 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b240154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f171a400640 1 -- 172.21.15.38:0/1590276951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b24014c210 con 0x55b24014abb0 2024-09-12T12:27:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f171a400640 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b24016f240 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f170c0050f0 tx=0x7f170c0093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142b3af7f3ac4a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f1706000640 1 -- 172.21.15.38:0/1590276951 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c016070 con 0x55b24014abb0 2024-09-12T12:27:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f1706000640 1 -- 172.21.15.38:0/1590276951 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c01f030 con 0x55b24014abb0 2024-09-12T12:27:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.682+0000 7f1706000640 1 -- 172.21.15.38:0/1590276951 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c004230 con 0x55b24014abb0 2024-09-12T12:27:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 -- 172.21.15.38:0/1590276951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 msgr2=0x55b24016f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b24016f240 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f170c0050f0 tx=0x7f170c0093c0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 -- 172.21.15.38:0/1590276951 shutdown_connections 2024-09-12T12:27:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24015a2a0 0x55b240154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24014b4d0 0x55b24016f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 --2- 172.21.15.38:0/1590276951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014abb0 0x55b24016f240 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 -- 172.21.15.38:0/1590276951 >> 172.21.15.38:0/1590276951 conn(0x55b240147240 msgr2=0x55b240152520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 -- 172.21.15.38:0/1590276951 shutdown_connections 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.683+0000 7f171efd7740 1 -- 172.21.15.38:0/1590276951 wait complete. 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 -- start start 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 Processor -- start 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24016fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b24016cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24016d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f17141adf20 con 0x55b24014b4d0 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17141ad850 con 0x55b24014abb0 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17141aaa90 con 0x55b24015a2a0 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.684+0000 7f171efd7740 10 client.0 _ll_register_callbacks cb 0x7f17080d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b24016cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b24016cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60024/0 (socket says 172.21.15.38:60024) 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 -- 172.21.15.38:0/920152569 learned_addr learned my addr 172.21.15.38:0/920152569 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f171a400640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24016d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f171a400640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24016fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 -- 172.21.15.38:0/920152569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 msgr2=0x55b24016d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24016d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 -- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 msgr2=0x55b24016fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24016fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f1719000640 1 -- 172.21.15.38:0/920152569 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24014b300 con 0x55b24014b4d0 2024-09-12T12:27:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.685+0000 7f171a400640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24016fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f1719000640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b24016cd90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1700000c00 tx=0x7f170002ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15475a5ca9ddcbb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f16fb400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f16fb400640 1 -- 172.21.15.38:0/920152569 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700035040 con 0x55b24014b4d0 2024-09-12T12:27:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f16fb400640 1 -- 172.21.15.38:0/920152569 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f1700004040 con 0x55b24014b4d0 2024-09-12T12:27:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170c01f030 con 0x55b24014b4d0 2024-09-12T12:27:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f16fb400640 1 -- 172.21.15.38:0/920152569 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1700004260 con 0x55b24014b4d0 2024-09-12T12:27:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f171efd7740 10 client.15705 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.686+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b2401d4ac0 con 0x55b24014b4d0 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f16fb400640 1 -- 172.21.15.38:0/920152569 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c01f030 con 0x55b24014b4d0 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f16fb400640 1 -- 172.21.15.38:0/920152569 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f170003c560 con 0x55b24014b4d0 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f171efd7740 10 client.15705 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f171efd7740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f171efd7740 20 client.15705 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f171efd7740 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b2401d5240 0x55b2401d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f171efd7740 4 client.15705 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b2400b8d10 con 0x55b2401d5240 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.687+0000 7f171a400640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b2401d5240 0x55b2401d7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.688+0000 7f171a400640 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b2401d5240 0x55b2401d7660 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b24cfe50f08a177 server_cookie=4a9583d591afaf51 in_seq=0 out_seq=0 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.688+0000 7f16fb400640 10 client.15705 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f16fb400640 1 -- 172.21.15.38:0/920152569 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b2400b8d10 con 0x55b2401d5240 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f16fb400640 10 client.15705 handle_command_reply: tid=0 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 client.15705 shutdown 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 msgr2=0x55b24016cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b24016cd90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1700000c00 tx=0x7f170002ab60 comp rx=0 tx=0).stop 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 shutdown_connections 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55b2401d5240 0x55b2401d7660 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b24015a2a0 0x55b24016d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b24014b4d0 0x55b24016cd90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 --2- 172.21.15.38:0/920152569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b24014abb0 0x55b24016fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 >> 172.21.15.38:0/920152569 conn(0x55b240147240 msgr2=0x55b240155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f16fb400640 0 client.15705 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 shutdown_connections 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.689+0000 7f171efd7740 1 -- 172.21.15.38:0/920152569 wait complete. 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171efd7740 20 client.15705 trim_cache size 0 max 16384 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "71331660-dbdd-4563-a472-796e25876e2d", 2024-09-12T12:27:57.694 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-12T12:27:57.695 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:27:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f16fc0a2b80 msgr2=0x7f16fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f16fc0a2b80 0x7f16fc0a5040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f17080980a0 tx=0x7f17080d5530 comp rx=0 tx=0).stop 2024-09-12T12:27:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 msgr2=0x7f1714198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714198300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f170800e9f0 tx=0x7f170800edf0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 shutdown_connections 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f16fc0a2b80 0x7f16fc0a5040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17141079c0 0x7f171419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1714102360 0x7f1714198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 --2- 172.21.15.38:0/1928695546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17141019c0 0x7f1714198300 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.690+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 >> 172.21.15.38:0/1928695546 conn(0x7f17140fd740 msgr2=0x7f17140fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.691+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 shutdown_connections 2024-09-12T12:27:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:57.691+0000 7f171ae00640 1 -- 172.21.15.38:0/1928695546 wait complete. 2024-09-12T12:27:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:58 smithi038 ceph-mon[30810]: scrub queued for path: / 2024-09-12T12:27:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:58 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:58 smithi038 ceph-mon[30810]: scrub summary: active paths [/] 2024-09-12T12:27:58.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:58 smithi038 ceph-mon[30810]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:58.470 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:58 smithi038 ceph-mon[30810]: scrub summary: idle 2024-09-12T12:27:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:58 smithi071 ceph-mon[34859]: scrub queued for path: / 2024-09-12T12:27:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:58 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:58 smithi071 ceph-mon[34859]: scrub summary: active paths [/] 2024-09-12T12:27:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:58 smithi071 ceph-mon[34859]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:58.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:58 smithi071 ceph-mon[34859]: scrub summary: idle 2024-09-12T12:27:58.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:27:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:58 smithi154 ceph-mon[35578]: scrub queued for path: / 2024-09-12T12:27:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:58 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:58 smithi154 ceph-mon[35578]: scrub summary: active paths [/] 2024-09-12T12:27:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:58 smithi154 ceph-mon[35578]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:58.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:58 smithi154 ceph-mon[35578]: scrub summary: idle 2024-09-12T12:27:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:59.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:27:59 smithi038 ceph-mon[30810]: pgmap v455: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T12:27:59.514 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:27:59 smithi071 ceph-mon[34859]: pgmap v455: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T12:27:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.637+0000 7f81bd600640 1 -- 172.21.15.38:0/2448416281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8106f00 msgr2=0x7f81b810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.637+0000 7f81bd600640 1 --2- 172.21.15.38:0/2448416281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8106f00 0x7f81b810ea80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009be0 tx=0x7f81b002a6d0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.637+0000 7f81bd600640 1 -- 172.21.15.38:0/2448416281 shutdown_connections 2024-09-12T12:27:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.637+0000 7f81bd600640 1 --2- 172.21.15.38:0/2448416281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8106f00 0x7f81b810ea80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.637+0000 7f81bd600640 1 --2- 172.21.15.38:0/2448416281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b8102780 0x7f81b81067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.637+0000 7f81bd600640 1 --2- 172.21.15.38:0/2448416281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81b8101dd0 0x7f81b81021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.637+0000 7f81bd600640 1 -- 172.21.15.38:0/2448416281 >> 172.21.15.38:0/2448416281 conn(0x7f81b80fd8b0 msgr2=0x7f81b80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.638+0000 7f81bd600640 1 -- 172.21.15.38:0/2448416281 shutdown_connections 2024-09-12T12:27:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.638+0000 7f81bd600640 1 -- 172.21.15.38:0/2448416281 wait complete. 2024-09-12T12:27:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 Processor -- start 2024-09-12T12:27:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 -- start start 2024-09-12T12:27:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b8101dd0 0x7f81b80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8102780 0x7f81b8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81b8106f00 0x7f81b8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81b8111f60 con 0x7f81b8106f00 2024-09-12T12:27:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81b8111de0 con 0x7f81b8101dd0 2024-09-12T12:27:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81bd600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81120e0 con 0x7f81b8102780 2024-09-12T12:27:59.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.639+0000 7f81ae000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8102780 0x7f81b8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8102780 0x7f81b8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:42402/0 (socket says 172.21.15.38:42402) 2024-09-12T12:27:59.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 -- 172.21.15.38:0/2827198278 learned_addr learned my addr 172.21.15.38:0/2827198278 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81b6a00640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b8101dd0 0x7f81b80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81b7400640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81b8106f00 0x7f81b8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 -- 172.21.15.38:0/2827198278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b8101dd0 msgr2=0x7f81b80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b8101dd0 0x7f81b80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 -- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81b8106f00 msgr2=0x7f81b8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81b8106f00 0x7f81b8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 -- 172.21.15.38:0/2827198278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b81a6890 con 0x7f81b8102780 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81b6a00640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b8101dd0 0x7f81b80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.640+0000 7f81ae000640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8102780 0x7f81b8074a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81a000e9f0 tx=0x7f81a000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.641+0000 7f81afe00640 1 -- 172.21.15.38:0/2827198278 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a000cd80 con 0x7f81b8102780 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.641+0000 7f81afe00640 1 -- 172.21.15.38:0/2827198278 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a0005500 con 0x7f81b8102780 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.641+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b81a6b80 con 0x7f81b8102780 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.641+0000 7f81afe00640 1 -- 172.21.15.38:0/2827198278 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0010690 con 0x7f81b8102780 2024-09-12T12:27:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.641+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b81a7070 con 0x7f81b8102780 2024-09-12T12:27:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.644+0000 7f81afe00640 1 -- 172.21.15.38:0/2827198278 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f81a00046c0 con 0x7f81b8102780 2024-09-12T12:27:59.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.645+0000 7f81bfff9740 1 Processor -- start 2024-09-12T12:27:59.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81afe00640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f819c0a2b80 0x7f819c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81bfff9740 1 -- start start 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81afe00640 1 -- 172.21.15.38:0/2827198278 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f81a00cf800 con 0x7f81b8102780 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81b7400640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f819c0a2b80 0x7f819c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c0427f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042803830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042806160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81bfff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55c04275f3e0 con 0x55c0427f94b0 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81bfff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c042706d80 con 0x55c042803d70 2024-09-12T12:27:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81bfff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c04275b3a0 con 0x55c0427f8b90 2024-09-12T12:27:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.646+0000 7f81ae000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042803830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c0427f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042806160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c0427f8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:42408/0 (socket says 172.21.15.38:42408) 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 -- 172.21.15.38:0/1048778511 learned_addr learned my addr 172.21.15.38:0/1048778511 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81ae000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042803830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60046/0 (socket says 172.21.15.38:60046) 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 -- 172.21.15.38:0/1048778511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 msgr2=0x55c042806160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 --2- 172.21.15.38:0/1048778511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042806160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 -- 172.21.15.38:0/1048778511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 msgr2=0x55c042803830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 --2- 172.21.15.38:0/1048778511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042803830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 -- 172.21.15.38:0/1048778511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c042725ae0 con 0x55c0427f8b90 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b7400640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f819c0a2b80 0x7f819c0a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f81b0004af0 tx=0x7f81b0030e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.647+0000 7f81b6a00640 1 --2- 172.21.15.38:0/1048778511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c0427f8f70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81a80114f0 tx=0x7f81a80119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7194fe3d132c7162 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.648+0000 7f81a7400640 1 -- 172.21.15.38:0/1048778511 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8005020 con 0x55c0427f8b90 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.648+0000 7f81a7400640 1 -- 172.21.15.38:0/1048778511 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a80047a0 con 0x55c0427f8b90 2024-09-12T12:27:59.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.648+0000 7f81a7400640 1 -- 172.21.15.38:0/1048778511 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a800f980 con 0x55c0427f8b90 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 -- 172.21.15.38:0/1048778511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 msgr2=0x55c0427f8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 --2- 172.21.15.38:0/1048778511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c0427f8f70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81a80114f0 tx=0x7f81a80119b0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 -- 172.21.15.38:0/1048778511 shutdown_connections 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 --2- 172.21.15.38:0/1048778511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042806160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 --2- 172.21.15.38:0/1048778511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042803830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 --2- 172.21.15.38:0/1048778511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c0427f8f70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 -- 172.21.15.38:0/1048778511 >> 172.21.15.38:0/1048778511 conn(0x55c0427f5120 msgr2=0x55c0427f5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 -- 172.21.15.38:0/1048778511 shutdown_connections 2024-09-12T12:27:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 -- 172.21.15.38:0/1048778511 wait complete. 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 -- start start 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.649+0000 7f81bfff9740 1 Processor -- start 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c042800cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042801210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042801750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81bfff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55c0428069e0 con 0x55c0427f94b0 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81bfff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c04271a0f0 con 0x55c042803d70 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81bfff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c042806b60 con 0x55c0427f8b90 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81bfff9740 10 client.0 _ll_register_callbacks cb 0x55c04270b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81ae000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042801210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c042800cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81ae000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042801210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60062/0 (socket says 172.21.15.38:60062) 2024-09-12T12:27:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.650+0000 7f81ae000640 1 -- 172.21.15.38:0/438455082 learned_addr learned my addr 172.21.15.38:0/438455082 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:59.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81b7400640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042801750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81ae000640 1 -- 172.21.15.38:0/438455082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 msgr2=0x55c042800cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81ae000640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c042800cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81ae000640 1 -- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 msgr2=0x55c042801750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81ae000640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042801750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81ae000640 1 -- 172.21.15.38:0/438455082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0424d03c0 con 0x55c0427f94b0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81b6a00640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c042800cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81b7400640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042801750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f81ae000640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042801210 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f81a00097d0 tx=0x7f81a009c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b6e8762bd4e02a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.651+0000 7f819be00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f819be00640 1 -- 172.21.15.38:0/438455082 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a00b9060 con 0x55c0427f94b0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f819be00640 1 -- 172.21.15.38:0/438455082 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f81a0099f50 con 0x55c0427f94b0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a80047a0 con 0x55c0427f94b0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f819be00640 1 -- 172.21.15.38:0/438455082 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f81a00b1030 con 0x55c0427f94b0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f81bfff9740 10 client.15717 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c042812770 con 0x55c0427f94b0 2024-09-12T12:27:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f819be00640 1 -- 172.21.15.38:0/438455082 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a80047a0 con 0x55c0427f94b0 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f819be00640 1 -- 172.21.15.38:0/438455082 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f81a009ab10 con 0x55c0427f94b0 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f81bfff9740 10 client.15717 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.652+0000 7f81bfff9740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.653+0000 7f81bfff9740 20 client.15717 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.653+0000 7f81bfff9740 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c042813ac0 0x55c042815ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.653+0000 7f81bfff9740 4 client.15717 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.653+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c04276c950 con 0x55c042813ac0 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.653+0000 7f81b6a00640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c042813ac0 0x55c042815ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.654+0000 7f81b6a00640 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c042813ac0 0x55c042815ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d21862d735b675e server_cookie=74b9350403ac1f21 in_seq=0 out_seq=0 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.654+0000 7f819be00640 10 client.15717 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f819be00640 1 -- 172.21.15.38:0/438455082 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c04276c950 con 0x55c042813ac0 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f819be00640 10 client.15717 handle_command_reply: tid=0 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 client.15717 shutdown 2024-09-12T12:27:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 msgr2=0x55c042801210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042801210 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f81a00097d0 tx=0x7f81a009c460 comp rx=0 tx=0).stop 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 shutdown_connections 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c042813ac0 0x55c042815ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c042803d70 0x55c042801750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f94b0 0x55c042801210 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 --2- 172.21.15.38:0/438455082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0427f8b90 0x55c042800cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f819be00640 0 client.15717 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 >> 172.21.15.38:0/438455082 conn(0x55c0427f5120 msgr2=0x55c0427fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 shutdown_connections 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 1 -- 172.21.15.38:0/438455082 wait complete. 2024-09-12T12:27:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.655+0000 7f81bfff9740 20 client.15717 trim_cache size 0 max 16384 2024-09-12T12:27:59.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:27:59 smithi154 ceph-mon[35578]: pgmap v455: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T12:27:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 Processor -- start 2024-09-12T12:27:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 -- start start 2024-09-12T12:27:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c0427f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c04281b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c04281bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81b0f90 con 0x55c0427f8b90 2024-09-12T12:27:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81b2ad0 con 0x55c0427f94b0 2024-09-12T12:27:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81bfff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81b1660 con 0x55c042803d70 2024-09-12T12:27:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c0427f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c0427f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60068/0 (socket says 172.21.15.38:60068) 2024-09-12T12:27:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.674+0000 7f81b6a00640 1 -- 172.21.15.38:0/3371254478 learned_addr learned my addr 172.21.15.38:0/3371254478 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81ae000640 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c04281b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81b7400640 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c04281bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81b6a00640 1 -- 172.21.15.38:0/3371254478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 msgr2=0x55c04281bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81b6a00640 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c04281bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81b6a00640 1 -- 172.21.15.38:0/3371254478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 msgr2=0x55c04281b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81b6a00640 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c04281b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81b6a00640 1 -- 172.21.15.38:0/3371254478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c042816570 con 0x55c0427f8b90 2024-09-12T12:27:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.675+0000 7f81b6a00640 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c0427f40d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f81a801a000 tx=0x7f81a800f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7675bedafeb4fe0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.676+0000 7f81a6a00640 1 -- 172.21.15.38:0/3371254478 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8009c40 con 0x55c0427f8b90 2024-09-12T12:27:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.676+0000 7f81a6a00640 1 -- 172.21.15.38:0/3371254478 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a8011040 con 0x55c0427f8b90 2024-09-12T12:27:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.676+0000 7f81a6a00640 1 -- 172.21.15.38:0/3371254478 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8005360 con 0x55c0427f8b90 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.676+0000 7f81bfff9740 1 -- 172.21.15.38:0/3371254478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 msgr2=0x55c0427f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.676+0000 7f81bfff9740 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c0427f40d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f81a801a000 tx=0x7f81a800f5c0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 -- 172.21.15.38:0/3371254478 shutdown_connections 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c04281bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c04281b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 --2- 172.21.15.38:0/3371254478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c0427f40d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 -- 172.21.15.38:0/3371254478 >> 172.21.15.38:0/3371254478 conn(0x55c0427f5120 msgr2=0x55c0427f39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 -- 172.21.15.38:0/3371254478 shutdown_connections 2024-09-12T12:27:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 -- 172.21.15.38:0/3371254478 wait complete. 2024-09-12T12:27:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 -- start start 2024-09-12T12:27:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.677+0000 7f81bfff9740 1 Processor -- start 2024-09-12T12:27:59.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c04280c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c0428077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81bfff9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c042807d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81bfff9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81b2400 con 0x55c0427f8b90 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81bfff9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81b1d30 con 0x55c0427f94b0 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81bfff9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81aef70 con 0x55c042803d70 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81bfff9740 10 client.0 _ll_register_callbacks cb 0x7f81a009b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c04280c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c04280c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60082/0 (socket says 172.21.15.38:60082) 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81b6a00640 1 -- 172.21.15.38:0/2208079782 learned_addr learned my addr 172.21.15.38:0/2208079782 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81ae000640 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c0428077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.678+0000 7f81b7400640 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c042807d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f81ae000640 1 -- 172.21.15.38:0/2208079782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 msgr2=0x55c042807d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f81ae000640 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c042807d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f81ae000640 1 -- 172.21.15.38:0/2208079782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 msgr2=0x55c04280c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f81ae000640 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c04280c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f81ae000640 1 -- 172.21.15.38:0/2208079782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c042808540 con 0x55c0427f94b0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f81ae000640 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c0428077f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81a0099f00 tx=0x7f81a009a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757469d385cf925c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f819be00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.679+0000 7f819be00640 1 -- 172.21.15.38:0/2208079782 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a009b790 con 0x55c0427f94b0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a8011040 con 0x55c0427f94b0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f819be00640 1 -- 172.21.15.38:0/2208079782 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f81a00a4430 con 0x55c0427f94b0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f819be00640 1 -- 172.21.15.38:0/2208079782 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f81a00a48c0 con 0x55c0427f94b0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 10 client.25733 fetch_fsmap learned FSMap version 30 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c04287e710 con 0x55c0427f94b0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f819be00640 1 -- 172.21.15.38:0/2208079782 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a8011040 con 0x55c0427f94b0 2024-09-12T12:27:59.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f819be00640 1 -- 172.21.15.38:0/2208079782 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f81a00979a0 con 0x55c0427f94b0 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 10 client.25733 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 10 client.25733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 20 client.25733 populate_metadata read hostname 'smithi038' 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c04287ed50 0x55c042881170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 4 client.25733 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.680+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c042766e60 con 0x55c04287ed50 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.681+0000 7f81b6a00640 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c04287ed50 0x55c042881170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.681+0000 7f81b6a00640 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c04287ed50 0x55c042881170 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dda6d5c471a0cc26 server_cookie=907636abc0283172 in_seq=0 out_seq=0 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.681+0000 7f819be00640 10 client.25733 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f819be00640 1 -- 172.21.15.38:0/2208079782 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c042766e60 con 0x55c04287ed50 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f819be00640 10 client.25733 handle_command_reply: tid=0 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 client.25733 shutdown 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 msgr2=0x55c0428077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c0428077f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81a0099f00 tx=0x7f81a009a160 comp rx=0 tx=0).stop 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 shutdown_connections 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55c04287ed50 0x55c042881170 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c042803d70 0x55c042807d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c0427f94b0 0x55c0428077f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 --2- 172.21.15.38:0/2208079782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c0427f8b90 0x55c04280c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 >> 172.21.15.38:0/2208079782 conn(0x55c0427f5120 msgr2=0x55c0428014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f819be00640 0 client.25733 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:27:59.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 shutdown_connections 2024-09-12T12:27:59.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 1 -- 172.21.15.38:0/2208079782 wait complete. 2024-09-12T12:27:59.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.682+0000 7f81bfff9740 20 client.25733 trim_cache size 0 max 16384 2024-09-12T12:27:59.686 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:27:59.686 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-12T12:27:59.686 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2024-09-12T12:27:59.686 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f819c0a2b80 msgr2=0x7f819c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f819c0a2b80 0x7f819c0a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f81b0004af0 tx=0x7f81b0030e20 comp rx=0 tx=0).stop 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8102780 msgr2=0x7f81b8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8102780 0x7f81b8074a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81a000e9f0 tx=0x7f81a000edf0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 shutdown_connections 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f819c0a2b80 0x7f819c0a5040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81b8106f00 0x7f81b8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b8102780 0x7f81b8074a30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 --2- 172.21.15.38:0/2827198278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81b8101dd0 0x7f81b80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 >> 172.21.15.38:0/2827198278 conn(0x7f81b80fd8b0 msgr2=0x7f81b80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:59.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 shutdown_connections 2024-09-12T12:27:59.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:27:59.683+0000 7f81bd600640 1 -- 172.21.15.38:0/2827198278 wait complete. 2024-09-12T12:28:00.636 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:28:00.637 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:28:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:01.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:01 smithi038 ceph-mon[30810]: pgmap v456: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 -- 172.21.15.38:0/3114829877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 msgr2=0x7ff6141067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3114829877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 0x7ff6141067f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff600009900 tx=0x7ff60002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 -- 172.21.15.38:0/3114829877 shutdown_connections 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3114829877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614106f20 0x7ff61410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3114829877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 0x7ff6141067f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3114829877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 0x7ff6141021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 -- 172.21.15.38:0/3114829877 >> 172.21.15.38:0/3114829877 conn(0x7ff6140fd8b0 msgr2=0x7ff6140ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 -- 172.21.15.38:0/3114829877 shutdown_connections 2024-09-12T12:28:01.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.644+0000 7ff61ac00640 1 -- 172.21.15.38:0/3114829877 wait complete. 2024-09-12T12:28:01.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.645+0000 7ff61ac00640 1 Processor -- start 2024-09-12T12:28:01.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.646+0000 7ff61ac00640 1 -- start start 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.646+0000 7ff61ac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 0x7ff6140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.646+0000 7ff61ac00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 0x7ff614074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.646+0000 7ff61ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614106f20 0x7ff614074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.646+0000 7ff61ac00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff614111f80 con 0x7ff6141027a0 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.646+0000 7ff61ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff614111e00 con 0x7ff614106f20 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.646+0000 7ff61ac00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff614112100 con 0x7ff614101df0 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 0x7ff6140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 0x7ff614074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 0x7ff6140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:42454/0 (socket says 172.21.15.38:42454) 2024-09-12T12:28:01.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 -- 172.21.15.38:0/3229951704 learned_addr learned my addr 172.21.15.38:0/3229951704 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:01.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff618c00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614106f20 0x7ff614074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 -- 172.21.15.38:0/3229951704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614106f20 msgr2=0x7ff614074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614106f20 0x7ff614074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 -- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 msgr2=0x7ff614074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 0x7ff614074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.647+0000 7ff613e00640 1 -- 172.21.15.38:0/3229951704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6141a68a0 con 0x7ff614101df0 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.648+0000 7ff613e00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 0x7ff6140744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff60400e9f0 tx=0x7ff60400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.648+0000 7ff610c00640 1 -- 172.21.15.38:0/3229951704 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60400cd80 con 0x7ff614101df0 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.648+0000 7ff610c00640 1 -- 172.21.15.38:0/3229951704 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff604005500 con 0x7ff614101df0 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.648+0000 7ff610c00640 1 -- 172.21.15.38:0/3229951704 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604010690 con 0x7ff614101df0 2024-09-12T12:28:01.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.648+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6141a6b90 con 0x7ff614101df0 2024-09-12T12:28:01.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.648+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141a7050 con 0x7ff614101df0 2024-09-12T12:28:01.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.649+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6141021d0 con 0x7ff614101df0 2024-09-12T12:28:01.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.651+0000 7ff610c00640 1 -- 172.21.15.38:0/3229951704 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff6040046c0 con 0x7ff614101df0 2024-09-12T12:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.652+0000 7ff610c00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2c00 0x7ff5f80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.653+0000 7ff610c00640 1 -- 172.21.15.38:0/3229951704 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7ff6040cf990 con 0x7ff614101df0 2024-09-12T12:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.653+0000 7ff613400640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2c00 0x7ff5f80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:01.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.654+0000 7ff613400640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2c00 0x7ff5f80a50c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff600009230 tx=0x7ff6000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:01.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.655+0000 7ff610c00640 1 -- 172.21.15.38:0/3229951704 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6040541b0 con 0x7ff614101df0 2024-09-12T12:28:01.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:01 smithi154 ceph-mon[35578]: pgmap v456: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:28:01.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:01 smithi071 ceph-mon[34859]: pgmap v456: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:28:01.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.880+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff614075a20 con 0x7ff614101df0 2024-09-12T12:28:01.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.881+0000 7ff610c00640 1 -- 172.21.15.38:0/3229951704 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7ff60409c4e0 con 0x7ff614101df0 2024-09-12T12:28:01.882 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:28:01.882 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:28:01.882 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2c00 msgr2=0x7ff5f80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2c00 0x7ff5f80a50c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff600009230 tx=0x7ff6000058d0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 msgr2=0x7ff6140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 0x7ff6140744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff60400e9f0 tx=0x7ff60400edf0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 shutdown_connections 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7ff5f80a2c00 0x7ff5f80a50c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff614106f20 0x7ff614074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6141027a0 0x7ff614074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 --2- 172.21.15.38:0/3229951704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff614101df0 0x7ff6140744f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:01.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.884+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 >> 172.21.15.38:0/3229951704 conn(0x7ff6140fd8b0 msgr2=0x7ff6140feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:01.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.885+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 shutdown_connections 2024-09-12T12:28:01.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:01.885+0000 7ff61ac00640 1 -- 172.21.15.38:0/3229951704 wait complete. 2024-09-12T12:28:02.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:02 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3229951704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:02.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:02 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3229951704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:02.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:02 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3229951704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:02.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T12:28:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:03.541 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:03 smithi038 ceph-mon[30810]: pgmap v457: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 15 op/s 2024-09-12T12:28:03.541 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:03 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:28:03.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:03 smithi154 ceph-mon[35578]: pgmap v457: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 15 op/s 2024-09-12T12:28:03.666 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:03 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:28:03.763 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:03 smithi071 ceph-mon[34859]: pgmap v457: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 15 op/s 2024-09-12T12:28:03.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:03 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:28:03.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 -- 172.21.15.38:0/398517332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58077040 msgr2=0x7faf581124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 --2- 172.21.15.38:0/398517332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58077040 0x7faf581124f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf44009900 tx=0x7faf4402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 -- 172.21.15.38:0/398517332 shutdown_connections 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 --2- 172.21.15.38:0/398517332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf58112a30 0x7faf58114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 --2- 172.21.15.38:0/398517332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58077040 0x7faf581124f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 --2- 172.21.15.38:0/398517332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 0x7faf58076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 -- 172.21.15.38:0/398517332 >> 172.21.15.38:0/398517332 conn(0x7faf580ffa90 msgr2=0x7faf58101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 -- 172.21.15.38:0/398517332 shutdown_connections 2024-09-12T12:28:03.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.839+0000 7faf5d800640 1 -- 172.21.15.38:0/398517332 wait complete. 2024-09-12T12:28:03.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.840+0000 7faf5d800640 1 Processor -- start 2024-09-12T12:28:03.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.841+0000 7faf5d800640 1 -- start start 2024-09-12T12:28:03.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.841+0000 7faf5d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 0x7faf581a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.841+0000 7faf5d800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf58077040 0x7faf581a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.841+0000 7faf5d800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58112a30 0x7faf5819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.841+0000 7faf5d800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf581185f0 con 0x7faf58077040 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.841+0000 7faf5d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf58118470 con 0x7faf58076720 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.841+0000 7faf5d800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf58118770 con 0x7faf58112a30 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 0x7faf581a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 0x7faf581a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57244/0 (socket says 172.21.15.38:57244) 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 -- 172.21.15.38:0/2675157171 learned_addr learned my addr 172.21.15.38:0/2675157171 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56000640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf58077040 0x7faf581a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf57400640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58112a30 0x7faf5819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 -- 172.21.15.38:0/2675157171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58112a30 msgr2=0x7faf5819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58112a30 0x7faf5819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 -- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf58077040 msgr2=0x7faf581a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf58077040 0x7faf581a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 -- 172.21.15.38:0/2675157171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5819efd0 con 0x7faf58076720 2024-09-12T12:28:03.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf57400640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58112a30 0x7faf5819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:03.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.842+0000 7faf56a00640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 0x7faf581a46e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faf4800e9f0 tx=0x7faf4800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:03.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.843+0000 7faf4f400640 1 -- 172.21.15.38:0/2675157171 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4800cd80 con 0x7faf58076720 2024-09-12T12:28:03.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.843+0000 7faf4f400640 1 -- 172.21.15.38:0/2675157171 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf48010910 con 0x7faf58076720 2024-09-12T12:28:03.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.843+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5819f2c0 con 0x7faf58076720 2024-09-12T12:28:03.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.843+0000 7faf4f400640 1 -- 172.21.15.38:0/2675157171 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48018980 con 0x7faf58076720 2024-09-12T12:28:03.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.843+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf581ab5b0 con 0x7faf58076720 2024-09-12T12:28:03.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.846+0000 7faf4f400640 1 -- 172.21.15.38:0/2675157171 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faf48018b20 con 0x7faf58076720 2024-09-12T12:28:03.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.846+0000 7faf60256740 1 Processor -- start 2024-09-12T12:28:03.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.846+0000 7faf60256740 1 -- start start 2024-09-12T12:28:03.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf60256740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74d6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf60256740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74e0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf60256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74e3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf60256740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5584c743c3e0 con 0x5584c74d5c70 2024-09-12T12:28:03.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf60256740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5584c73e3d80 con 0x5584c74d6590 2024-09-12T12:28:03.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf60256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5584c74383a0 con 0x5584c74e0e50 2024-09-12T12:28:03.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf57400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf57400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74d6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60116/0 (socket says 172.21.15.38:60116) 2024-09-12T12:28:03.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf57400640 1 -- 172.21.15.38:0/3376423075 learned_addr learned my addr 172.21.15.38:0/3376423075 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:03.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf56000640 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.847+0000 7faf56a00640 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf57400640 1 -- 172.21.15.38:0/3376423075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 msgr2=0x5584c74e3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf57400640 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74e3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf57400640 1 -- 172.21.15.38:0/3376423075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 msgr2=0x5584c74e0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf57400640 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74e0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf57400640 1 -- 172.21.15.38:0/3376423075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c7402ae0 con 0x5584c74d5c70 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf4f400640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf3c0a2c00 0x7faf3c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf57400640 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74d6050 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faf50009f80 tx=0x7faf50010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c697ac8906e17e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf4f400640 1 -- 172.21.15.38:0/2675157171 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faf480cf870 con 0x7faf58076720 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.848+0000 7faf56a00640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf3c0a2c00 0x7faf3c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.849+0000 7faf43e00640 1 -- 172.21.15.38:0/3376423075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50011700 con 0x5584c74d5c70 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.849+0000 7faf43e00640 1 -- 172.21.15.38:0/3376423075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf50011d80 con 0x5584c74d5c70 2024-09-12T12:28:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.849+0000 7faf43e00640 1 -- 172.21.15.38:0/3376423075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5001a380 con 0x5584c74d5c70 2024-09-12T12:28:03.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.849+0000 7faf60256740 1 -- 172.21.15.38:0/3376423075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 msgr2=0x5584c74d6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.849+0000 7faf56a00640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf3c0a2c00 0x7faf3c0a50c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faf48098690 tx=0x7faf480d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.849+0000 7faf60256740 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74d6050 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faf50009f80 tx=0x7faf50010860 comp rx=0 tx=0).stop 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 -- 172.21.15.38:0/3376423075 shutdown_connections 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74e3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 --2- 172.21.15.38:0/3376423075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74d6050 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 -- 172.21.15.38:0/3376423075 >> 172.21.15.38:0/3376423075 conn(0x5584c74d2200 msgr2=0x5584c74d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 -- 172.21.15.38:0/3376423075 shutdown_connections 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 -- 172.21.15.38:0/3376423075 wait complete. 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.850+0000 7faf60256740 1 -- start start 2024-09-12T12:28:03.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.851+0000 7faf60256740 1 Processor -- start 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.851+0000 7faf60256740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74dddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.851+0000 7faf60256740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74de310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.851+0000 7faf60256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74de850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.851+0000 7faf60256740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5584c74e3a20 con 0x5584c74d5c70 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.851+0000 7faf60256740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5584c73f70f0 con 0x5584c74d6590 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.851+0000 7faf60256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5584c74e3ba0 con 0x5584c74e0e50 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf60256740 10 client.0 _ll_register_callbacks cb 0x5584c73debd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:03.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74dddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74dddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60120/0 (socket says 172.21.15.38:60120) 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 -- 172.21.15.38:0/2170983307 learned_addr learned my addr 172.21.15.38:0/2170983307 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf56000640 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 -- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 msgr2=0x5584c74de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 -- 172.21.15.38:0/2170983307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 msgr2=0x5584c74de310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74de310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.852+0000 7faf57400640 1 -- 172.21.15.38:0/2170983307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c71ad3c0 con 0x5584c74d5c70 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf57400640 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74dddd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf5001cb10 tx=0x7faf50009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e419bf229c43a395 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf40c00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:28:03.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf40c00640 1 -- 172.21.15.38:0/2170983307 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50011500 con 0x5584c74d5c70 2024-09-12T12:28:03.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf40c00640 1 -- 172.21.15.38:0/2170983307 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faf500116a0 con 0x5584c74d5c70 2024-09-12T12:28:03.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf50011d80 con 0x5584c74d5c70 2024-09-12T12:28:03.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf40c00640 1 -- 172.21.15.38:0/2170983307 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faf50033050 con 0x5584c74d5c70 2024-09-12T12:28:03.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf60256740 10 client.15741 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:03.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.853+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5584c74efae0 con 0x5584c74d5c70 2024-09-12T12:28:03.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf40c00640 1 -- 172.21.15.38:0/2170983307 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf50011d80 con 0x5584c74d5c70 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf40c00640 1 -- 172.21.15.38:0/2170983307 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7faf5002bc10 con 0x5584c74d5c70 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf60256740 10 client.15741 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf60256740 10 client.15741 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf60256740 20 client.15741 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf60256740 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c74f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf60256740 4 client.15741 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.854+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584c7449950 con 0x5584c74f0ef0 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.855+0000 7faf56000640 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c74f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.856+0000 7faf56000640 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c74f32e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ec06a23d1ef3e0df server_cookie=a5a1f789c27fa155 in_seq=0 out_seq=0 2024-09-12T12:28:03.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.856+0000 7faf40c00640 10 client.15741 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.857+0000 7faf40c00640 1 -- 172.21.15.38:0/2170983307 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584c7449950 con 0x5584c74f0ef0 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.857+0000 7faf40c00640 10 client.15741 handle_command_reply: tid=0 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.857+0000 7faf60256740 1 client.15741 shutdown 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.857+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 msgr2=0x5584c74dddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.857+0000 7faf60256740 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74dddd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf5001cb10 tx=0x7faf50009fb0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 shutdown_connections 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c74f32e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf40c00640 0 client.15741 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74de310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 --2- 172.21.15.38:0/2170983307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74dddd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 >> 172.21.15.38:0/2170983307 conn(0x5584c74d2200 msgr2=0x5584c74d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 shutdown_connections 2024-09-12T12:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 1 -- 172.21.15.38:0/2170983307 wait complete. 2024-09-12T12:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.858+0000 7faf60256740 20 client.15741 trim_cache size 0 max 16384 2024-09-12T12:28:03.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 Processor -- start 2024-09-12T12:28:03.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 -- start start 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74f6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74db030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf581b5430 con 0x5584c74d5c70 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf581b6f70 con 0x5584c74d6590 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.886+0000 7faf60256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf581b5b00 con 0x5584c74e0e50 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf57400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57278/0 (socket says 172.21.15.38:57278) 2024-09-12T12:28:03.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf57400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60130/0 (socket says 172.21.15.38:60130) 2024-09-12T12:28:03.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 -- 172.21.15.38:0/1405663543 learned_addr learned my addr 172.21.15.38:0/1405663543 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:03.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 -- 172.21.15.38:0/1405663543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 msgr2=0x5584c74db030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:28:03.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 --2- 172.21.15.38:0/1405663543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74db030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 -- 172.21.15.38:0/1405663543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 msgr2=0x5584c74f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:03.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 --2- 172.21.15.38:0/1405663543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 -- 172.21.15.38:0/1405663543 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c74d63c0 con 0x5584c74d6590 2024-09-12T12:28:03.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.887+0000 7faf56000640 1 --2- 172.21.15.38:0/1405663543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f6840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faf4402a9b0 tx=0x7faf44005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52987c2be79fc40a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:03.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.888+0000 7faf43400640 1 -- 172.21.15.38:0/1405663543 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44035040 con 0x5584c74d6590 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.888+0000 7faf43400640 1 -- 172.21.15.38:0/1405663543 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf4404a070 con 0x5584c74d6590 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.888+0000 7faf43400640 1 -- 172.21.15.38:0/1405663543 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf440315b0 con 0x5584c74d6590 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 -- 172.21.15.38:0/1405663543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 msgr2=0x5584c74f6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 --2- 172.21.15.38:0/1405663543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f6840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faf4402a9b0 tx=0x7faf44005b50 comp rx=0 tx=0).stop 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 -- 172.21.15.38:0/1405663543 shutdown_connections 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 --2- 172.21.15.38:0/1405663543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74e0e50 0x5584c74db030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 --2- 172.21.15.38:0/1405663543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f6840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 --2- 172.21.15.38:0/1405663543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74d5c70 0x5584c74f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 -- 172.21.15.38:0/1405663543 >> 172.21.15.38:0/1405663543 conn(0x5584c74d2200 msgr2=0x5584c74dfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:03.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 -- 172.21.15.38:0/1405663543 shutdown_connections 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 -- 172.21.15.38:0/1405663543 wait complete. 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.889+0000 7faf60256740 1 -- start start 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 1 Processor -- start 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74d5c70 0x5584c74f6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74e0e50 0x5584c74f4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf581b68a0 con 0x5584c74e0e50 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf581b61d0 con 0x5584c74d6590 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf581b3410 con 0x5584c74d5c70 2024-09-12T12:28:03.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf60256740 10 client.0 _ll_register_callbacks cb 0x7faf480d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf57400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74d5c70 0x5584c74f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.890+0000 7faf56000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57292/0 (socket says 172.21.15.38:57292) 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf57400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74d5c70 0x5584c74f6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:42512/0 (socket says 172.21.15.38:42512) 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 -- 172.21.15.38:0/2136034123 learned_addr learned my addr 172.21.15.38:0/2136034123 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf57400640 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74e0e50 0x5584c74f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 -- 172.21.15.38:0/2136034123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74d5c70 msgr2=0x5584c74f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:03.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74d5c70 0x5584c74f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 -- 172.21.15.38:0/2136034123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74e0e50 msgr2=0x5584c74f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74e0e50 0x5584c74f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 -- 172.21.15.38:0/2136034123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c74f4a90 con 0x5584c74d6590 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf57400640 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74e0e50 0x5584c74f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf56000640 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f3d20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf4402a9e0 tx=0x7faf44009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a409f767847e2fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.891+0000 7faf40c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf40c00640 1 -- 172.21.15.38:0/2136034123 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44052030 con 0x5584c74d6590 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf40c00640 1 -- 172.21.15.38:0/2136034123 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faf440046c0 con 0x5584c74d6590 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf4404a070 con 0x5584c74d6590 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf40c00640 1 -- 172.21.15.38:0/2136034123 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faf4405f050 con 0x5584c74d6590 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf60256740 10 client.25757 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5584c755b760 con 0x5584c74d6590 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf40c00640 1 -- 172.21.15.38:0/2136034123 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf4404a070 con 0x5584c74d6590 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf40c00640 1 -- 172.21.15.38:0/2136034123 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7faf440319c0 con 0x5584c74d6590 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf60256740 10 client.25757 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf60256740 10 client.25757 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.892+0000 7faf60256740 20 client.25757 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.893+0000 7faf60256740 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c755ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.893+0000 7faf60256740 4 client.25757 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.893+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 --> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584c7443e60 con 0x5584c74f0ef0 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.893+0000 7faf57400640 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c755ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf57400640 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c755ddf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8c9887ec31a769fa server_cookie=b489bd502bb36f80 in_seq=0 out_seq=0 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf40c00640 10 client.25757 ms_handle_connect on v2:172.21.15.154:6834/3632627850 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf40c00640 1 -- 172.21.15.38:0/2136034123 <== mds.4 v2:172.21.15.154:6834/3632627850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584c7443e60 con 0x5584c74f0ef0 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf40c00640 10 client.25757 handle_command_reply: tid=0 2024-09-12T12:28:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 client.25757 shutdown 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 msgr2=0x5584c74f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f3d20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf4402a9e0 tx=0x7faf44009520 comp rx=0 tx=0).stop 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 shutdown_connections 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.154:6834/3632627850,v1:172.21.15.154:6835/3632627850] conn(0x5584c74f0ef0 0x5584c755ddf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5584c74e0e50 0x5584c74f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5584c74d6590 0x5584c74f3d20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 --2- 172.21.15.38:0/2136034123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584c74d5c70 0x5584c74f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf40c00640 0 client.25757 ms_handle_reset on v2:172.21.15.154:6834/3632627850 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 >> 172.21.15.38:0/2136034123 conn(0x5584c74d2200 msgr2=0x5584c74ebdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 shutdown_connections 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.894+0000 7faf60256740 1 -- 172.21.15.38:0/2136034123 wait complete. 2024-09-12T12:28:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf60256740 20 client.25757 trim_cache size 0 max 16384 2024-09-12T12:28:03.899 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:28:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf3c0a2c00 msgr2=0x7faf3c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf3c0a2c00 0x7faf3c0a50c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faf48098690 tx=0x7faf480d5530 comp rx=0 tx=0).stop 2024-09-12T12:28:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 msgr2=0x7faf581a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 0x7faf581a46e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faf4800e9f0 tx=0x7faf4800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 shutdown_connections 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf3c0a2c00 0x7faf3c0a50c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf58112a30 0x7faf5819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf58077040 0x7faf581a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 --2- 172.21.15.38:0/2675157171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf58076720 0x7faf581a46e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.895+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 >> 172.21.15.38:0/2675157171 conn(0x7faf580ffa90 msgr2=0x7faf58101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.896+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 shutdown_connections 2024-09-12T12:28:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:03.896+0000 7faf5d800640 1 -- 172.21.15.38:0/2675157171 wait complete. 2024-09-12T12:28:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:28:04.667 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:28:04.668 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:04 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:28:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:28:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:28:04.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:04 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:28:04.763 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:28:04.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:28:04.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:04 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' 2024-09-12T12:28:04.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T12:28:05.226 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.795+0000 7fecf0a00640 1 -- 172.21.15.38:0/1886945191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1079c0 msgr2=0x7fecec107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.795+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1886945191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1079c0 0x7fecec107da0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009930 tx=0x7fecdc02a420 comp rx=0 tx=0).stop 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.796+0000 7fecf0a00640 1 -- 172.21.15.38:0/1886945191 shutdown_connections 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.796+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1886945191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecec102360 0x7fecec10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.796+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1886945191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecec1019c0 0x7fecec101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.796+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1886945191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1079c0 0x7fecec107da0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.796+0000 7fecf0a00640 1 -- 172.21.15.38:0/1886945191 >> 172.21.15.38:0/1886945191 conn(0x7fecec0fd740 msgr2=0x7fecec0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.796+0000 7fecf0a00640 1 -- 172.21.15.38:0/1886945191 shutdown_connections 2024-09-12T12:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.796+0000 7fecf0a00640 1 -- 172.21.15.38:0/1886945191 wait complete. 2024-09-12T12:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 Processor -- start 2024-09-12T12:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 -- start start 2024-09-12T12:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1019c0 0x7fecec19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecec102360 0x7fecec19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecec1079c0 0x7fecec19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fecec111d80 con 0x7fecec1019c0 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecec111c00 con 0x7fecec102360 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.797+0000 7fecf0a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecec111f00 con 0x7fecec1079c0 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1019c0 0x7fecec19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecec102360 0x7fecec19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceb400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1019c0 0x7fecec19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54076/0 (socket says 172.21.15.38:54076) 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceb400640 1 -- 172.21.15.38:0/1022828391 learned_addr learned my addr 172.21.15.38:0/1022828391 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7fecebe00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecec1079c0 0x7fecec19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceaa00640 1 -- 172.21.15.38:0/1022828391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecec1079c0 msgr2=0x7fecec19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceaa00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecec1079c0 0x7fecec19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceaa00640 1 -- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1019c0 msgr2=0x7fecec19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceaa00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1019c0 0x7fecec19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceaa00640 1 -- 172.21.15.38:0/1022828391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec19f480 con 0x7fecec102360 2024-09-12T12:28:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.798+0000 7feceb400640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1019c0 0x7fecec19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.799+0000 7feceaa00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecec102360 0x7fecec19aa10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fecd800d6d0 tx=0x7fecd800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.799+0000 7fece3e00640 1 -- 172.21.15.38:0/1022828391 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8017070 con 0x7fecec102360 2024-09-12T12:28:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.799+0000 7fece3e00640 1 -- 172.21.15.38:0/1022828391 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecd8009820 con 0x7fecec102360 2024-09-12T12:28:05.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.799+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec19f770 con 0x7fecec102360 2024-09-12T12:28:05.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.799+0000 7fece3e00640 1 -- 172.21.15.38:0/1022828391 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8004d00 con 0x7fecec102360 2024-09-12T12:28:05.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.799+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec1a7050 con 0x7fecec102360 2024-09-12T12:28:05.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.802+0000 7fece3e00640 1 -- 172.21.15.38:0/1022828391 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fecd80099d0 con 0x7fecec102360 2024-09-12T12:28:05.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.802+0000 7fecf4bec740 1 Processor -- start 2024-09-12T12:28:05.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.802+0000 7fecf4bec740 1 -- start start 2024-09-12T12:28:05.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.802+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab446e40 0x555eab447220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.802+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab451ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab452020 0x555eab454410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7fecf4bec740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555eab3ad3e0 con 0x555eab446e40 2024-09-12T12:28:05.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7fecf4bec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555eab354d80 con 0x555eab452020 2024-09-12T12:28:05.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7fecf4bec740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555eab3a93a0 con 0x555eab447760 2024-09-12T12:28:05.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7fecebe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab446e40 0x555eab447220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab451ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab451ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:43540/0 (socket says 172.21.15.38:43540) 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab452020 0x555eab454410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 -- 172.21.15.38:0/563081386 learned_addr learned my addr 172.21.15.38:0/563081386 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 -- 172.21.15.38:0/563081386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab452020 msgr2=0x555eab454410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 --2- 172.21.15.38:0/563081386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab452020 0x555eab454410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 -- 172.21.15.38:0/563081386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab446e40 msgr2=0x555eab447220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 --2- 172.21.15.38:0/563081386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab446e40 0x555eab447220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.803+0000 7feceb400640 1 -- 172.21.15.38:0/563081386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eab373ae0 con 0x555eab447760 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.804+0000 7feceb400640 1 --2- 172.21.15.38:0/563081386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab451ae0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fecdc006010 tx=0x7fecdc005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee13e2957eb5c60f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.804+0000 7fece3e00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fecd00a2b80 0x7fecd00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.804+0000 7fecd7e00640 1 -- 172.21.15.38:0/563081386 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc035040 con 0x555eab447760 2024-09-12T12:28:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.804+0000 7fecd7e00640 1 -- 172.21.15.38:0/563081386 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc0318e0 con 0x555eab447760 2024-09-12T12:28:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.804+0000 7fecd7e00640 1 -- 172.21.15.38:0/563081386 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc03c440 con 0x555eab447760 2024-09-12T12:28:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.804+0000 7fece3e00640 1 -- 172.21.15.38:0/1022828391 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fecd80cef20 con 0x7fecec102360 2024-09-12T12:28:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.804+0000 7fecebe00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fecd00a2b80 0x7fecd00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 -- 172.21.15.38:0/563081386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 msgr2=0x555eab451ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecebe00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fecd00a2b80 0x7fecd00a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fece4005fd0 tx=0x7fece4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:05.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 --2- 172.21.15.38:0/563081386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab451ae0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fecdc006010 tx=0x7fecdc005e70 comp rx=0 tx=0).stop 2024-09-12T12:28:05.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 -- 172.21.15.38:0/563081386 shutdown_connections 2024-09-12T12:28:05.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 --2- 172.21.15.38:0/563081386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab452020 0x555eab454410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 --2- 172.21.15.38:0/563081386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab451ae0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 --2- 172.21.15.38:0/563081386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab446e40 0x555eab447220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 -- 172.21.15.38:0/563081386 >> 172.21.15.38:0/563081386 conn(0x555eab4433d0 msgr2=0x555eab4437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 -- 172.21.15.38:0/563081386 shutdown_connections 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.805+0000 7fecf4bec740 1 -- 172.21.15.38:0/563081386 wait complete. 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.806+0000 7fecf4bec740 1 -- start start 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.806+0000 7fecf4bec740 1 Processor -- start 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab446e40 0x555eab44ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab447760 0x555eab44f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecf4bec740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555eab454bf0 con 0x555eab452020 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecf4bec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555eab3680f0 con 0x555eab447760 2024-09-12T12:28:05.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecf4bec740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555eab454d70 con 0x555eab446e40 2024-09-12T12:28:05.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecf4bec740 10 client.0 _ll_register_callbacks cb 0x555eab34fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:05.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7feceb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab446e40 0x555eab44ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7feceaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab447760 0x555eab44f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7feceb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab446e40 0x555eab44ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:43544/0 (socket says 172.21.15.38:43544) 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7fecebe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7feceb400640 1 -- 172.21.15.38:0/1704241116 learned_addr learned my addr 172.21.15.38:0/1704241116 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.807+0000 7feceb400640 1 -- 172.21.15.38:0/1704241116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab447760 msgr2=0x555eab44f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7feceb400640 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab447760 0x555eab44f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7feceb400640 1 -- 172.21.15.38:0/1704241116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 msgr2=0x555eab44f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7feceb400640 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7feceb400640 1 -- 172.21.15.38:0/1704241116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eab11e3c0 con 0x555eab446e40 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7feceaa00640 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab447760 0x555eab44f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7feceb400640 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab446e40 0x555eab44ef10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009a50 tx=0x7fecdc02a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e644207f6c5661b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:05.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7fecd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7fecd4c00640 1 -- 172.21.15.38:0/1704241116 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc04e020 con 0x555eab446e40 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecdc0318e0 con 0x555eab446e40 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.808+0000 7fecd4c00640 1 -- 172.21.15.38:0/1704241116 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fecdc0041e0 con 0x555eab446e40 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecd4c00640 1 -- 172.21.15.38:0/1704241116 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fecdc059050 con 0x555eab446e40 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 10 client.25738 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555eab454c40 con 0x555eab446e40 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecd4c00640 1 -- 172.21.15.38:0/1704241116 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc0318e0 con 0x555eab446e40 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecd4c00640 1 -- 172.21.15.38:0/1704241116 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fecdc03cb50 con 0x555eab446e40 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 10 client.25738 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 10 client.25738 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 20 client.25738 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab461db0 0x555eab4641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 4 client.25738 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:05.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.809+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eab3ba950 con 0x555eab461db0 2024-09-12T12:28:05.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.810+0000 7feceaa00640 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab461db0 0x555eab4641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.810+0000 7feceaa00640 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab461db0 0x555eab4641a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=19948d42e93a7a42 server_cookie=8e49264b8fc011d1 in_seq=0 out_seq=0 2024-09-12T12:28:05.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.810+0000 7fecd4c00640 10 client.25738 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:28:05.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecd4c00640 1 -- 172.21.15.38:0/1704241116 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555eab3ba950 con 0x555eab461db0 2024-09-12T12:28:05.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecd4c00640 10 client.25738 handle_command_reply: tid=0 2024-09-12T12:28:05.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 client.25738 shutdown 2024-09-12T12:28:05.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab446e40 msgr2=0x555eab44ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab446e40 0x555eab44ef10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009a50 tx=0x7fecdc02a420 comp rx=0 tx=0).stop 2024-09-12T12:28:05.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 shutdown_connections 2024-09-12T12:28:05.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab461db0 0x555eab4641a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecd4c00640 0 client.25738 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab447760 0x555eab44f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 --2- 172.21.15.38:0/1704241116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab446e40 0x555eab44ef10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.811+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 >> 172.21.15.38:0/1704241116 conn(0x555eab4433d0 msgr2=0x555eab449100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.812+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 shutdown_connections 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.812+0000 7fecf4bec740 1 -- 172.21.15.38:0/1704241116 wait complete. 2024-09-12T12:28:05.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.812+0000 7fecf4bec740 20 client.25738 trim_cache size 0 max 16384 2024-09-12T12:28:05.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 Processor -- start 2024-09-12T12:28:05.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 -- start start 2024-09-12T12:28:05.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab4498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab469990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab469ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1aca30 con 0x555eab452020 2024-09-12T12:28:05.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1ae570 con 0x555eab446e40 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.826+0000 7fecf4bec740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1ad100 con 0x555eab447760 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab4498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceaa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab469990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab4498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:48912/0 (socket says 172.21.15.38:48912) 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 -- 172.21.15.38:0/2762495117 learned_addr learned my addr 172.21.15.38:0/2762495117 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7fecebe00640 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab469ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 -- 172.21.15.38:0/2762495117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 msgr2=0x555eab469990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab469990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 -- 172.21.15.38:0/2762495117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 msgr2=0x555eab469ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab469ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 -- 172.21.15.38:0/2762495117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eab464760 con 0x555eab446e40 2024-09-12T12:28:05.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.827+0000 7feceb400640 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab4498a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0315b0 tx=0x7fecdc005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea73e5c3941737a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecd7400640 1 -- 172.21.15.38:0/2762495117 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc04e070 con 0x555eab446e40 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecd7400640 1 -- 172.21.15.38:0/2762495117 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc0041e0 con 0x555eab446e40 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecd7400640 1 -- 172.21.15.38:0/2762495117 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc035040 con 0x555eab446e40 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecf4bec740 1 -- 172.21.15.38:0/2762495117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 msgr2=0x555eab4498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecf4bec740 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab4498a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0315b0 tx=0x7fecdc005780 comp rx=0 tx=0).stop 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecf4bec740 1 -- 172.21.15.38:0/2762495117 shutdown_connections 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecf4bec740 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab469ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecf4bec740 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab469990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecf4bec740 1 --2- 172.21.15.38:0/2762495117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab4498a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.828+0000 7fecf4bec740 1 -- 172.21.15.38:0/2762495117 >> 172.21.15.38:0/2762495117 conn(0x555eab4433d0 msgr2=0x555eab450f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.829+0000 7fecf4bec740 1 -- 172.21.15.38:0/2762495117 shutdown_connections 2024-09-12T12:28:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.829+0000 7fecf4bec740 1 -- 172.21.15.38:0/2762495117 wait complete. 2024-09-12T12:28:05.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.829+0000 7fecf4bec740 1 -- start start 2024-09-12T12:28:05.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.829+0000 7fecf4bec740 1 Processor -- start 2024-09-12T12:28:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab45a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab44bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecf4bec740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecf4bec740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1adea0 con 0x555eab452020 2024-09-12T12:28:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecf4bec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1ad7d0 con 0x555eab446e40 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecf4bec740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1aaa30 con 0x555eab447760 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecf4bec740 10 client.0 _ll_register_callbacks cb 0x7fecdc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7feceb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab45a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7fecebe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7feceb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab45a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:48916/0 (socket says 172.21.15.38:48916) 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7feceb400640 1 -- 172.21.15.38:0/879091937 learned_addr learned my addr 172.21.15.38:0/879091937 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.830+0000 7feceaa00640 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab44bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7feceb400640 1 -- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 msgr2=0x555eab44bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7feceb400640 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab44bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7feceb400640 1 -- 172.21.15.38:0/879091937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 msgr2=0x555eab44c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7feceb400640 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7feceb400640 1 -- 172.21.15.38:0/879091937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eab443200 con 0x555eab446e40 2024-09-12T12:28:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7feceaa00640 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab44bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7feceb400640 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab45a580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009a50 tx=0x7fecdc0038c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64087275bd04e551 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7fecd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7fecd4c00640 1 -- 172.21.15.38:0/879091937 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc035040 con 0x555eab446e40 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecdc0041e0 con 0x555eab446e40 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.831+0000 7fecd4c00640 1 -- 172.21.15.38:0/879091937 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fecdc031860 con 0x555eab446e40 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecd4c00640 1 -- 172.21.15.38:0/879091937 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fecdc06c050 con 0x555eab446e40 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 10 client.25775 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555eab4cc5f0 con 0x555eab446e40 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecd4c00640 1 -- 172.21.15.38:0/879091937 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc0041e0 con 0x555eab446e40 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecd4c00640 1 -- 172.21.15.38:0/879091937 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fecdc004c00 con 0x555eab446e40 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 10 client.25775 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 10 client.25775 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 20 client.25775 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab4ccbf0 0x555eab4cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:05.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 4 client.25775 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:05.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.832+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 --> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555eab3b4e60 con 0x555eab4ccbf0 2024-09-12T12:28:05.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.833+0000 7feceaa00640 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab4ccbf0 0x555eab4cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.833+0000 7feceaa00640 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab4ccbf0 0x555eab4cefe0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=761a9d22c21c1682 server_cookie=6fba9667c6e86cea in_seq=0 out_seq=0 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.833+0000 7fecd4c00640 10 client.25775 ms_handle_connect on v2:172.21.15.154:6836/973401105 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecd4c00640 1 -- 172.21.15.38:0/879091937 <== mds.3 v2:172.21.15.154:6836/973401105 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555eab3b4e60 con 0x555eab4ccbf0 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecd4c00640 10 client.25775 handle_command_reply: tid=0 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 client.25775 shutdown 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 msgr2=0x555eab45a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab45a580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009a50 tx=0x7fecdc0038c0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 shutdown_connections 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:6836/973401105,v1:172.21.15.154:6837/973401105] conn(0x555eab4ccbf0 0x555eab4cefe0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555eab452020 0x555eab44c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eab447760 0x555eab44bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 --2- 172.21.15.38:0/879091937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eab446e40 0x555eab45a580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecd4c00640 0 client.25775 ms_handle_reset on v2:172.21.15.154:6836/973401105 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 >> 172.21.15.38:0/879091937 conn(0x555eab4433d0 msgr2=0x555eab44eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 shutdown_connections 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 1 -- 172.21.15.38:0/879091937 wait complete. 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.834+0000 7fecf4bec740 20 client.25775 trim_cache size 0 max 16384 2024-09-12T12:28:05.838 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fecd00a2b80 msgr2=0x7fecd00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fecd00a2b80 0x7fecd00a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fece4005fd0 tx=0x7fece4009500 comp rx=0 tx=0).stop 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecec102360 msgr2=0x7fecec19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecec102360 0x7fecec19aa10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fecd800d6d0 tx=0x7fecd800db90 comp rx=0 tx=0).stop 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 shutdown_connections 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fecd00a2b80 0x7fecd00a5040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecec1079c0 0x7fecec19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecec102360 0x7fecec19aa10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 --2- 172.21.15.38:0/1022828391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecec1019c0 0x7fecec19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 >> 172.21.15.38:0/1022828391 conn(0x7fecec0fd740 msgr2=0x7fecec0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:05.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 shutdown_connections 2024-09-12T12:28:05.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:05.835+0000 7fecf0a00640 1 -- 172.21.15.38:0/1022828391 wait complete. 2024-09-12T12:28:05.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:05 smithi038 ceph-mon[30810]: pgmap v458: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-12T12:28:06.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:05 smithi071 ceph-mon[34859]: pgmap v458: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-12T12:28:06.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:05 smithi154 ceph-mon[35578]: pgmap v458: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-12T12:28:06.785 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:28:07.177 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:07.584 INFO:tasks.workunit.client.0.smithi038.stdout:setting up random write file 2024-09-12T12:28:07.584 INFO:tasks.workunit.client.0.smithi038.stdout:done setting up random write file 2024-09-12T12:28:07.584 INFO:tasks.workunit.client.0.smithi038.stdout:starting fsync run 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0009s fsync time: 0.0211s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0106s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0146s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0137s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0007s fsync time: 0.0091s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0007s fsync time: 0.0169s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0062s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0100s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0090s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0094s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0066s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0100s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0072s 2024-09-12T12:28:07.585 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0091s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0064s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0096s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0062s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0091s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0092s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0073s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0099s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0084s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0143s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0092s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0008s fsync time: 0.0168s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0089s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0074s 2024-09-12T12:28:07.586 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0097s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0079s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0147s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0097s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0083s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0094s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0064s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0143s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0076s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0097s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0070s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0008s fsync time: 0.0470s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0070s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0102s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0071s 2024-09-12T12:28:07.587 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0092s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0092s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0148s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0094s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0008s fsync time: 0.0168s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0093s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0097s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0105s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0069s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0094s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0166s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0008s fsync time: 0.0139s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0107s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0098s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0102s 2024-09-12T12:28:07.588 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0094s 2024-09-12T12:28:07.589 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0100s 2024-09-12T12:28:07.589 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0005s fsync time: 0.0096s 2024-09-12T12:28:07.589 INFO:tasks.workunit.client.0.smithi038.stdout:run done 61 fsyncs total, killing random writer 2024-09-12T12:28:07.589 INFO:tasks.workunit.client.0.smithi038.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T12:28:07.589 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T12:28:07.589 INFO:tasks.workunit.client.0.smithi038.stderr:+ whereis lsof 2024-09-12T12:28:07.696 INFO:tasks.workunit.client.0.smithi038.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-12T12:28:07.696 INFO:tasks.workunit.client.0.smithi038.stderr:+ lsof 2024-09-12T12:28:07.748 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/3b272250a8486399ce594245550c106017c986fd074b6e804a4b8ddaea754b0c/merged 2024-09-12T12:28:07.749 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/79e0a94ea41dd040a595954dd46959ca716f8953c1537ad09d6e23d82c4e740b/merged 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/caa4beb861274e9f51ed6d11e5ca1da20fb90c57fb001d7a4682ddbc3b8f507d/merged 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/10674fc1ace021df69dea4870ee4bae98ef32276b382dd68b17bbf5781e5b457/merged 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/5a7bff539e23d781e03a55bd705af6c97da5a99f9f6838e16a5bda1a067b7dbe/merged 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/79c498f486f9dd545f8f9e015adf033cfc46dd067a6192d4509c7951b5691808/merged 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.758 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/6e85cdc6dc26222cb2714aa1198f683a9772111edea67ed0d63af4112b8a1242/merged 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/a060d524ef8db99595b65f48a88c4e724e70ee2dcd896e1e1befd5e7b8c69b7e/merged 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/9ac140f691e20fed2373146a49d3f1d8647324d49c1ab7e623d89ec0ee8cd87f/merged 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/95dc28a87c9fb9b8dcbef2150857f96f45c9e407b01788745966f4553beea045/merged 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/3ce90c6618b66d93e59f223fbdaa47fe53737a8e7d88729299f8d4b1e0ab3e7f/merged 2024-09-12T12:28:07.759 INFO:tasks.workunit.client.0.smithi038.stderr: Output information may be incomplete. 2024-09-12T12:28:07.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 -- 172.21.15.38:0/1153026567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d4103ff0 msgr2=0x7f62d41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 --2- 172.21.15.38:0/1153026567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d4103ff0 0x7f62d41043d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009900 tx=0x7f62c802a410 comp rx=0 tx=0).stop 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 -- 172.21.15.38:0/1153026567 shutdown_connections 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 --2- 172.21.15.38:0/1153026567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d4109120 0x7f62d4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 --2- 172.21.15.38:0/1153026567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62d41049a0 0x7f62d41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 --2- 172.21.15.38:0/1153026567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d4103ff0 0x7f62d41043d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 -- 172.21.15.38:0/1153026567 >> 172.21.15.38:0/1153026567 conn(0x7f62d40ffa90 msgr2=0x7f62d4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 -- 172.21.15.38:0/1153026567 shutdown_connections 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.746+0000 7f62dc800640 1 -- 172.21.15.38:0/1153026567 wait complete. 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.747+0000 7f62dc800640 1 Processor -- start 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62dc800640 1 -- start start 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62dc800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d4103ff0 0x7f62d419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62dc800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d41049a0 0x7f62d419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62dc800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62d4109120 0x7f62d419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62dc800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f62d4114170 con 0x7f62d41049a0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62dc800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62d4113ff0 con 0x7f62d4103ff0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62dc800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41142f0 con 0x7f62d4109120 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62d9400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d41049a0 0x7f62d419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62d9400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d41049a0 0x7f62d419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54142/0 (socket says 172.21.15.38:54142) 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62d9400640 1 -- 172.21.15.38:0/2642822675 learned_addr learned my addr 172.21.15.38:0/2642822675 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62d9e00640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d4103ff0 0x7f62d419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.748+0000 7f62da800640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62d4109120 0x7f62d419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.749+0000 7f62d9400640 1 -- 172.21.15.38:0/2642822675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62d4109120 msgr2=0x7f62d419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.749+0000 7f62d9400640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62d4109120 0x7f62d419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.749+0000 7f62d9400640 1 -- 172.21.15.38:0/2642822675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d4103ff0 msgr2=0x7f62d419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.749+0000 7f62d9400640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d4103ff0 0x7f62d419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.749+0000 7f62d9400640 1 -- 172.21.15.38:0/2642822675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d419f620 con 0x7f62d41049a0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.749+0000 7f62d9400640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d41049a0 0x7f62d419abb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e9f0 tx=0x7f62c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.749+0000 7f62cea00640 1 -- 172.21.15.38:0/2642822675 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c400cd80 con 0x7f62d41049a0 2024-09-12T12:28:07.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.750+0000 7f62cea00640 1 -- 172.21.15.38:0/2642822675 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62c4010910 con 0x7f62d41049a0 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.750+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d419f910 con 0x7f62d41049a0 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.750+0000 7f62cea00640 1 -- 172.21.15.38:0/2642822675 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4018990 con 0x7f62d41049a0 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.750+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d41a71f0 con 0x7f62d41049a0 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 Processor -- start 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 -- start start 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf4c70 0x55c767bf5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bff910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bffe50 0x55c767c02240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55c767b5b3e0 con 0x55c767bf4c70 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c767b02d80 con 0x55c767bf5590 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62df41a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c767b573a0 con 0x55c767bffe50 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.753+0000 7f62cea00640 1 -- 172.21.15.38:0/2642822675 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f62c4010ac0 con 0x7f62d41049a0 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf4c70 0x55c767bf5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf4c70 0x55c767bf5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54156/0 (socket says 172.21.15.38:54156) 2024-09-12T12:28:07.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 -- 172.21.15.38:0/2428062621 learned_addr learned my addr 172.21.15.38:0/2428062621 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62d9400640 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bffe50 0x55c767c02240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62d9e00640 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 -- 172.21.15.38:0/2428062621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bffe50 msgr2=0x55c767c02240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bffe50 0x55c767c02240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 -- 172.21.15.38:0/2428062621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 msgr2=0x55c767bff910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bff910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62da800640 1 -- 172.21.15.38:0/2428062621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c767b21ae0 con 0x55c767bf4c70 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.754+0000 7f62d9400640 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bffe50 0x55c767c02240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.755+0000 7f62da800640 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf4c70 0x55c767bf5050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009f50 tx=0x7f62d00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02dab08cbbbcd82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.755+0000 7f62c3000640 1 -- 172.21.15.38:0/2428062621 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0004d20 con 0x55c767bf4c70 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.755+0000 7f62c3000640 1 -- 172.21.15.38:0/2428062621 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62d0004050 con 0x55c767bf4c70 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.755+0000 7f62cea00640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f62bc0a2b80 0x7f62bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62cea00640 1 -- 172.21.15.38:0/2642822675 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f62c40cf760 con 0x7f62d41049a0 2024-09-12T12:28:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62c3000640 1 -- 172.21.15.38:0/2428062621 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0005220 con 0x55c767bf4c70 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62d9e00640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f62bc0a2b80 0x7f62bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 -- 172.21.15.38:0/2428062621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf4c70 msgr2=0x55c767bf5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf4c70 0x55c767bf5050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009f50 tx=0x7f62d00118d0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 -- 172.21.15.38:0/2428062621 shutdown_connections 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bffe50 0x55c767c02240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 --2- 172.21.15.38:0/2428062621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf4c70 0x55c767bf5050 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 -- 172.21.15.38:0/2428062621 >> 172.21.15.38:0/2428062621 conn(0x55c767bf1200 msgr2=0x55c767bf15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 -- 172.21.15.38:0/2428062621 shutdown_connections 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.756+0000 7f62df41a740 1 -- 172.21.15.38:0/2428062621 wait complete. 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62d9e00640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f62bc0a2b80 0x7f62bc0a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f62c8000c00 tx=0x7f62c8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 -- start start 2024-09-12T12:28:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 Processor -- start 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bfcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf5590 0x55c767bfd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bffe50 0x55c767bfd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55c767c02a70 con 0x55c767bf5590 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c767b160f0 con 0x55c767bffe50 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c767c02bf0 con 0x55c767bf4c70 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.757+0000 7f62df41a740 10 client.0 _ll_register_callbacks cb 0x55c767afdbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf5590 0x55c767bfd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bfcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf5590 0x55c767bfd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54158/0 (socket says 172.21.15.38:54158) 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bfcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:43588/0 (socket says 172.21.15.38:43588) 2024-09-12T12:28:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9400640 1 -- 172.21.15.38:0/1682780827 learned_addr learned my addr 172.21.15.38:0/1682780827 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62da800640 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bffe50 0x55c767bfd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 -- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bffe50 msgr2=0x55c767bfd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bffe50 0x55c767bfd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 -- 172.21.15.38:0/1682780827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf5590 msgr2=0x55c767bfd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf5590 0x55c767bfd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 -- 172.21.15.38:0/1682780827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7678cc3c0 con 0x55c767bf4c70 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9400640 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf5590 0x55c767bfd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62d9e00640 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bfcc90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62c802aa00 tx=0x7f62c802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbfc3cad09f972bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.758+0000 7f62b7400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.759+0000 7f62b7400640 1 -- 172.21.15.38:0/1682780827 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c804d020 con 0x55c767bf4c70 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.759+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d0004050 con 0x55c767bf4c70 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.759+0000 7f62b7400640 1 -- 172.21.15.38:0/1682780827 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f62c8005450 con 0x55c767bf4c70 2024-09-12T12:28:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.759+0000 7f62b7400640 1 -- 172.21.15.38:0/1682780827 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f62c8058050 con 0x55c767bf4c70 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.759+0000 7f62df41a740 10 client.25753 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.759+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c767c0e9b0 con 0x55c767bf4c70 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62b7400640 1 -- 172.21.15.38:0/1682780827 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62d0004050 con 0x55c767bf4c70 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62b7400640 1 -- 172.21.15.38:0/1682780827 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f62c8032920 con 0x55c767bf4c70 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62df41a740 10 client.25753 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62df41a740 10 client.25753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62df41a740 20 client.25753 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62df41a740 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c0fec0 0x55c767c12330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62df41a740 4 client.25753 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c767b68950 con 0x55c767c0fec0 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.760+0000 7f62d9400640 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c0fec0 0x55c767c12330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.761+0000 7f62d9400640 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c0fec0 0x55c767c12330 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=421775dd1c19f6a server_cookie=c11c27d43a8855da in_seq=0 out_seq=0 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.761+0000 7f62b7400640 10 client.25753 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62b7400640 1 -- 172.21.15.38:0/1682780827 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c767b68950 con 0x55c767c0fec0 2024-09-12T12:28:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62b7400640 10 client.25753 handle_command_reply: tid=0 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 client.25753 shutdown 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 msgr2=0x55c767bfcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bfcc90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62c802aa00 tx=0x7f62c802a410 comp rx=0 tx=0).stop 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 shutdown_connections 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c0fec0 0x55c767c12330 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bffe50 0x55c767bfd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62b7400640 0 client.25753 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bf5590 0x55c767bfd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 --2- 172.21.15.38:0/1682780827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bfcc90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 >> 172.21.15.38:0/1682780827 conn(0x55c767bf1200 msgr2=0x55c767bf0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 shutdown_connections 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 1 -- 172.21.15.38:0/1682780827 wait complete. 2024-09-12T12:28:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.762+0000 7f62df41a740 20 client.25753 trim_cache size 0 max 16384 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 Processor -- start 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 -- start start 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bf76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bfec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767c17c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41b0fb0 con 0x55c767bffe50 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41b2af0 con 0x55c767bf5590 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.777+0000 7f62df41a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41b1680 con 0x55c767bf4c70 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62da800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767c17c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bfec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bf76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bfec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:48964/0 (socket says 172.21.15.38:48964) 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 -- 172.21.15.38:0/410025205 learned_addr learned my addr 172.21.15.38:0/410025205 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 -- 172.21.15.38:0/410025205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 msgr2=0x55c767bf76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 --2- 172.21.15.38:0/410025205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bf76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 -- 172.21.15.38:0/410025205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 msgr2=0x55c767c17c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 --2- 172.21.15.38:0/410025205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767c17c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 -- 172.21.15.38:0/410025205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c767bec770 con 0x55c767bf5590 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.778+0000 7f62d9400640 1 --2- 172.21.15.38:0/410025205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bfec00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f62c409be20 tx=0x7f62c4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee6d82aef59d4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.779+0000 7f62c2600640 1 -- 172.21.15.38:0/410025205 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4099d00 con 0x55c767bf5590 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.779+0000 7f62c2600640 1 -- 172.21.15.38:0/410025205 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62c4099f60 con 0x55c767bf5590 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.779+0000 7f62c2600640 1 -- 172.21.15.38:0/410025205 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c40cfb50 con 0x55c767bf5590 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.779+0000 7f62df41a740 1 -- 172.21.15.38:0/410025205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 msgr2=0x55c767bfec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.779+0000 7f62df41a740 1 --2- 172.21.15.38:0/410025205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bfec00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f62c409be20 tx=0x7f62c4000bc0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 -- 172.21.15.38:0/410025205 shutdown_connections 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 --2- 172.21.15.38:0/410025205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767c17c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 --2- 172.21.15.38:0/410025205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bfec00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 --2- 172.21.15.38:0/410025205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767bf76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 -- 172.21.15.38:0/410025205 >> 172.21.15.38:0/410025205 conn(0x55c767bf1200 msgr2=0x55c767bfe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 -- 172.21.15.38:0/410025205 shutdown_connections 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 -- 172.21.15.38:0/410025205 wait complete. 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 -- start start 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.780+0000 7f62df41a740 1 Processor -- start 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62df41a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767c08630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62df41a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bf99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62df41a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767bf9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62df41a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41b2420 con 0x55c767bffe50 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62df41a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41b1d50 con 0x55c767bf5590 2024-09-12T12:28:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62df41a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41aef90 con 0x55c767bf4c70 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62df41a740 10 client.0 _ll_register_callbacks cb 0x7f62c8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62d9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767c08630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62da800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767bf9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62d9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767c08630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:43616/0 (socket says 172.21.15.38:43616) 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62d9e00640 1 -- 172.21.15.38:0/1188922201 learned_addr learned my addr 172.21.15.38:0/1188922201 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.781+0000 7f62d9400640 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bf99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62d9e00640 1 -- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 msgr2=0x55c767bf99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62d9e00640 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bf99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62d9e00640 1 -- 172.21.15.38:0/1188922201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 msgr2=0x55c767bf9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62d9e00640 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767bf9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62d9e00640 1 -- 172.21.15.38:0/1188922201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c767bf22b0 con 0x55c767bf4c70 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62da800640 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767bf9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62d9e00640 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767c08630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62c8004100 tx=0x7f62c8032fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9544b6d34faa80a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62b7400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:28:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.782+0000 7f62b7400640 1 -- 172.21.15.38:0/1188922201 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c804d070 con 0x55c767bf4c70 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62c4099f60 con 0x55c767bf4c70 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62b7400640 1 -- 172.21.15.38:0/1188922201 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f62c80325c0 con 0x55c767bf4c70 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62b7400640 1 -- 172.21.15.38:0/1188922201 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f62c806c050 con 0x55c767bf4c70 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 10 client.25759 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c767c7a9d0 con 0x55c767bf4c70 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62b7400640 1 -- 172.21.15.38:0/1188922201 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62c4099f60 con 0x55c767bf4c70 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62b7400640 1 -- 172.21.15.38:0/1188922201 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f62c8065060 con 0x55c767bf4c70 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 10 client.25759 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 10 client.25759 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 20 client.25759 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c7b140 0x55c767c7d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 4 client.25759 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.783+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 --> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c767b62e60 con 0x55c767c7b140 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.784+0000 7f62d9400640 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c7b140 0x55c767c7d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.784+0000 7f62d9400640 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c7b140 0x55c767c7d530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=46c3ee1e377d7ddb server_cookie=89accbd6b8440844 in_seq=0 out_seq=0 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.784+0000 7f62b7400640 10 client.25759 ms_handle_connect on v2:172.21.15.71:6836/293615032 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62b7400640 1 -- 172.21.15.38:0/1188922201 <== mds.2 v2:172.21.15.71:6836/293615032 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c767b62e60 con 0x55c767c7b140 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62b7400640 10 client.25759 handle_command_reply: tid=0 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 client.25759 shutdown 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 msgr2=0x55c767c08630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767c08630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62c8004100 tx=0x7f62c8032fb0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 shutdown_connections 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:6836/293615032,v1:172.21.15.71:6837/293615032] conn(0x55c767c7b140 0x55c767c7d530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c767bffe50 0x55c767bf9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c767bf5590 0x55c767bf99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 --2- 172.21.15.38:0/1188922201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c767bf4c70 0x55c767c08630 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62b7400640 0 client.25759 ms_handle_reset on v2:172.21.15.71:6836/293615032 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 >> 172.21.15.38:0/1188922201 conn(0x55c767bf1200 msgr2=0x55c767bf0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 shutdown_connections 2024-09-12T12:28:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 1 -- 172.21.15.38:0/1188922201 wait complete. 2024-09-12T12:28:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.785+0000 7f62df41a740 20 client.25759 trim_cache size 0 max 16384 2024-09-12T12:28:07.792 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:28:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f62bc0a2b80 msgr2=0x7f62bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f62bc0a2b80 0x7f62bc0a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f62c8000c00 tx=0x7f62c8005b50 comp rx=0 tx=0).stop 2024-09-12T12:28:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d41049a0 msgr2=0x7f62d419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d41049a0 0x7f62d419abb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e9f0 tx=0x7f62c400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 shutdown_connections 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f62bc0a2b80 0x7f62bc0a5040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62d4109120 0x7f62d419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62d41049a0 0x7f62d419abb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 --2- 172.21.15.38:0/2642822675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62d4103ff0 0x7f62d419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 >> 172.21.15.38:0/2642822675 conn(0x7f62d40ffa90 msgr2=0x7f62d4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 shutdown_connections 2024-09-12T12:28:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:07.786+0000 7f62dc800640 1 -- 172.21.15.38:0/2642822675 wait complete. 2024-09-12T12:28:07.911 INFO:tasks.workunit.client.0.smithi038.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-12T12:28:07.911 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-12T12:28:07.911 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-12T12:28:07.911 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-12T12:28:07.911 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-12T12:28:07.911 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-12T12:28:07.911 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-12T12:28:07.912 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-12T12:28:07.913 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-12T12:28:07.914 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-12T12:28:07.915 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_preem 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_preem 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_preem 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_preem 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_p 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_p 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_p 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_p 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_g 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_g 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_g 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_exp_g 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-12T12:28:07.916 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-12T12:28:07.917 INFO:tasks.workunit.client.0.smithi038.stdout:migration 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:migration 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:migration 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:migration 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-09-12T12:28:07.918 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:migration 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:migration 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:migration 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:migration 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-12T12:28:07.919 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:migration 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:migration 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:migration 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:migration 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-09-12T12:28:07.920 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-12T12:28:07.921 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-12T12:28:07.922 INFO:tasks.workunit.client.0.smithi038.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-12T12:28:07.923 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:migration 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:migration 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:migration 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:migration 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 51 root cwd unknown /proc/51/cwd (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 51 root rtd unknown /proc/51/root (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 51 root txt unknown /proc/51/exe (readlink: Permission denied) 2024-09-12T12:28:07.924 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 51 root NOFD /proc/51/fd (opendir: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:migration 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:migration 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:migration 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:migration 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-12T12:28:07.925 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-12T12:28:07.926 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 63 root cwd unknown /proc/63/cwd (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 63 root rtd unknown /proc/63/root (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 63 root txt unknown /proc/63/exe (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 63 root NOFD /proc/63/fd (opendir: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 65 root cwd unknown /proc/65/cwd (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 65 root rtd unknown /proc/65/root (readlink: Permission denied) 2024-09-12T12:28:07.927 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 65 root txt unknown /proc/65/exe (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 65 root NOFD /proc/65/fd (opendir: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 66 root cwd unknown /proc/66/cwd (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 66 root rtd unknown /proc/66/root (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 66 root txt unknown /proc/66/exe (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 66 root NOFD /proc/66/fd (opendir: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 67 root NOFD /proc/67/fd (opendir: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-09-12T12:28:07.928 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2024-09-12T12:28:07.929 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 71 root NOFD /proc/71/fd (opendir: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:irq/9-acp 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:irq/9-acp 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:irq/9-acp 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:irq/9-acp 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-12T12:28:07.930 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-12T12:28:07.931 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-09-12T12:28:07.932 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 94 root cwd unknown /proc/94/cwd (readlink: Permission denied) 2024-09-12T12:28:07.933 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 94 root rtd unknown /proc/94/root (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 94 root txt unknown /proc/94/exe (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 94 root NOFD /proc/94/fd (opendir: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 96 root cwd unknown /proc/96/cwd (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 96 root rtd unknown /proc/96/root (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 96 root txt unknown /proc/96/exe (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 96 root NOFD /proc/96/fd (opendir: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 97 root cwd unknown /proc/97/cwd (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 97 root rtd unknown /proc/97/root (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 97 root txt unknown /proc/97/exe (readlink: Permission denied) 2024-09-12T12:28:07.934 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 97 root NOFD /proc/97/fd (opendir: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 98 root cwd unknown /proc/98/cwd (readlink: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 98 root rtd unknown /proc/98/root (readlink: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 98 root txt unknown /proc/98/exe (readlink: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 98 root NOFD /proc/98/fd (opendir: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 99 root cwd unknown /proc/99/cwd (readlink: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 99 root rtd unknown /proc/99/root (readlink: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 99 root txt unknown /proc/99/exe (readlink: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 99 root NOFD /proc/99/fd (opendir: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 100 root cwd unknown /proc/100/cwd (readlink: Permission denied) 2024-09-12T12:28:07.935 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 100 root rtd unknown /proc/100/root (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 100 root txt unknown /proc/100/exe (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 100 root NOFD /proc/100/fd (opendir: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 101 root cwd unknown /proc/101/cwd (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 101 root rtd unknown /proc/101/root (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 101 root txt unknown /proc/101/exe (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 101 root NOFD /proc/101/fd (opendir: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 105 root cwd unknown /proc/105/cwd (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 105 root rtd unknown /proc/105/root (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 105 root txt unknown /proc/105/exe (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 105 root NOFD /proc/105/fd (opendir: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 106 root cwd unknown /proc/106/cwd (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 106 root rtd unknown /proc/106/root (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 106 root txt unknown /proc/106/exe (readlink: Permission denied) 2024-09-12T12:28:07.936 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 106 root NOFD /proc/106/fd (opendir: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 107 root cwd unknown /proc/107/cwd (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 107 root rtd unknown /proc/107/root (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 107 root txt unknown /proc/107/exe (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 107 root NOFD /proc/107/fd (opendir: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 108 root cwd unknown /proc/108/cwd (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 108 root rtd unknown /proc/108/root (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 108 root txt unknown /proc/108/exe (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 108 root NOFD /proc/108/fd (opendir: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-09-12T12:28:07.937 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-12T12:28:07.938 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 117 root cwd unknown /proc/117/cwd (readlink: Permission denied) 2024-09-12T12:28:07.939 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 117 root rtd unknown /proc/117/root (readlink: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 117 root txt unknown /proc/117/exe (readlink: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 117 root NOFD /proc/117/fd (opendir: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 120 root cwd unknown /proc/120/cwd (readlink: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 120 root rtd unknown /proc/120/root (readlink: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 120 root txt unknown /proc/120/exe (readlink: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 120 root NOFD /proc/120/fd (opendir: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 121 root cwd unknown /proc/121/cwd (readlink: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 121 root rtd unknown /proc/121/root (readlink: Permission denied) 2024-09-12T12:28:07.940 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 121 root txt unknown /proc/121/exe (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 121 root NOFD /proc/121/fd (opendir: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 122 root cwd unknown /proc/122/cwd (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 122 root rtd unknown /proc/122/root (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 122 root txt unknown /proc/122/exe (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 122 root NOFD /proc/122/fd (opendir: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 128 root cwd unknown /proc/128/cwd (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 128 root rtd unknown /proc/128/root (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 128 root txt unknown /proc/128/exe (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 128 root NOFD /proc/128/fd (opendir: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 130 root cwd unknown /proc/130/cwd (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 130 root rtd unknown /proc/130/root (readlink: Permission denied) 2024-09-12T12:28:07.941 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 130 root txt unknown /proc/130/exe (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 130 root NOFD /proc/130/fd (opendir: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 131 root cwd unknown /proc/131/cwd (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 131 root rtd unknown /proc/131/root (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 131 root txt unknown /proc/131/exe (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 131 root NOFD /proc/131/fd (opendir: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 132 root cwd unknown /proc/132/cwd (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 132 root rtd unknown /proc/132/root (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 132 root txt unknown /proc/132/exe (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 132 root NOFD /proc/132/fd (opendir: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 139 root cwd unknown /proc/139/cwd (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 139 root rtd unknown /proc/139/root (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 139 root txt unknown /proc/139/exe (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 139 root NOFD /proc/139/fd (opendir: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 222 root cwd unknown /proc/222/cwd (readlink: Permission denied) 2024-09-12T12:28:07.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 222 root rtd unknown /proc/222/root (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 222 root txt unknown /proc/222/exe (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 222 root NOFD /proc/222/fd (opendir: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 264 root cwd unknown /proc/264/cwd (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 264 root rtd unknown /proc/264/root (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 264 root txt unknown /proc/264/exe (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 264 root NOFD /proc/264/fd (opendir: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 268 root cwd unknown /proc/268/cwd (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 268 root rtd unknown /proc/268/root (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 268 root txt unknown /proc/268/exe (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 268 root NOFD /proc/268/fd (opendir: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 287 root cwd unknown /proc/287/cwd (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 287 root rtd unknown /proc/287/root (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 287 root txt unknown /proc/287/exe (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 287 root NOFD /proc/287/fd (opendir: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 295 root cwd unknown /proc/295/cwd (readlink: Permission denied) 2024-09-12T12:28:07.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 295 root rtd unknown /proc/295/root (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 295 root txt unknown /proc/295/exe (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 295 root NOFD /proc/295/fd (opendir: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 370 root cwd unknown /proc/370/cwd (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 370 root rtd unknown /proc/370/root (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 370 root txt unknown /proc/370/exe (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 370 root NOFD /proc/370/fd (opendir: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 401 root cwd unknown /proc/401/cwd (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 401 root rtd unknown /proc/401/root (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 401 root txt unknown /proc/401/exe (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 401 root NOFD /proc/401/fd (opendir: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 402 root cwd unknown /proc/402/cwd (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 402 root rtd unknown /proc/402/root (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 402 root txt unknown /proc/402/exe (readlink: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 402 root NOFD /proc/402/fd (opendir: Permission denied) 2024-09-12T12:28:07.944 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 417 root cwd unknown /proc/417/cwd (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 417 root rtd unknown /proc/417/root (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 417 root txt unknown /proc/417/exe (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 417 root NOFD /proc/417/fd (opendir: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 418 root cwd unknown /proc/418/cwd (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 418 root rtd unknown /proc/418/root (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 418 root txt unknown /proc/418/exe (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 418 root NOFD /proc/418/fd (opendir: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 422 root cwd unknown /proc/422/cwd (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 422 root rtd unknown /proc/422/root (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 422 root txt unknown /proc/422/exe (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 422 root NOFD /proc/422/fd (opendir: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-12T12:28:07.945 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 541 root cwd unknown /proc/541/cwd (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 541 root rtd unknown /proc/541/root (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 541 root txt unknown /proc/541/exe (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 541 root NOFD /proc/541/fd (opendir: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 548 root cwd unknown /proc/548/cwd (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 548 root rtd unknown /proc/548/root (readlink: Permission denied) 2024-09-12T12:28:07.946 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 548 root txt unknown /proc/548/exe (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 548 root NOFD /proc/548/fd (opendir: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 551 root cwd unknown /proc/551/cwd (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 551 root rtd unknown /proc/551/root (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 551 root txt unknown /proc/551/exe (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 551 root NOFD /proc/551/fd (opendir: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 559 root cwd unknown /proc/559/cwd (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 559 root rtd unknown /proc/559/root (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 559 root txt unknown /proc/559/exe (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 559 root NOFD /proc/559/fd (opendir: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 610 root cwd unknown /proc/610/cwd (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 610 root rtd unknown /proc/610/root (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 610 root txt unknown /proc/610/exe (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 610 root NOFD /proc/610/fd (opendir: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 628 rpc cwd unknown /proc/628/cwd (readlink: Permission denied) 2024-09-12T12:28:07.947 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 628 rpc rtd unknown /proc/628/root (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 628 rpc txt unknown /proc/628/exe (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 628 rpc NOFD /proc/628/fd (opendir: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 629 root cwd unknown /proc/629/cwd (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 629 root rtd unknown /proc/629/root (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 629 root txt unknown /proc/629/exe (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 629 root NOFD /proc/629/fd (opendir: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 root cwd unknown /proc/632/cwd (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 root rtd unknown /proc/632/root (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 root txt unknown /proc/632/exe (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 root NOFD /proc/632/fd (opendir: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 633 auditd root cwd unknown /proc/632/task/633/cwd (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 633 auditd root rtd unknown /proc/632/task/633/root (readlink: Permission denied) 2024-09-12T12:28:07.948 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 633 auditd root txt unknown /proc/632/task/633/exe (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 633 auditd root NOFD /proc/632/task/633/fd (opendir: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 635 auditd root cwd unknown /proc/632/task/635/cwd (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 635 auditd root rtd unknown /proc/632/task/635/root (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 635 auditd root txt unknown /proc/632/task/635/exe (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 632 635 auditd root NOFD /proc/632/task/635/fd (opendir: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 634 root cwd unknown /proc/634/cwd (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 634 root rtd unknown /proc/634/root (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 634 root txt unknown /proc/634/exe (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 634 root NOFD /proc/634/fd (opendir: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 639 root cwd unknown /proc/639/cwd (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 639 root rtd unknown /proc/639/root (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 639 root txt unknown /proc/639/exe (readlink: Permission denied) 2024-09-12T12:28:07.949 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 639 root NOFD /proc/639/fd (opendir: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 640 root cwd unknown /proc/640/cwd (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 640 root rtd unknown /proc/640/root (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 640 root txt unknown /proc/640/exe (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 640 root NOFD /proc/640/fd (opendir: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 679 dbus cwd unknown /proc/679/cwd (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 679 dbus rtd unknown /proc/679/root (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 679 dbus txt unknown /proc/679/exe (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 679 dbus NOFD /proc/679/fd (opendir: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 680 dbus cwd unknown /proc/680/cwd (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 680 dbus rtd unknown /proc/680/root (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 680 dbus txt unknown /proc/680/exe (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-brok 680 dbus NOFD /proc/680/fd (opendir: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 root cwd unknown /proc/681/cwd (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 root rtd unknown /proc/681/root (readlink: Permission denied) 2024-09-12T12:28:07.950 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 root txt unknown /proc/681/exe (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 root NOFD /proc/681/fd (opendir: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 697 gmain root cwd unknown /proc/681/task/697/cwd (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 697 gmain root rtd unknown /proc/681/task/697/root (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 697 gmain root txt unknown /proc/681/task/697/exe (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 697 gmain root NOFD /proc/681/task/697/fd (opendir: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 698 gdbus root cwd unknown /proc/681/task/698/cwd (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 698 gdbus root rtd unknown /proc/681/task/698/root (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 698 gdbus root txt unknown /proc/681/task/698/exe (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 681 698 gdbus root NOFD /proc/681/task/698/fd (opendir: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 root cwd unknown /proc/684/cwd (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 root rtd unknown /proc/684/root (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 root txt unknown /proc/684/exe (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 root NOFD /proc/684/fd (opendir: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 690 gmain root cwd unknown /proc/684/task/690/cwd (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 690 gmain root rtd unknown /proc/684/task/690/root (readlink: Permission denied) 2024-09-12T12:28:07.951 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 690 gmain root txt unknown /proc/684/task/690/exe (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 684 690 gmain root NOFD /proc/684/task/690/fd (opendir: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 685 libstoragemgmt cwd unknown /proc/685/cwd (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 685 libstoragemgmt rtd unknown /proc/685/root (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 685 libstoragemgmt txt unknown /proc/685/exe (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 685 libstoragemgmt NOFD /proc/685/fd (opendir: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 687 root cwd unknown /proc/687/cwd (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 687 root rtd unknown /proc/687/root (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 687 root txt unknown /proc/687/exe (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 687 root NOFD /proc/687/fd (opendir: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 689 root cwd unknown /proc/689/cwd (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 689 root rtd unknown /proc/689/root (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 689 root txt unknown /proc/689/exe (readlink: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 689 root NOFD /proc/689/fd (opendir: Permission denied) 2024-09-12T12:28:07.952 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 735 root cwd unknown /proc/735/cwd (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 735 root rtd unknown /proc/735/root (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 735 root txt unknown /proc/735/exe (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 735 root NOFD /proc/735/fd (opendir: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 root cwd unknown /proc/739/cwd (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 root rtd unknown /proc/739/root (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 root txt unknown /proc/739/exe (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 root NOFD /proc/739/fd (opendir: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 740 gssproxy root cwd unknown /proc/739/task/740/cwd (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 740 gssproxy root rtd unknown /proc/739/task/740/root (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 740 gssproxy root txt unknown /proc/739/task/740/exe (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 740 gssproxy root NOFD /proc/739/task/740/fd (opendir: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 741 gssproxy root cwd unknown /proc/739/task/741/cwd (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 741 gssproxy root rtd unknown /proc/739/task/741/root (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 741 gssproxy root txt unknown /proc/739/task/741/exe (readlink: Permission denied) 2024-09-12T12:28:07.953 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 741 gssproxy root NOFD /proc/739/task/741/fd (opendir: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 742 gssproxy root cwd unknown /proc/739/task/742/cwd (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 742 gssproxy root rtd unknown /proc/739/task/742/root (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 742 gssproxy root txt unknown /proc/739/task/742/exe (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 742 gssproxy root NOFD /proc/739/task/742/fd (opendir: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 743 gssproxy root cwd unknown /proc/739/task/743/cwd (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 743 gssproxy root rtd unknown /proc/739/task/743/root (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 743 gssproxy root txt unknown /proc/739/task/743/exe (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 743 gssproxy root NOFD /proc/739/task/743/fd (opendir: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 744 gssproxy root cwd unknown /proc/739/task/744/cwd (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 744 gssproxy root rtd unknown /proc/739/task/744/root (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 744 gssproxy root txt unknown /proc/739/task/744/exe (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 739 744 gssproxy root NOFD /proc/739/task/744/fd (opendir: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:atd 746 root cwd unknown /proc/746/cwd (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:atd 746 root rtd unknown /proc/746/root (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:atd 746 root txt unknown /proc/746/exe (readlink: Permission denied) 2024-09-12T12:28:07.954 INFO:tasks.workunit.client.0.smithi038.stdout:atd 746 root NOFD /proc/746/fd (opendir: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:crond 747 root cwd unknown /proc/747/cwd (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:crond 747 root rtd unknown /proc/747/root (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:crond 747 root txt unknown /proc/747/exe (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:crond 747 root NOFD /proc/747/fd (opendir: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 763 nrpe cwd unknown /proc/763/cwd (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 763 nrpe rtd unknown /proc/763/root (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 763 nrpe txt unknown /proc/763/exe (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 763 nrpe NOFD /proc/763/fd (opendir: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1099 root cwd unknown /proc/1099/cwd (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1099 root rtd unknown /proc/1099/root (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1099 root txt unknown /proc/1099/exe (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1099 root NOFD /proc/1099/fd (opendir: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1101 root cwd unknown /proc/1101/cwd (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1101 root rtd unknown /proc/1101/root (readlink: Permission denied) 2024-09-12T12:28:07.955 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1101 root txt unknown /proc/1101/exe (readlink: Permission denied) 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 1101 root NOFD /proc/1101/fd (opendir: Permission denied) 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu cwd DIR 8,1 4096 2 / 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-12T12:28:07.956 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-12T12:28:07.957 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 0,20 0 19 /sys/fs/selinux/status 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 1u unix 0x0000000000000000 0t0 10448 type=STREAM (CONNECTED) 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 2u unix 0x0000000000000000 0t0 10448 type=STREAM (CONNECTED) 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 3u unix 0x0000000000000000 0t0 10476 type=DGRAM (CONNECTED) 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 4u a_inode 0,15 0 50 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 5u a_inode 0,15 0 50 [signalfd] 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 6r a_inode 0,15 0 50 inotify 2024-09-12T12:28:07.958 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 7r DIR 0,26 0 3674 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 8u a_inode 0,15 0 50 [timerfd] 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 9u a_inode 0,15 0 50 [eventpoll:10,13] 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 10r REG 0,21 0 10465 /proc/4247/mountinfo 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 11r a_inode 0,15 0 50 inotify 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 12u unix 0x0000000000000000 0t0 10498 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 13r a_inode 0,15 0 50 inotify 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 14r REG 0,21 0 4026532070 /proc/swaps 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 15u netlink 0t0 10480 KOBJECT_UEVENT 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 16u unix 0x0000000000000000 0t0 10485 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 17u unix 0x0000000000000000 0t0 10486 type=DGRAM (CONNECTED) 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 18u unix 0x0000000000000000 0t0 10487 type=DGRAM (CONNECTED) 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 19u unix 0x0000000000000000 0t0 10488 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 20u unix 0x0000000000000000 0t0 10490 type=STREAM (CONNECTED) 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 4247 ubuntu 21u a_inode 0,15 0 50 [timerfd] 2024-09-12T12:28:07.959 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 4249 ubuntu cwd unknown /proc/4249/cwd (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 4249 ubuntu rtd unknown /proc/4249/root (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 4249 ubuntu txt unknown /proc/4249/exe (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 4249 ubuntu NOFD /proc/4249/fd (opendir: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 root cwd unknown /proc/4492/cwd (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 root rtd unknown /proc/4492/root (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 root txt unknown /proc/4492/exe (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 root NOFD /proc/4492/fd (opendir: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4494 in:imjour root cwd unknown /proc/4492/task/4494/cwd (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4494 in:imjour root rtd unknown /proc/4492/task/4494/root (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4494 in:imjour root txt unknown /proc/4492/task/4494/exe (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4494 in:imjour root NOFD /proc/4492/task/4494/fd (opendir: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4495 rs:main root cwd unknown /proc/4492/task/4495/cwd (readlink: Permission denied) 2024-09-12T12:28:07.960 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4495 rs:main root rtd unknown /proc/4492/task/4495/root (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4495 rs:main root txt unknown /proc/4492/task/4495/exe (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 4492 4495 rs:main root NOFD /proc/4492/task/4495/fd (opendir: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 polkitd cwd unknown /proc/18629/cwd (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 polkitd rtd unknown /proc/18629/root (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 polkitd txt unknown /proc/18629/exe (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 polkitd NOFD /proc/18629/fd (opendir: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18631 gmain polkitd cwd unknown /proc/18629/task/18631/cwd (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18631 gmain polkitd rtd unknown /proc/18629/task/18631/root (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18631 gmain polkitd txt unknown /proc/18629/task/18631/exe (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18631 gmain polkitd NOFD /proc/18629/task/18631/fd (opendir: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18632 gdbus polkitd cwd unknown /proc/18629/task/18632/cwd (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18632 gdbus polkitd rtd unknown /proc/18629/task/18632/root (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18632 gdbus polkitd txt unknown /proc/18629/task/18632/exe (readlink: Permission denied) 2024-09-12T12:28:07.961 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18632 gdbus polkitd NOFD /proc/18629/task/18632/fd (opendir: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18633 JS\x20Hel polkitd cwd unknown /proc/18629/task/18633/cwd (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18633 JS\x20Hel polkitd rtd unknown /proc/18629/task/18633/root (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18633 JS\x20Hel polkitd txt unknown /proc/18629/task/18633/exe (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18633 JS\x20Hel polkitd NOFD /proc/18629/task/18633/fd (opendir: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18634 JS\x20Hel polkitd cwd unknown /proc/18629/task/18634/cwd (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18634 JS\x20Hel polkitd rtd unknown /proc/18629/task/18634/root (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18634 JS\x20Hel polkitd txt unknown /proc/18629/task/18634/exe (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18634 JS\x20Hel polkitd NOFD /proc/18629/task/18634/fd (opendir: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18635 JS\x20Hel polkitd cwd unknown /proc/18629/task/18635/cwd (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18635 JS\x20Hel polkitd rtd unknown /proc/18629/task/18635/root (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18635 JS\x20Hel polkitd txt unknown /proc/18629/task/18635/exe (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18635 JS\x20Hel polkitd NOFD /proc/18629/task/18635/fd (opendir: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18636 JS\x20Hel polkitd cwd unknown /proc/18629/task/18636/cwd (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18636 JS\x20Hel polkitd rtd unknown /proc/18629/task/18636/root (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18636 JS\x20Hel polkitd txt unknown /proc/18629/task/18636/exe (readlink: Permission denied) 2024-09-12T12:28:07.962 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18636 JS\x20Hel polkitd NOFD /proc/18629/task/18636/fd (opendir: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18637 JS\x20Hel polkitd cwd unknown /proc/18629/task/18637/cwd (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18637 JS\x20Hel polkitd rtd unknown /proc/18629/task/18637/root (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18637 JS\x20Hel polkitd txt unknown /proc/18629/task/18637/exe (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18637 JS\x20Hel polkitd NOFD /proc/18629/task/18637/fd (opendir: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18638 JS\x20Hel polkitd cwd unknown /proc/18629/task/18638/cwd (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18638 JS\x20Hel polkitd rtd unknown /proc/18629/task/18638/root (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18638 JS\x20Hel polkitd txt unknown /proc/18629/task/18638/exe (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18638 JS\x20Hel polkitd NOFD /proc/18629/task/18638/fd (opendir: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18639 JS\x20Hel polkitd cwd unknown /proc/18629/task/18639/cwd (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18639 JS\x20Hel polkitd rtd unknown /proc/18629/task/18639/root (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18639 JS\x20Hel polkitd txt unknown /proc/18629/task/18639/exe (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18639 JS\x20Hel polkitd NOFD /proc/18629/task/18639/fd (opendir: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18640 JS\x20Hel polkitd cwd unknown /proc/18629/task/18640/cwd (readlink: Permission denied) 2024-09-12T12:28:07.963 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18640 JS\x20Hel polkitd rtd unknown /proc/18629/task/18640/root (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18640 JS\x20Hel polkitd txt unknown /proc/18629/task/18640/exe (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18640 JS\x20Hel polkitd NOFD /proc/18629/task/18640/fd (opendir: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18641 polkitd polkitd cwd unknown /proc/18629/task/18641/cwd (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18641 polkitd polkitd rtd unknown /proc/18629/task/18641/root (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18641 polkitd polkitd txt unknown /proc/18629/task/18641/exe (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 18629 18641 polkitd polkitd NOFD /proc/18629/task/18641/fd (opendir: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 20406 root cwd unknown /proc/20406/cwd (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 20406 root rtd unknown /proc/20406/root (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 20406 root txt unknown /proc/20406/exe (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 20406 root NOFD /proc/20406/fd (opendir: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20542 root cwd unknown /proc/20542/cwd (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20542 root rtd unknown /proc/20542/root (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20542 root txt unknown /proc/20542/exe (readlink: Permission denied) 2024-09-12T12:28:07.964 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20542 root NOFD /proc/20542/fd (opendir: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20572 root cwd unknown /proc/20572/cwd (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20572 root rtd unknown /proc/20572/root (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20572 root txt unknown /proc/20572/exe (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20572 root NOFD /proc/20572/fd (opendir: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20601 root cwd unknown /proc/20601/cwd (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20601 root rtd unknown /proc/20601/root (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20601 root txt unknown /proc/20601/exe (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20601 root NOFD /proc/20601/fd (opendir: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20630 root cwd unknown /proc/20630/cwd (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20630 root rtd unknown /proc/20630/root (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20630 root txt unknown /proc/20630/exe (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20630 root NOFD /proc/20630/fd (opendir: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20659 root cwd unknown /proc/20659/cwd (readlink: Permission denied) 2024-09-12T12:28:07.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20659 root rtd unknown /proc/20659/root (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20659 root txt unknown /proc/20659/exe (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20659 root NOFD /proc/20659/fd (opendir: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20823 root cwd unknown /proc/20823/cwd (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20823 root rtd unknown /proc/20823/root (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20823 root txt unknown /proc/20823/exe (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20823 root NOFD /proc/20823/fd (opendir: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20824 root cwd unknown /proc/20824/cwd (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20824 root rtd unknown /proc/20824/root (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20824 root txt unknown /proc/20824/exe (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20824 root NOFD /proc/20824/fd (opendir: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20825 root cwd unknown /proc/20825/cwd (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20825 root rtd unknown /proc/20825/root (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20825 root txt unknown /proc/20825/exe (readlink: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20825 root NOFD /proc/20825/fd (opendir: Permission denied) 2024-09-12T12:28:07.966 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20826 root cwd unknown /proc/20826/cwd (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20826 root rtd unknown /proc/20826/root (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20826 root txt unknown /proc/20826/exe (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20826 root NOFD /proc/20826/fd (opendir: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20827 root cwd unknown /proc/20827/cwd (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20827 root rtd unknown /proc/20827/root (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20827 root txt unknown /proc/20827/exe (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20827 root NOFD /proc/20827/fd (opendir: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20828 root cwd unknown /proc/20828/cwd (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20828 root rtd unknown /proc/20828/root (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20828 root txt unknown /proc/20828/exe (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20828 root NOFD /proc/20828/fd (opendir: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20829 root cwd unknown /proc/20829/cwd (readlink: Permission denied) 2024-09-12T12:28:07.967 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20829 root rtd unknown /proc/20829/root (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20829 root txt unknown /proc/20829/exe (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20829 root NOFD /proc/20829/fd (opendir: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20830 root cwd unknown /proc/20830/cwd (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20830 root rtd unknown /proc/20830/root (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20830 root txt unknown /proc/20830/exe (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20830 root NOFD /proc/20830/fd (opendir: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20831 root cwd unknown /proc/20831/cwd (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20831 root rtd unknown /proc/20831/root (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20831 root txt unknown /proc/20831/exe (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 20831 root NOFD /proc/20831/fd (opendir: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 20832 root cwd unknown /proc/20832/cwd (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 20832 root rtd unknown /proc/20832/root (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 20832 root txt unknown /proc/20832/exe (readlink: Permission denied) 2024-09-12T12:28:07.968 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 20832 root NOFD /proc/20832/fd (opendir: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21767 root cwd unknown /proc/21767/cwd (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21767 root rtd unknown /proc/21767/root (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21767 root txt unknown /proc/21767/exe (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21767 root NOFD /proc/21767/fd (opendir: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21770 ubuntu cwd unknown /proc/21770/cwd (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21770 ubuntu rtd unknown /proc/21770/root (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21770 ubuntu txt unknown /proc/21770/exe (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 21770 ubuntu NOFD /proc/21770/fd (opendir: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 21831 chrony cwd unknown /proc/21831/cwd (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 21831 chrony rtd unknown /proc/21831/root (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 21831 chrony txt unknown /proc/21831/exe (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 21831 chrony NOFD /proc/21831/fd (opendir: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 22165 ceph cwd unknown /proc/22165/cwd (readlink: Permission denied) 2024-09-12T12:28:07.969 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 22165 ceph rtd unknown /proc/22165/root (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 22165 ceph txt unknown /proc/22165/exe (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 22165 ceph NOFD /proc/22165/fd (opendir: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 23325 root cwd unknown /proc/23325/cwd (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 23325 root rtd unknown /proc/23325/root (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 23325 root txt unknown /proc/23325/exe (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 23325 root NOFD /proc/23325/fd (opendir: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23443 root cwd unknown /proc/23443/cwd (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23443 root rtd unknown /proc/23443/root (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23443 root txt unknown /proc/23443/exe (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23443 root NOFD /proc/23443/fd (opendir: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23603 root cwd unknown /proc/23603/cwd (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23603 root rtd unknown /proc/23603/root (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23603 root txt unknown /proc/23603/exe (readlink: Permission denied) 2024-09-12T12:28:07.970 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 23603 root NOFD /proc/23603/fd (opendir: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 23660 root cwd unknown /proc/23660/cwd (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 23660 root rtd unknown /proc/23660/root (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 23660 root txt unknown /proc/23660/exe (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 23660 root NOFD /proc/23660/fd (opendir: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24111 root cwd unknown /proc/24111/cwd (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24111 root rtd unknown /proc/24111/root (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24111 root txt unknown /proc/24111/exe (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24111 root NOFD /proc/24111/fd (opendir: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24113 root cwd unknown /proc/24113/cwd (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24113 root rtd unknown /proc/24113/root (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24113 root txt unknown /proc/24113/exe (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 24113 root NOFD /proc/24113/fd (opendir: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29818 root cwd unknown /proc/29818/cwd (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29818 root rtd unknown /proc/29818/root (readlink: Permission denied) 2024-09-12T12:28:07.971 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29818 root txt unknown /proc/29818/exe (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29818 root NOFD /proc/29818/fd (opendir: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29835 root cwd unknown /proc/29835/cwd (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29835 root rtd unknown /proc/29835/root (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29835 root txt unknown /proc/29835/exe (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 29835 root NOFD /proc/29835/fd (opendir: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29836 root cwd unknown /proc/29836/cwd (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29836 root rtd unknown /proc/29836/root (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29836 root txt unknown /proc/29836/exe (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29836 root NOFD /proc/29836/fd (opendir: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29854 root cwd unknown /proc/29854/cwd (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29854 root rtd unknown /proc/29854/root (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29854 root txt unknown /proc/29854/exe (readlink: Permission denied) 2024-09-12T12:28:07.972 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 29854 root NOFD /proc/29854/fd (opendir: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 30806 root cwd unknown /proc/30806/cwd (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 30806 root rtd unknown /proc/30806/root (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 30806 root txt unknown /proc/30806/exe (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 30806 root NOFD /proc/30806/fd (opendir: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 30808 root cwd unknown /proc/30808/cwd (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 30808 root rtd unknown /proc/30808/root (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 30808 root txt unknown /proc/30808/exe (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 30808 root NOFD /proc/30808/fd (opendir: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 ceph cwd unknown /proc/30810/cwd (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 ceph rtd unknown /proc/30810/root (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 ceph txt unknown /proc/30810/exe (readlink: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 ceph NOFD /proc/30810/fd (opendir: Permission denied) 2024-09-12T12:28:07.973 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30811 log ceph cwd unknown /proc/30810/task/30811/cwd (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30811 log ceph rtd unknown /proc/30810/task/30811/root (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30811 log ceph txt unknown /proc/30810/task/30811/exe (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30811 log ceph NOFD /proc/30810/task/30811/fd (opendir: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30812 service ceph cwd unknown /proc/30810/task/30812/cwd (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30812 service ceph rtd unknown /proc/30810/task/30812/root (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30812 service ceph txt unknown /proc/30810/task/30812/exe (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30812 service ceph NOFD /proc/30810/task/30812/fd (opendir: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30813 admin_soc ceph cwd unknown /proc/30810/task/30813/cwd (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30813 admin_soc ceph rtd unknown /proc/30810/task/30813/root (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30813 admin_soc ceph txt unknown /proc/30810/task/30813/exe (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30813 admin_soc ceph NOFD /proc/30810/task/30813/fd (opendir: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30814 signal_ha ceph cwd unknown /proc/30810/task/30814/cwd (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30814 signal_ha ceph rtd unknown /proc/30810/task/30814/root (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30814 signal_ha ceph txt unknown /proc/30810/task/30814/exe (readlink: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30814 signal_ha ceph NOFD /proc/30810/task/30814/fd (opendir: Permission denied) 2024-09-12T12:28:07.974 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30815 rocksdb:l ceph cwd unknown /proc/30810/task/30815/cwd (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30815 rocksdb:l ceph rtd unknown /proc/30810/task/30815/root (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30815 rocksdb:l ceph txt unknown /proc/30810/task/30815/exe (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30815 rocksdb:l ceph NOFD /proc/30810/task/30815/fd (opendir: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30816 rocksdb:h ceph cwd unknown /proc/30810/task/30816/cwd (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30816 rocksdb:h ceph rtd unknown /proc/30810/task/30816/root (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30816 rocksdb:h ceph txt unknown /proc/30810/task/30816/exe (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30816 rocksdb:h ceph NOFD /proc/30810/task/30816/fd (opendir: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30832 ceph-mon ceph cwd unknown /proc/30810/task/30832/cwd (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30832 ceph-mon ceph rtd unknown /proc/30810/task/30832/root (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30832 ceph-mon ceph txt unknown /proc/30810/task/30832/exe (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30832 ceph-mon ceph NOFD /proc/30810/task/30832/fd (opendir: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30833 fn_monsto ceph cwd unknown /proc/30810/task/30833/cwd (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30833 fn_monsto ceph rtd unknown /proc/30810/task/30833/root (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30833 fn_monsto ceph txt unknown /proc/30810/task/30833/exe (readlink: Permission denied) 2024-09-12T12:28:07.975 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30833 fn_monsto ceph NOFD /proc/30810/task/30833/fd (opendir: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30834 msgr-work ceph cwd unknown /proc/30810/task/30834/cwd (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30834 msgr-work ceph rtd unknown /proc/30810/task/30834/root (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30834 msgr-work ceph txt unknown /proc/30810/task/30834/exe (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30834 msgr-work ceph NOFD /proc/30810/task/30834/fd (opendir: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30835 msgr-work ceph cwd unknown /proc/30810/task/30835/cwd (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30835 msgr-work ceph rtd unknown /proc/30810/task/30835/root (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30835 msgr-work ceph txt unknown /proc/30810/task/30835/exe (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30835 msgr-work ceph NOFD /proc/30810/task/30835/fd (opendir: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30836 msgr-work ceph cwd unknown /proc/30810/task/30836/cwd (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30836 msgr-work ceph rtd unknown /proc/30810/task/30836/root (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30836 msgr-work ceph txt unknown /proc/30810/task/30836/exe (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30836 msgr-work ceph NOFD /proc/30810/task/30836/fd (opendir: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30837 OpHistory ceph cwd unknown /proc/30810/task/30837/cwd (readlink: Permission denied) 2024-09-12T12:28:07.976 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30837 OpHistory ceph rtd unknown /proc/30810/task/30837/root (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30837 OpHistory ceph txt unknown /proc/30810/task/30837/exe (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30837 OpHistory ceph NOFD /proc/30810/task/30837/fd (opendir: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30838 fin ceph cwd unknown /proc/30810/task/30838/cwd (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30838 fin ceph rtd unknown /proc/30810/task/30838/root (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30838 fin ceph txt unknown /proc/30810/task/30838/exe (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30838 fin ceph NOFD /proc/30810/task/30838/fd (opendir: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30839 safe_time ceph cwd unknown /proc/30810/task/30839/cwd (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30839 safe_time ceph rtd unknown /proc/30810/task/30839/root (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30839 safe_time ceph txt unknown /proc/30810/task/30839/exe (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30839 safe_time ceph NOFD /proc/30810/task/30839/fd (opendir: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30840 cpu_tp ceph cwd unknown /proc/30810/task/30840/cwd (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30840 cpu_tp ceph rtd unknown /proc/30810/task/30840/root (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30840 cpu_tp ceph txt unknown /proc/30810/task/30840/exe (readlink: Permission denied) 2024-09-12T12:28:07.977 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30840 cpu_tp ceph NOFD /proc/30810/task/30840/fd (opendir: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30841 cpu_tp ceph cwd unknown /proc/30810/task/30841/cwd (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30841 cpu_tp ceph rtd unknown /proc/30810/task/30841/root (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30841 cpu_tp ceph txt unknown /proc/30810/task/30841/exe (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30841 cpu_tp ceph NOFD /proc/30810/task/30841/fd (opendir: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30842 cpu_tp ceph cwd unknown /proc/30810/task/30842/cwd (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30842 cpu_tp ceph rtd unknown /proc/30810/task/30842/root (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30842 cpu_tp ceph txt unknown /proc/30810/task/30842/exe (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30842 cpu_tp ceph NOFD /proc/30810/task/30842/fd (opendir: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30843 cpu_tp ceph cwd unknown /proc/30810/task/30843/cwd (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30843 cpu_tp ceph rtd unknown /proc/30810/task/30843/root (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30843 cpu_tp ceph txt unknown /proc/30810/task/30843/exe (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30843 cpu_tp ceph NOFD /proc/30810/task/30843/fd (opendir: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30844 ms_dispat ceph cwd unknown /proc/30810/task/30844/cwd (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30844 ms_dispat ceph rtd unknown /proc/30810/task/30844/root (readlink: Permission denied) 2024-09-12T12:28:07.978 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30844 ms_dispat ceph txt unknown /proc/30810/task/30844/exe (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30844 ms_dispat ceph NOFD /proc/30810/task/30844/fd (opendir: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30845 ms_local ceph cwd unknown /proc/30810/task/30845/cwd (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30845 ms_local ceph rtd unknown /proc/30810/task/30845/root (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30845 ms_local ceph txt unknown /proc/30810/task/30845/exe (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30845 ms_local ceph NOFD /proc/30810/task/30845/fd (opendir: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30846 safe_time ceph cwd unknown /proc/30810/task/30846/cwd (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30846 safe_time ceph rtd unknown /proc/30810/task/30846/root (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30846 safe_time ceph txt unknown /proc/30810/task/30846/exe (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30846 safe_time ceph NOFD /proc/30810/task/30846/fd (opendir: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30847 ms_dispat ceph cwd unknown /proc/30810/task/30847/cwd (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30847 ms_dispat ceph rtd unknown /proc/30810/task/30847/root (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30847 ms_dispat ceph txt unknown /proc/30810/task/30847/exe (readlink: Permission denied) 2024-09-12T12:28:07.979 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30847 ms_dispat ceph NOFD /proc/30810/task/30847/fd (opendir: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30848 ms_local ceph cwd unknown /proc/30810/task/30848/cwd (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30848 ms_local ceph rtd unknown /proc/30810/task/30848/root (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30848 ms_local ceph txt unknown /proc/30810/task/30848/exe (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 30848 ms_local ceph NOFD /proc/30810/task/30848/fd (opendir: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 68476 rstore_co ceph cwd unknown /proc/30810/task/68476/cwd (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 68476 rstore_co ceph rtd unknown /proc/30810/task/68476/root (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 68476 rstore_co ceph txt unknown /proc/30810/task/68476/exe (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 30810 68476 rstore_co ceph NOFD /proc/30810/task/68476/fd (opendir: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 31034 root cwd unknown /proc/31034/cwd (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 31034 root rtd unknown /proc/31034/root (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 31034 root txt unknown /proc/31034/exe (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 31034 root NOFD /proc/31034/fd (opendir: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 31036 root cwd unknown /proc/31036/cwd (readlink: Permission denied) 2024-09-12T12:28:07.980 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 31036 root rtd unknown /proc/31036/root (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 31036 root txt unknown /proc/31036/exe (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 31036 root NOFD /proc/31036/fd (opendir: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 ceph cwd unknown /proc/31038/cwd (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 ceph rtd unknown /proc/31038/root (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 ceph txt unknown /proc/31038/exe (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 ceph NOFD /proc/31038/fd (opendir: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33364 log ceph cwd unknown /proc/31038/task/33364/cwd (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33364 log ceph rtd unknown /proc/31038/task/33364/root (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33364 log ceph txt unknown /proc/31038/task/33364/exe (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33364 log ceph NOFD /proc/31038/task/33364/fd (opendir: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33366 msgr-work ceph cwd unknown /proc/31038/task/33366/cwd (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33366 msgr-work ceph rtd unknown /proc/31038/task/33366/root (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33366 msgr-work ceph txt unknown /proc/31038/task/33366/exe (readlink: Permission denied) 2024-09-12T12:28:07.981 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33366 msgr-work ceph NOFD /proc/31038/task/33366/fd (opendir: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33367 msgr-work ceph cwd unknown /proc/31038/task/33367/cwd (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33367 msgr-work ceph rtd unknown /proc/31038/task/33367/root (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33367 msgr-work ceph txt unknown /proc/31038/task/33367/exe (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33367 msgr-work ceph NOFD /proc/31038/task/33367/fd (opendir: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33368 msgr-work ceph cwd unknown /proc/31038/task/33368/cwd (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33368 msgr-work ceph rtd unknown /proc/31038/task/33368/root (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33368 msgr-work ceph txt unknown /proc/31038/task/33368/exe (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33368 msgr-work ceph NOFD /proc/31038/task/33368/fd (opendir: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33372 service ceph cwd unknown /proc/31038/task/33372/cwd (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33372 service ceph rtd unknown /proc/31038/task/33372/root (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33372 service ceph txt unknown /proc/31038/task/33372/exe (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33372 service ceph NOFD /proc/31038/task/33372/fd (opendir: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33373 admin_soc ceph cwd unknown /proc/31038/task/33373/cwd (readlink: Permission denied) 2024-09-12T12:28:07.982 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33373 admin_soc ceph rtd unknown /proc/31038/task/33373/root (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33373 admin_soc ceph txt unknown /proc/31038/task/33373/exe (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33373 admin_soc ceph NOFD /proc/31038/task/33373/fd (opendir: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33374 ceph_time ceph cwd unknown /proc/31038/task/33374/cwd (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33374 ceph_time ceph rtd unknown /proc/31038/task/33374/root (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33374 ceph_time ceph txt unknown /proc/31038/task/33374/exe (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33374 ceph_time ceph NOFD /proc/31038/task/33374/fd (opendir: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33375 fn_anonym ceph cwd unknown /proc/31038/task/33375/cwd (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33375 fn_anonym ceph rtd unknown /proc/31038/task/33375/root (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33375 fn_anonym ceph txt unknown /proc/31038/task/33375/exe (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33375 fn_anonym ceph NOFD /proc/31038/task/33375/fd (opendir: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33376 signal_ha ceph cwd unknown /proc/31038/task/33376/cwd (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33376 signal_ha ceph rtd unknown /proc/31038/task/33376/root (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33376 signal_ha ceph txt unknown /proc/31038/task/33376/exe (readlink: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33376 signal_ha ceph NOFD /proc/31038/task/33376/fd (opendir: Permission denied) 2024-09-12T12:28:07.983 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33377 mgrsb-fin ceph cwd unknown /proc/31038/task/33377/cwd (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33377 mgrsb-fin ceph rtd unknown /proc/31038/task/33377/root (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33377 mgrsb-fin ceph txt unknown /proc/31038/task/33377/exe (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33377 mgrsb-fin ceph NOFD /proc/31038/task/33377/fd (opendir: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33378 ms_dispat ceph cwd unknown /proc/31038/task/33378/cwd (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33378 ms_dispat ceph rtd unknown /proc/31038/task/33378/root (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33378 ms_dispat ceph txt unknown /proc/31038/task/33378/exe (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33378 ms_dispat ceph NOFD /proc/31038/task/33378/fd (opendir: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33379 ms_local ceph cwd unknown /proc/31038/task/33379/cwd (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33379 ms_local ceph rtd unknown /proc/31038/task/33379/root (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33379 ms_local ceph txt unknown /proc/31038/task/33379/exe (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33379 ms_local ceph NOFD /proc/31038/task/33379/fd (opendir: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33380 io_contex ceph cwd unknown /proc/31038/task/33380/cwd (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33380 io_contex ceph rtd unknown /proc/31038/task/33380/root (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33380 io_contex ceph txt unknown /proc/31038/task/33380/exe (readlink: Permission denied) 2024-09-12T12:28:07.984 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33380 io_contex ceph NOFD /proc/31038/task/33380/fd (opendir: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33381 io_contex ceph cwd unknown /proc/31038/task/33381/cwd (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33381 io_contex ceph rtd unknown /proc/31038/task/33381/root (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33381 io_contex ceph txt unknown /proc/31038/task/33381/exe (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33381 io_contex ceph NOFD /proc/31038/task/33381/fd (opendir: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33382 safe_time ceph cwd unknown /proc/31038/task/33382/cwd (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33382 safe_time ceph rtd unknown /proc/31038/task/33382/root (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33382 safe_time ceph txt unknown /proc/31038/task/33382/exe (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33382 safe_time ceph NOFD /proc/31038/task/33382/fd (opendir: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33383 safe_time ceph cwd unknown /proc/31038/task/33383/cwd (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33383 safe_time ceph rtd unknown /proc/31038/task/33383/root (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33383 safe_time ceph txt unknown /proc/31038/task/33383/exe (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33383 safe_time ceph NOFD /proc/31038/task/33383/fd (opendir: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33384 safe_time ceph cwd unknown /proc/31038/task/33384/cwd (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33384 safe_time ceph rtd unknown /proc/31038/task/33384/root (readlink: Permission denied) 2024-09-12T12:28:07.985 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33384 safe_time ceph txt unknown /proc/31038/task/33384/exe (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33384 safe_time ceph NOFD /proc/31038/task/33384/fd (opendir: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33385 fn_anonym ceph cwd unknown /proc/31038/task/33385/cwd (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33385 fn_anonym ceph rtd unknown /proc/31038/task/33385/root (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33385 fn_anonym ceph txt unknown /proc/31038/task/33385/exe (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33385 fn_anonym ceph NOFD /proc/31038/task/33385/fd (opendir: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33386 flusher ceph cwd unknown /proc/31038/task/33386/cwd (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33386 flusher ceph rtd unknown /proc/31038/task/33386/root (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33386 flusher ceph txt unknown /proc/31038/task/33386/exe (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33386 flusher ceph NOFD /proc/31038/task/33386/fd (opendir: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33387 safe_time ceph cwd unknown /proc/31038/task/33387/cwd (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33387 safe_time ceph rtd unknown /proc/31038/task/33387/root (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33387 safe_time ceph txt unknown /proc/31038/task/33387/exe (readlink: Permission denied) 2024-09-12T12:28:07.986 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33387 safe_time ceph NOFD /proc/31038/task/33387/fd (opendir: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33495 OpHistory ceph cwd unknown /proc/31038/task/33495/cwd (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33495 OpHistory ceph rtd unknown /proc/31038/task/33495/root (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33495 OpHistory ceph txt unknown /proc/31038/task/33495/exe (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33495 OpHistory ceph NOFD /proc/31038/task/33495/fd (opendir: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33496 mgr-fin ceph cwd unknown /proc/31038/task/33496/cwd (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33496 mgr-fin ceph rtd unknown /proc/31038/task/33496/root (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33496 mgr-fin ceph txt unknown /proc/31038/task/33496/exe (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33496 mgr-fin ceph NOFD /proc/31038/task/33496/fd (opendir: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33497 ms_dispat ceph cwd unknown /proc/31038/task/33497/cwd (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33497 ms_dispat ceph rtd unknown /proc/31038/task/33497/root (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33497 ms_dispat ceph txt unknown /proc/31038/task/33497/exe (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33497 ms_dispat ceph NOFD /proc/31038/task/33497/fd (opendir: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33498 ms_local ceph cwd unknown /proc/31038/task/33498/cwd (readlink: Permission denied) 2024-09-12T12:28:07.987 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33498 ms_local ceph rtd unknown /proc/31038/task/33498/root (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33498 ms_local ceph txt unknown /proc/31038/task/33498/exe (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33498 ms_local ceph NOFD /proc/31038/task/33498/fd (opendir: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33499 safe_time ceph cwd unknown /proc/31038/task/33499/cwd (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33499 safe_time ceph rtd unknown /proc/31038/task/33499/root (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33499 safe_time ceph txt unknown /proc/31038/task/33499/exe (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33499 safe_time ceph NOFD /proc/31038/task/33499/fd (opendir: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33500 cmdfin ceph cwd unknown /proc/31038/task/33500/cwd (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33500 cmdfin ceph rtd unknown /proc/31038/task/33500/root (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33500 cmdfin ceph txt unknown /proc/31038/task/33500/exe (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33500 cmdfin ceph NOFD /proc/31038/task/33500/fd (opendir: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33504 io_contex ceph cwd unknown /proc/31038/task/33504/cwd (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33504 io_contex ceph rtd unknown /proc/31038/task/33504/root (readlink: Permission denied) 2024-09-12T12:28:07.988 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33504 io_contex ceph txt unknown /proc/31038/task/33504/exe (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33504 io_contex ceph NOFD /proc/31038/task/33504/fd (opendir: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33505 io_contex ceph cwd unknown /proc/31038/task/33505/cwd (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33505 io_contex ceph rtd unknown /proc/31038/task/33505/root (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33505 io_contex ceph txt unknown /proc/31038/task/33505/exe (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33505 io_contex ceph NOFD /proc/31038/task/33505/fd (opendir: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33506 ceph_time ceph cwd unknown /proc/31038/task/33506/cwd (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33506 ceph_time ceph rtd unknown /proc/31038/task/33506/root (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33506 ceph_time ceph txt unknown /proc/31038/task/33506/exe (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33506 ceph_time ceph NOFD /proc/31038/task/33506/fd (opendir: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33507 ms_dispat ceph cwd unknown /proc/31038/task/33507/cwd (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33507 ms_dispat ceph rtd unknown /proc/31038/task/33507/root (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33507 ms_dispat ceph txt unknown /proc/31038/task/33507/exe (readlink: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33507 ms_dispat ceph NOFD /proc/31038/task/33507/fd (opendir: Permission denied) 2024-09-12T12:28:07.989 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33508 ms_local ceph cwd unknown /proc/31038/task/33508/cwd (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33508 ms_local ceph rtd unknown /proc/31038/task/33508/root (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33508 ms_local ceph txt unknown /proc/31038/task/33508/exe (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33508 ms_local ceph NOFD /proc/31038/task/33508/fd (opendir: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33509 safe_time ceph cwd unknown /proc/31038/task/33509/cwd (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33509 safe_time ceph rtd unknown /proc/31038/task/33509/root (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33509 safe_time ceph txt unknown /proc/31038/task/33509/exe (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33509 safe_time ceph NOFD /proc/31038/task/33509/fd (opendir: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33510 safe_time ceph cwd unknown /proc/31038/task/33510/cwd (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33510 safe_time ceph rtd unknown /proc/31038/task/33510/root (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33510 safe_time ceph txt unknown /proc/31038/task/33510/exe (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33510 safe_time ceph NOFD /proc/31038/task/33510/fd (opendir: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33511 balancer ceph cwd unknown /proc/31038/task/33511/cwd (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33511 balancer ceph rtd unknown /proc/31038/task/33511/root (readlink: Permission denied) 2024-09-12T12:28:07.990 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33511 balancer ceph txt unknown /proc/31038/task/33511/exe (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33511 balancer ceph NOFD /proc/31038/task/33511/fd (opendir: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33512 m-fin-bal ceph cwd unknown /proc/31038/task/33512/cwd (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33512 m-fin-bal ceph rtd unknown /proc/31038/task/33512/root (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33512 m-fin-bal ceph txt unknown /proc/31038/task/33512/exe (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33512 m-fin-bal ceph NOFD /proc/31038/task/33512/fd (opendir: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33513 mgr-fin ceph cwd unknown /proc/31038/task/33513/cwd (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33513 mgr-fin ceph rtd unknown /proc/31038/task/33513/root (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33513 mgr-fin ceph txt unknown /proc/31038/task/33513/exe (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33513 mgr-fin ceph NOFD /proc/31038/task/33513/fd (opendir: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33514 mgr-fin ceph cwd unknown /proc/31038/task/33514/cwd (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33514 mgr-fin ceph rtd unknown /proc/31038/task/33514/root (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33514 mgr-fin ceph txt unknown /proc/31038/task/33514/exe (readlink: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33514 mgr-fin ceph NOFD /proc/31038/task/33514/fd (opendir: Permission denied) 2024-09-12T12:28:07.991 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33515 mgr-fin ceph cwd unknown /proc/31038/task/33515/cwd (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33515 mgr-fin ceph rtd unknown /proc/31038/task/33515/root (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33515 mgr-fin ceph txt unknown /proc/31038/task/33515/exe (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33515 mgr-fin ceph NOFD /proc/31038/task/33515/fd (opendir: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33516 mgr-fin ceph cwd unknown /proc/31038/task/33516/cwd (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33516 mgr-fin ceph rtd unknown /proc/31038/task/33516/root (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33516 mgr-fin ceph txt unknown /proc/31038/task/33516/exe (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33516 mgr-fin ceph NOFD /proc/31038/task/33516/fd (opendir: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33517 mgr-fin ceph cwd unknown /proc/31038/task/33517/cwd (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33517 mgr-fin ceph rtd unknown /proc/31038/task/33517/root (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33517 mgr-fin ceph txt unknown /proc/31038/task/33517/exe (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33517 mgr-fin ceph NOFD /proc/31038/task/33517/fd (opendir: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33518 mgr-fin ceph cwd unknown /proc/31038/task/33518/cwd (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33518 mgr-fin ceph rtd unknown /proc/31038/task/33518/root (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33518 mgr-fin ceph txt unknown /proc/31038/task/33518/exe (readlink: Permission denied) 2024-09-12T12:28:07.992 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33518 mgr-fin ceph NOFD /proc/31038/task/33518/fd (opendir: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33519 mgr-fin ceph cwd unknown /proc/31038/task/33519/cwd (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33519 mgr-fin ceph rtd unknown /proc/31038/task/33519/root (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33519 mgr-fin ceph txt unknown /proc/31038/task/33519/exe (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33519 mgr-fin ceph NOFD /proc/31038/task/33519/fd (opendir: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33520 mgr-fin ceph cwd unknown /proc/31038/task/33520/cwd (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33520 mgr-fin ceph rtd unknown /proc/31038/task/33520/root (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33520 mgr-fin ceph txt unknown /proc/31038/task/33520/exe (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33520 mgr-fin ceph NOFD /proc/31038/task/33520/fd (opendir: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33521 mgr-fin ceph cwd unknown /proc/31038/task/33521/cwd (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33521 mgr-fin ceph rtd unknown /proc/31038/task/33521/root (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33521 mgr-fin ceph txt unknown /proc/31038/task/33521/exe (readlink: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33521 mgr-fin ceph NOFD /proc/31038/task/33521/fd (opendir: Permission denied) 2024-09-12T12:28:07.993 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33522 mgr-fin ceph cwd unknown /proc/31038/task/33522/cwd (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33522 mgr-fin ceph rtd unknown /proc/31038/task/33522/root (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33522 mgr-fin ceph txt unknown /proc/31038/task/33522/exe (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33522 mgr-fin ceph NOFD /proc/31038/task/33522/fd (opendir: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33523 mgr-fin ceph cwd unknown /proc/31038/task/33523/cwd (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33523 mgr-fin ceph rtd unknown /proc/31038/task/33523/root (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33523 mgr-fin ceph txt unknown /proc/31038/task/33523/exe (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33523 mgr-fin ceph NOFD /proc/31038/task/33523/fd (opendir: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33524 mgr-fin ceph cwd unknown /proc/31038/task/33524/cwd (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33524 mgr-fin ceph rtd unknown /proc/31038/task/33524/root (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33524 mgr-fin ceph txt unknown /proc/31038/task/33524/exe (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33524 mgr-fin ceph NOFD /proc/31038/task/33524/fd (opendir: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33525 mgr-fin ceph cwd unknown /proc/31038/task/33525/cwd (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33525 mgr-fin ceph rtd unknown /proc/31038/task/33525/root (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33525 mgr-fin ceph txt unknown /proc/31038/task/33525/exe (readlink: Permission denied) 2024-09-12T12:28:07.994 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33525 mgr-fin ceph NOFD /proc/31038/task/33525/fd (opendir: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33526 mgr-fin ceph cwd unknown /proc/31038/task/33526/cwd (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33526 mgr-fin ceph rtd unknown /proc/31038/task/33526/root (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33526 mgr-fin ceph txt unknown /proc/31038/task/33526/exe (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33526 mgr-fin ceph NOFD /proc/31038/task/33526/fd (opendir: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33527 mgr-fin ceph cwd unknown /proc/31038/task/33527/cwd (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33527 mgr-fin ceph rtd unknown /proc/31038/task/33527/root (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33527 mgr-fin ceph txt unknown /proc/31038/task/33527/exe (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33527 mgr-fin ceph NOFD /proc/31038/task/33527/fd (opendir: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33528 cephadm ceph cwd unknown /proc/31038/task/33528/cwd (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33528 cephadm ceph rtd unknown /proc/31038/task/33528/root (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33528 cephadm ceph txt unknown /proc/31038/task/33528/exe (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33528 cephadm ceph NOFD /proc/31038/task/33528/fd (opendir: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33529 m-fin-cep ceph cwd unknown /proc/31038/task/33529/cwd (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33529 m-fin-cep ceph rtd unknown /proc/31038/task/33529/root (readlink: Permission denied) 2024-09-12T12:28:07.995 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33529 m-fin-cep ceph txt unknown /proc/31038/task/33529/exe (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33529 m-fin-cep ceph NOFD /proc/31038/task/33529/fd (opendir: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33530 mgr-fin ceph cwd unknown /proc/31038/task/33530/cwd (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33530 mgr-fin ceph rtd unknown /proc/31038/task/33530/root (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33530 mgr-fin ceph txt unknown /proc/31038/task/33530/exe (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33530 mgr-fin ceph NOFD /proc/31038/task/33530/fd (opendir: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33531 mgr-fin ceph cwd unknown /proc/31038/task/33531/cwd (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33531 mgr-fin ceph rtd unknown /proc/31038/task/33531/root (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33531 mgr-fin ceph txt unknown /proc/31038/task/33531/exe (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33531 mgr-fin ceph NOFD /proc/31038/task/33531/fd (opendir: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33532 mgr-fin ceph cwd unknown /proc/31038/task/33532/cwd (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33532 mgr-fin ceph rtd unknown /proc/31038/task/33532/root (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33532 mgr-fin ceph txt unknown /proc/31038/task/33532/exe (readlink: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33532 mgr-fin ceph NOFD /proc/31038/task/33532/fd (opendir: Permission denied) 2024-09-12T12:28:07.996 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33533 mgr-fin ceph cwd unknown /proc/31038/task/33533/cwd (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33533 mgr-fin ceph rtd unknown /proc/31038/task/33533/root (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33533 mgr-fin ceph txt unknown /proc/31038/task/33533/exe (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33533 mgr-fin ceph NOFD /proc/31038/task/33533/fd (opendir: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33534 mgr-fin ceph cwd unknown /proc/31038/task/33534/cwd (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33534 mgr-fin ceph rtd unknown /proc/31038/task/33534/root (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33534 mgr-fin ceph txt unknown /proc/31038/task/33534/exe (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33534 mgr-fin ceph NOFD /proc/31038/task/33534/fd (opendir: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33535 mgr-fin ceph cwd unknown /proc/31038/task/33535/cwd (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33535 mgr-fin ceph rtd unknown /proc/31038/task/33535/root (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33535 mgr-fin ceph txt unknown /proc/31038/task/33535/exe (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33535 mgr-fin ceph NOFD /proc/31038/task/33535/fd (opendir: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33536 crash ceph cwd unknown /proc/31038/task/33536/cwd (readlink: Permission denied) 2024-09-12T12:28:07.997 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33536 crash ceph rtd unknown /proc/31038/task/33536/root (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33536 crash ceph txt unknown /proc/31038/task/33536/exe (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33536 crash ceph NOFD /proc/31038/task/33536/fd (opendir: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33537 cephadm ceph cwd unknown /proc/31038/task/33537/cwd (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33537 cephadm ceph rtd unknown /proc/31038/task/33537/root (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33537 cephadm ceph txt unknown /proc/31038/task/33537/exe (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33537 cephadm ceph NOFD /proc/31038/task/33537/fd (opendir: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33538 m-fin-cra ceph cwd unknown /proc/31038/task/33538/cwd (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33538 m-fin-cra ceph rtd unknown /proc/31038/task/33538/root (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33538 m-fin-cra ceph txt unknown /proc/31038/task/33538/exe (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33538 m-fin-cra ceph NOFD /proc/31038/task/33538/fd (opendir: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33539 dashboard ceph cwd unknown /proc/31038/task/33539/cwd (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33539 dashboard ceph rtd unknown /proc/31038/task/33539/root (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33539 dashboard ceph txt unknown /proc/31038/task/33539/exe (readlink: Permission denied) 2024-09-12T12:28:07.998 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33539 dashboard ceph NOFD /proc/31038/task/33539/fd (opendir: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33540 mgr-fin ceph cwd unknown /proc/31038/task/33540/cwd (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33540 mgr-fin ceph rtd unknown /proc/31038/task/33540/root (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33540 mgr-fin ceph txt unknown /proc/31038/task/33540/exe (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33540 mgr-fin ceph NOFD /proc/31038/task/33540/fd (opendir: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33541 m-fin-das ceph cwd unknown /proc/31038/task/33541/cwd (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33541 m-fin-das ceph rtd unknown /proc/31038/task/33541/root (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33541 m-fin-das ceph txt unknown /proc/31038/task/33541/exe (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33541 m-fin-das ceph NOFD /proc/31038/task/33541/fd (opendir: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33542 mgr-fin ceph cwd unknown /proc/31038/task/33542/cwd (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33542 mgr-fin ceph rtd unknown /proc/31038/task/33542/root (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33542 mgr-fin ceph txt unknown /proc/31038/task/33542/exe (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33542 mgr-fin ceph NOFD /proc/31038/task/33542/fd (opendir: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33543 mgr-fin ceph cwd unknown /proc/31038/task/33543/cwd (readlink: Permission denied) 2024-09-12T12:28:07.999 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33543 mgr-fin ceph rtd unknown /proc/31038/task/33543/root (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33543 mgr-fin ceph txt unknown /proc/31038/task/33543/exe (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33543 mgr-fin ceph NOFD /proc/31038/task/33543/fd (opendir: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33544 mgr-fin ceph cwd unknown /proc/31038/task/33544/cwd (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33544 mgr-fin ceph rtd unknown /proc/31038/task/33544/root (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33544 mgr-fin ceph txt unknown /proc/31038/task/33544/exe (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33544 mgr-fin ceph NOFD /proc/31038/task/33544/fd (opendir: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33545 devicehea ceph cwd unknown /proc/31038/task/33545/cwd (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33545 devicehea ceph rtd unknown /proc/31038/task/33545/root (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33545 devicehea ceph txt unknown /proc/31038/task/33545/exe (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33545 devicehea ceph NOFD /proc/31038/task/33545/fd (opendir: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33546 mgr-fin ceph cwd unknown /proc/31038/task/33546/cwd (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33546 mgr-fin ceph rtd unknown /proc/31038/task/33546/root (readlink: Permission denied) 2024-09-12T12:28:08.000 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33546 mgr-fin ceph txt unknown /proc/31038/task/33546/exe (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33546 mgr-fin ceph NOFD /proc/31038/task/33546/fd (opendir: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33547 m-fin-dev ceph cwd unknown /proc/31038/task/33547/cwd (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33547 m-fin-dev ceph rtd unknown /proc/31038/task/33547/root (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33547 m-fin-dev ceph txt unknown /proc/31038/task/33547/exe (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33547 m-fin-dev ceph NOFD /proc/31038/task/33547/fd (opendir: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33549 m-fin-ios ceph cwd unknown /proc/31038/task/33549/cwd (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33549 m-fin-ios ceph rtd unknown /proc/31038/task/33549/root (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33549 m-fin-ios ceph txt unknown /proc/31038/task/33549/exe (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33549 m-fin-ios ceph NOFD /proc/31038/task/33549/fd (opendir: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33550 mgr-fin ceph cwd unknown /proc/31038/task/33550/cwd (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33550 mgr-fin ceph rtd unknown /proc/31038/task/33550/root (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33550 mgr-fin ceph txt unknown /proc/31038/task/33550/exe (readlink: Permission denied) 2024-09-12T12:28:08.001 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33550 mgr-fin ceph NOFD /proc/31038/task/33550/fd (opendir: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33552 mgr-fin ceph cwd unknown /proc/31038/task/33552/cwd (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33552 mgr-fin ceph rtd unknown /proc/31038/task/33552/root (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33552 mgr-fin ceph txt unknown /proc/31038/task/33552/exe (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33552 mgr-fin ceph NOFD /proc/31038/task/33552/fd (opendir: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33553 m-fin-nfs ceph cwd unknown /proc/31038/task/33553/cwd (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33553 m-fin-nfs ceph rtd unknown /proc/31038/task/33553/root (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33553 m-fin-nfs ceph txt unknown /proc/31038/task/33553/exe (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33553 m-fin-nfs ceph NOFD /proc/31038/task/33553/fd (opendir: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33555 m-fin-orc ceph cwd unknown /proc/31038/task/33555/cwd (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33555 m-fin-orc ceph rtd unknown /proc/31038/task/33555/root (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33555 m-fin-orc ceph txt unknown /proc/31038/task/33555/exe (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33555 m-fin-orc ceph NOFD /proc/31038/task/33555/fd (opendir: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33556 pg_autosc ceph cwd unknown /proc/31038/task/33556/cwd (readlink: Permission denied) 2024-09-12T12:28:08.002 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33556 pg_autosc ceph rtd unknown /proc/31038/task/33556/root (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33556 pg_autosc ceph txt unknown /proc/31038/task/33556/exe (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33556 pg_autosc ceph NOFD /proc/31038/task/33556/fd (opendir: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33557 m-fin-pg_ ceph cwd unknown /proc/31038/task/33557/cwd (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33557 m-fin-pg_ ceph rtd unknown /proc/31038/task/33557/root (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33557 m-fin-pg_ ceph txt unknown /proc/31038/task/33557/exe (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33557 m-fin-pg_ ceph NOFD /proc/31038/task/33557/fd (opendir: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33558 progress ceph cwd unknown /proc/31038/task/33558/cwd (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33558 progress ceph rtd unknown /proc/31038/task/33558/root (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33558 progress ceph txt unknown /proc/31038/task/33558/exe (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33558 progress ceph NOFD /proc/31038/task/33558/fd (opendir: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33559 m-fin-pro ceph cwd unknown /proc/31038/task/33559/cwd (readlink: Permission denied) 2024-09-12T12:28:08.003 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33559 m-fin-pro ceph rtd unknown /proc/31038/task/33559/root (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33559 m-fin-pro ceph txt unknown /proc/31038/task/33559/exe (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33559 m-fin-pro ceph NOFD /proc/31038/task/33559/fd (opendir: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33560 cephadm ceph cwd unknown /proc/31038/task/33560/cwd (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33560 cephadm ceph rtd unknown /proc/31038/task/33560/root (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33560 cephadm ceph txt unknown /proc/31038/task/33560/exe (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33560 cephadm ceph NOFD /proc/31038/task/33560/fd (opendir: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33564 io_contex ceph cwd unknown /proc/31038/task/33564/cwd (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33564 io_contex ceph rtd unknown /proc/31038/task/33564/root (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33564 io_contex ceph txt unknown /proc/31038/task/33564/exe (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33564 io_contex ceph NOFD /proc/31038/task/33564/fd (opendir: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33565 io_contex ceph cwd unknown /proc/31038/task/33565/cwd (readlink: Permission denied) 2024-09-12T12:28:08.004 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33565 io_contex ceph rtd unknown /proc/31038/task/33565/root (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33565 io_contex ceph txt unknown /proc/31038/task/33565/exe (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33565 io_contex ceph NOFD /proc/31038/task/33565/fd (opendir: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33566 ceph_time ceph cwd unknown /proc/31038/task/33566/cwd (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33566 ceph_time ceph rtd unknown /proc/31038/task/33566/root (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33566 ceph_time ceph txt unknown /proc/31038/task/33566/exe (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33566 ceph_time ceph NOFD /proc/31038/task/33566/fd (opendir: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33567 ms_dispat ceph cwd unknown /proc/31038/task/33567/cwd (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33567 ms_dispat ceph rtd unknown /proc/31038/task/33567/root (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33567 ms_dispat ceph txt unknown /proc/31038/task/33567/exe (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33567 ms_dispat ceph NOFD /proc/31038/task/33567/fd (opendir: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33568 ms_local ceph cwd unknown /proc/31038/task/33568/cwd (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33568 ms_local ceph rtd unknown /proc/31038/task/33568/root (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33568 ms_local ceph txt unknown /proc/31038/task/33568/exe (readlink: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33568 ms_local ceph NOFD /proc/31038/task/33568/fd (opendir: Permission denied) 2024-09-12T12:28:08.005 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33569 safe_time ceph cwd unknown /proc/31038/task/33569/cwd (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33569 safe_time ceph rtd unknown /proc/31038/task/33569/root (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33569 safe_time ceph txt unknown /proc/31038/task/33569/exe (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33569 safe_time ceph NOFD /proc/31038/task/33569/fd (opendir: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33570 safe_time ceph cwd unknown /proc/31038/task/33570/cwd (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33570 safe_time ceph rtd unknown /proc/31038/task/33570/root (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33570 safe_time ceph txt unknown /proc/31038/task/33570/exe (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33570 safe_time ceph NOFD /proc/31038/task/33570/fd (opendir: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33571 mgr-fin ceph cwd unknown /proc/31038/task/33571/cwd (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33571 mgr-fin ceph rtd unknown /proc/31038/task/33571/root (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33571 mgr-fin ceph txt unknown /proc/31038/task/33571/exe (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33571 mgr-fin ceph NOFD /proc/31038/task/33571/fd (opendir: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33573 m-fin-rbd ceph cwd unknown /proc/31038/task/33573/cwd (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33573 m-fin-rbd ceph rtd unknown /proc/31038/task/33573/root (readlink: Permission denied) 2024-09-12T12:28:08.006 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33573 m-fin-rbd ceph txt unknown /proc/31038/task/33573/exe (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33573 m-fin-rbd ceph NOFD /proc/31038/task/33573/fd (opendir: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33574 restful ceph cwd unknown /proc/31038/task/33574/cwd (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33574 restful ceph rtd unknown /proc/31038/task/33574/root (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33574 restful ceph txt unknown /proc/31038/task/33574/exe (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33574 restful ceph NOFD /proc/31038/task/33574/fd (opendir: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33575 m-fin-res ceph cwd unknown /proc/31038/task/33575/cwd (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33575 m-fin-res ceph rtd unknown /proc/31038/task/33575/root (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33575 m-fin-res ceph txt unknown /proc/31038/task/33575/exe (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33575 m-fin-res ceph NOFD /proc/31038/task/33575/fd (opendir: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33577 m-fin-sta ceph cwd unknown /proc/31038/task/33577/cwd (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33577 m-fin-sta ceph rtd unknown /proc/31038/task/33577/root (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33577 m-fin-sta ceph txt unknown /proc/31038/task/33577/exe (readlink: Permission denied) 2024-09-12T12:28:08.007 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33577 m-fin-sta ceph NOFD /proc/31038/task/33577/fd (opendir: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33578 mgr-fin ceph cwd unknown /proc/31038/task/33578/cwd (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33578 mgr-fin ceph rtd unknown /proc/31038/task/33578/root (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33578 mgr-fin ceph txt unknown /proc/31038/task/33578/exe (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33578 mgr-fin ceph NOFD /proc/31038/task/33578/fd (opendir: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33579 mgr-fin ceph cwd unknown /proc/31038/task/33579/cwd (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33579 mgr-fin ceph rtd unknown /proc/31038/task/33579/root (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33579 mgr-fin ceph txt unknown /proc/31038/task/33579/exe (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33579 mgr-fin ceph NOFD /proc/31038/task/33579/fd (opendir: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33580 telemetry ceph cwd unknown /proc/31038/task/33580/cwd (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33580 telemetry ceph rtd unknown /proc/31038/task/33580/root (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33580 telemetry ceph txt unknown /proc/31038/task/33580/exe (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33580 telemetry ceph NOFD /proc/31038/task/33580/fd (opendir: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33581 m-fin-tel ceph cwd unknown /proc/31038/task/33581/cwd (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33581 m-fin-tel ceph rtd unknown /proc/31038/task/33581/root (readlink: Permission denied) 2024-09-12T12:28:08.008 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33581 m-fin-tel ceph txt unknown /proc/31038/task/33581/exe (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33581 m-fin-tel ceph NOFD /proc/31038/task/33581/fd (opendir: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33582 mgr-fin ceph cwd unknown /proc/31038/task/33582/cwd (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33582 mgr-fin ceph rtd unknown /proc/31038/task/33582/root (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33582 mgr-fin ceph txt unknown /proc/31038/task/33582/exe (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33582 mgr-fin ceph NOFD /proc/31038/task/33582/fd (opendir: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33583 mgr-fin ceph cwd unknown /proc/31038/task/33583/cwd (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33583 mgr-fin ceph rtd unknown /proc/31038/task/33583/root (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33583 mgr-fin ceph txt unknown /proc/31038/task/33583/exe (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33583 mgr-fin ceph NOFD /proc/31038/task/33583/fd (opendir: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33585 mgr-fin ceph cwd unknown /proc/31038/task/33585/cwd (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33585 mgr-fin ceph rtd unknown /proc/31038/task/33585/root (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33585 mgr-fin ceph txt unknown /proc/31038/task/33585/exe (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33585 mgr-fin ceph NOFD /proc/31038/task/33585/fd (opendir: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33588 io_contex ceph cwd unknown /proc/31038/task/33588/cwd (readlink: Permission denied) 2024-09-12T12:28:08.009 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33588 io_contex ceph rtd unknown /proc/31038/task/33588/root (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33588 io_contex ceph txt unknown /proc/31038/task/33588/exe (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33588 io_contex ceph NOFD /proc/31038/task/33588/fd (opendir: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33589 io_contex ceph cwd unknown /proc/31038/task/33589/cwd (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33589 io_contex ceph rtd unknown /proc/31038/task/33589/root (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33589 io_contex ceph txt unknown /proc/31038/task/33589/exe (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33589 io_contex ceph NOFD /proc/31038/task/33589/fd (opendir: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33590 ceph_time ceph cwd unknown /proc/31038/task/33590/cwd (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33590 ceph_time ceph rtd unknown /proc/31038/task/33590/root (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33590 ceph_time ceph txt unknown /proc/31038/task/33590/exe (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33590 ceph_time ceph NOFD /proc/31038/task/33590/fd (opendir: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33591 ms_dispat ceph cwd unknown /proc/31038/task/33591/cwd (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33591 ms_dispat ceph rtd unknown /proc/31038/task/33591/root (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33591 ms_dispat ceph txt unknown /proc/31038/task/33591/exe (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33591 ms_dispat ceph NOFD /proc/31038/task/33591/fd (opendir: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33592 ms_local ceph cwd unknown /proc/31038/task/33592/cwd (readlink: Permission denied) 2024-09-12T12:28:08.010 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33592 ms_local ceph rtd unknown /proc/31038/task/33592/root (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33592 ms_local ceph txt unknown /proc/31038/task/33592/exe (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33592 ms_local ceph NOFD /proc/31038/task/33592/fd (opendir: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33593 safe_time ceph cwd unknown /proc/31038/task/33593/cwd (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33593 safe_time ceph rtd unknown /proc/31038/task/33593/root (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33593 safe_time ceph txt unknown /proc/31038/task/33593/exe (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33593 safe_time ceph NOFD /proc/31038/task/33593/fd (opendir: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33594 safe_time ceph cwd unknown /proc/31038/task/33594/cwd (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33594 safe_time ceph rtd unknown /proc/31038/task/33594/root (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33594 safe_time ceph txt unknown /proc/31038/task/33594/exe (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33594 safe_time ceph NOFD /proc/31038/task/33594/fd (opendir: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33595 mgr-fin ceph cwd unknown /proc/31038/task/33595/cwd (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33595 mgr-fin ceph rtd unknown /proc/31038/task/33595/root (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33595 mgr-fin ceph txt unknown /proc/31038/task/33595/exe (readlink: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33595 mgr-fin ceph NOFD /proc/31038/task/33595/fd (opendir: Permission denied) 2024-09-12T12:28:08.011 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33596 mgr-fin ceph cwd unknown /proc/31038/task/33596/cwd (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33596 mgr-fin ceph rtd unknown /proc/31038/task/33596/root (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33596 mgr-fin ceph txt unknown /proc/31038/task/33596/exe (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33596 mgr-fin ceph NOFD /proc/31038/task/33596/fd (opendir: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33597 mgr-fin ceph cwd unknown /proc/31038/task/33597/cwd (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33597 mgr-fin ceph rtd unknown /proc/31038/task/33597/root (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33597 mgr-fin ceph txt unknown /proc/31038/task/33597/exe (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33597 mgr-fin ceph NOFD /proc/31038/task/33597/fd (opendir: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33598 mgr-fin ceph cwd unknown /proc/31038/task/33598/cwd (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33598 mgr-fin ceph rtd unknown /proc/31038/task/33598/root (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33598 mgr-fin ceph txt unknown /proc/31038/task/33598/exe (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33598 mgr-fin ceph NOFD /proc/31038/task/33598/fd (opendir: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33599 mgr-fin ceph cwd unknown /proc/31038/task/33599/cwd (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33599 mgr-fin ceph rtd unknown /proc/31038/task/33599/root (readlink: Permission denied) 2024-09-12T12:28:08.012 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33599 mgr-fin ceph txt unknown /proc/31038/task/33599/exe (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33599 mgr-fin ceph NOFD /proc/31038/task/33599/fd (opendir: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33600 mgr-fin ceph cwd unknown /proc/31038/task/33600/cwd (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33600 mgr-fin ceph rtd unknown /proc/31038/task/33600/root (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33600 mgr-fin ceph txt unknown /proc/31038/task/33600/exe (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33600 mgr-fin ceph NOFD /proc/31038/task/33600/fd (opendir: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33601 mgr-fin ceph cwd unknown /proc/31038/task/33601/cwd (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33601 mgr-fin ceph rtd unknown /proc/31038/task/33601/root (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33601 mgr-fin ceph txt unknown /proc/31038/task/33601/exe (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33601 mgr-fin ceph NOFD /proc/31038/task/33601/fd (opendir: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33602 mgr-fin ceph cwd unknown /proc/31038/task/33602/cwd (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33602 mgr-fin ceph rtd unknown /proc/31038/task/33602/root (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33602 mgr-fin ceph txt unknown /proc/31038/task/33602/exe (readlink: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33602 mgr-fin ceph NOFD /proc/31038/task/33602/fd (opendir: Permission denied) 2024-09-12T12:28:08.013 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33603 mgr-fin ceph cwd unknown /proc/31038/task/33603/cwd (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33603 mgr-fin ceph rtd unknown /proc/31038/task/33603/root (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33603 mgr-fin ceph txt unknown /proc/31038/task/33603/exe (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33603 mgr-fin ceph NOFD /proc/31038/task/33603/fd (opendir: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33604 mgr-fin ceph cwd unknown /proc/31038/task/33604/cwd (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33604 mgr-fin ceph rtd unknown /proc/31038/task/33604/root (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33604 mgr-fin ceph txt unknown /proc/31038/task/33604/exe (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33604 mgr-fin ceph NOFD /proc/31038/task/33604/fd (opendir: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33605 mgr-fin ceph cwd unknown /proc/31038/task/33605/cwd (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33605 mgr-fin ceph rtd unknown /proc/31038/task/33605/root (readlink: Permission denied) 2024-09-12T12:28:08.014 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33605 mgr-fin ceph txt unknown /proc/31038/task/33605/exe (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33605 mgr-fin ceph NOFD /proc/31038/task/33605/fd (opendir: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33606 mgr-fin ceph cwd unknown /proc/31038/task/33606/cwd (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33606 mgr-fin ceph rtd unknown /proc/31038/task/33606/root (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33606 mgr-fin ceph txt unknown /proc/31038/task/33606/exe (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33606 mgr-fin ceph NOFD /proc/31038/task/33606/fd (opendir: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33608 m-fin-vol ceph cwd unknown /proc/31038/task/33608/cwd (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33608 m-fin-vol ceph rtd unknown /proc/31038/task/33608/root (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33608 m-fin-vol ceph txt unknown /proc/31038/task/33608/exe (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33608 m-fin-vol ceph NOFD /proc/31038/task/33608/fd (opendir: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33787 mgr-fin ceph cwd unknown /proc/31038/task/33787/cwd (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33787 mgr-fin ceph rtd unknown /proc/31038/task/33787/root (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33787 mgr-fin ceph txt unknown /proc/31038/task/33787/exe (readlink: Permission denied) 2024-09-12T12:28:08.015 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33787 mgr-fin ceph NOFD /proc/31038/task/33787/fd (opendir: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33788 mgr-fin ceph cwd unknown /proc/31038/task/33788/cwd (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33788 mgr-fin ceph rtd unknown /proc/31038/task/33788/root (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33788 mgr-fin ceph txt unknown /proc/31038/task/33788/exe (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33788 mgr-fin ceph NOFD /proc/31038/task/33788/fd (opendir: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33789 mgr-fin ceph cwd unknown /proc/31038/task/33789/cwd (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33789 mgr-fin ceph rtd unknown /proc/31038/task/33789/root (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33789 mgr-fin ceph txt unknown /proc/31038/task/33789/exe (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33789 mgr-fin ceph NOFD /proc/31038/task/33789/fd (opendir: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33790 mgr-fin ceph cwd unknown /proc/31038/task/33790/cwd (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33790 mgr-fin ceph rtd unknown /proc/31038/task/33790/root (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33790 mgr-fin ceph txt unknown /proc/31038/task/33790/exe (readlink: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33790 mgr-fin ceph NOFD /proc/31038/task/33790/fd (opendir: Permission denied) 2024-09-12T12:28:08.016 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33791 mgr-fin ceph cwd unknown /proc/31038/task/33791/cwd (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33791 mgr-fin ceph rtd unknown /proc/31038/task/33791/root (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33791 mgr-fin ceph txt unknown /proc/31038/task/33791/exe (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33791 mgr-fin ceph NOFD /proc/31038/task/33791/fd (opendir: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33792 mgr-fin ceph cwd unknown /proc/31038/task/33792/cwd (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33792 mgr-fin ceph rtd unknown /proc/31038/task/33792/root (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33792 mgr-fin ceph txt unknown /proc/31038/task/33792/exe (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33792 mgr-fin ceph NOFD /proc/31038/task/33792/fd (opendir: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33793 mgr-fin ceph cwd unknown /proc/31038/task/33793/cwd (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33793 mgr-fin ceph rtd unknown /proc/31038/task/33793/root (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33793 mgr-fin ceph txt unknown /proc/31038/task/33793/exe (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33793 mgr-fin ceph NOFD /proc/31038/task/33793/fd (opendir: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33794 mgr-fin ceph cwd unknown /proc/31038/task/33794/cwd (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33794 mgr-fin ceph rtd unknown /proc/31038/task/33794/root (readlink: Permission denied) 2024-09-12T12:28:08.017 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33794 mgr-fin ceph txt unknown /proc/31038/task/33794/exe (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33794 mgr-fin ceph NOFD /proc/31038/task/33794/fd (opendir: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33795 mgr-fin ceph cwd unknown /proc/31038/task/33795/cwd (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33795 mgr-fin ceph rtd unknown /proc/31038/task/33795/root (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33795 mgr-fin ceph txt unknown /proc/31038/task/33795/exe (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33795 mgr-fin ceph NOFD /proc/31038/task/33795/fd (opendir: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33796 mgr-fin ceph cwd unknown /proc/31038/task/33796/cwd (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33796 mgr-fin ceph rtd unknown /proc/31038/task/33796/root (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33796 mgr-fin ceph txt unknown /proc/31038/task/33796/exe (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33796 mgr-fin ceph NOFD /proc/31038/task/33796/fd (opendir: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33797 mgr-fin ceph cwd unknown /proc/31038/task/33797/cwd (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33797 mgr-fin ceph rtd unknown /proc/31038/task/33797/root (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33797 mgr-fin ceph txt unknown /proc/31038/task/33797/exe (readlink: Permission denied) 2024-09-12T12:28:08.018 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33797 mgr-fin ceph NOFD /proc/31038/task/33797/fd (opendir: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33820 mgr-fin ceph cwd unknown /proc/31038/task/33820/cwd (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33820 mgr-fin ceph rtd unknown /proc/31038/task/33820/root (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33820 mgr-fin ceph txt unknown /proc/31038/task/33820/exe (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33820 mgr-fin ceph NOFD /proc/31038/task/33820/fd (opendir: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33821 mgr-fin ceph cwd unknown /proc/31038/task/33821/cwd (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33821 mgr-fin ceph rtd unknown /proc/31038/task/33821/root (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33821 mgr-fin ceph txt unknown /proc/31038/task/33821/exe (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33821 mgr-fin ceph NOFD /proc/31038/task/33821/fd (opendir: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33822 mgr-fin ceph cwd unknown /proc/31038/task/33822/cwd (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33822 mgr-fin ceph rtd unknown /proc/31038/task/33822/root (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33822 mgr-fin ceph txt unknown /proc/31038/task/33822/exe (readlink: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33822 mgr-fin ceph NOFD /proc/31038/task/33822/fd (opendir: Permission denied) 2024-09-12T12:28:08.019 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33823 mgr-fin ceph cwd unknown /proc/31038/task/33823/cwd (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33823 mgr-fin ceph rtd unknown /proc/31038/task/33823/root (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33823 mgr-fin ceph txt unknown /proc/31038/task/33823/exe (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33823 mgr-fin ceph NOFD /proc/31038/task/33823/fd (opendir: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33824 mgr-fin ceph cwd unknown /proc/31038/task/33824/cwd (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33824 mgr-fin ceph rtd unknown /proc/31038/task/33824/root (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33824 mgr-fin ceph txt unknown /proc/31038/task/33824/exe (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33824 mgr-fin ceph NOFD /proc/31038/task/33824/fd (opendir: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33825 mgr-fin ceph cwd unknown /proc/31038/task/33825/cwd (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33825 mgr-fin ceph rtd unknown /proc/31038/task/33825/root (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33825 mgr-fin ceph txt unknown /proc/31038/task/33825/exe (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33825 mgr-fin ceph NOFD /proc/31038/task/33825/fd (opendir: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33826 mgr-fin ceph cwd unknown /proc/31038/task/33826/cwd (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33826 mgr-fin ceph rtd unknown /proc/31038/task/33826/root (readlink: Permission denied) 2024-09-12T12:28:08.020 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33826 mgr-fin ceph txt unknown /proc/31038/task/33826/exe (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33826 mgr-fin ceph NOFD /proc/31038/task/33826/fd (opendir: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33827 mgr-fin ceph cwd unknown /proc/31038/task/33827/cwd (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33827 mgr-fin ceph rtd unknown /proc/31038/task/33827/root (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33827 mgr-fin ceph txt unknown /proc/31038/task/33827/exe (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33827 mgr-fin ceph NOFD /proc/31038/task/33827/fd (opendir: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33828 mgr-fin ceph cwd unknown /proc/31038/task/33828/cwd (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33828 mgr-fin ceph rtd unknown /proc/31038/task/33828/root (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33828 mgr-fin ceph txt unknown /proc/31038/task/33828/exe (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33828 mgr-fin ceph NOFD /proc/31038/task/33828/fd (opendir: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33829 mgr-fin ceph cwd unknown /proc/31038/task/33829/cwd (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33829 mgr-fin ceph rtd unknown /proc/31038/task/33829/root (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33829 mgr-fin ceph txt unknown /proc/31038/task/33829/exe (readlink: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33829 mgr-fin ceph NOFD /proc/31038/task/33829/fd (opendir: Permission denied) 2024-09-12T12:28:08.021 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33830 mgr-fin ceph cwd unknown /proc/31038/task/33830/cwd (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33830 mgr-fin ceph rtd unknown /proc/31038/task/33830/root (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33830 mgr-fin ceph txt unknown /proc/31038/task/33830/exe (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 33830 mgr-fin ceph NOFD /proc/31038/task/33830/fd (opendir: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34248 dashboard ceph cwd unknown /proc/31038/task/34248/cwd (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34248 dashboard ceph rtd unknown /proc/31038/task/34248/root (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34248 dashboard ceph txt unknown /proc/31038/task/34248/exe (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34248 dashboard ceph NOFD /proc/31038/task/34248/fd (opendir: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34249 dashboard ceph cwd unknown /proc/31038/task/34249/cwd (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34249 dashboard ceph rtd unknown /proc/31038/task/34249/root (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34249 dashboard ceph txt unknown /proc/31038/task/34249/exe (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34249 dashboard ceph NOFD /proc/31038/task/34249/fd (opendir: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34250 dashboard ceph cwd unknown /proc/31038/task/34250/cwd (readlink: Permission denied) 2024-09-12T12:28:08.022 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34250 dashboard ceph rtd unknown /proc/31038/task/34250/root (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34250 dashboard ceph txt unknown /proc/31038/task/34250/exe (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34250 dashboard ceph NOFD /proc/31038/task/34250/fd (opendir: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34251 dashboard ceph cwd unknown /proc/31038/task/34251/cwd (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34251 dashboard ceph rtd unknown /proc/31038/task/34251/root (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34251 dashboard ceph txt unknown /proc/31038/task/34251/exe (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34251 dashboard ceph NOFD /proc/31038/task/34251/fd (opendir: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34252 dashboard ceph cwd unknown /proc/31038/task/34252/cwd (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34252 dashboard ceph rtd unknown /proc/31038/task/34252/root (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34252 dashboard ceph txt unknown /proc/31038/task/34252/exe (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34252 dashboard ceph NOFD /proc/31038/task/34252/fd (opendir: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34253 dashboard ceph cwd unknown /proc/31038/task/34253/cwd (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34253 dashboard ceph rtd unknown /proc/31038/task/34253/root (readlink: Permission denied) 2024-09-12T12:28:08.023 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34253 dashboard ceph txt unknown /proc/31038/task/34253/exe (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34253 dashboard ceph NOFD /proc/31038/task/34253/fd (opendir: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34254 dashboard ceph cwd unknown /proc/31038/task/34254/cwd (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34254 dashboard ceph rtd unknown /proc/31038/task/34254/root (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34254 dashboard ceph txt unknown /proc/31038/task/34254/exe (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34254 dashboard ceph NOFD /proc/31038/task/34254/fd (opendir: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34255 dashboard ceph cwd unknown /proc/31038/task/34255/cwd (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34255 dashboard ceph rtd unknown /proc/31038/task/34255/root (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34255 dashboard ceph txt unknown /proc/31038/task/34255/exe (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34255 dashboard ceph NOFD /proc/31038/task/34255/fd (opendir: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34256 dashboard ceph cwd unknown /proc/31038/task/34256/cwd (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34256 dashboard ceph rtd unknown /proc/31038/task/34256/root (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34256 dashboard ceph txt unknown /proc/31038/task/34256/exe (readlink: Permission denied) 2024-09-12T12:28:08.024 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34256 dashboard ceph NOFD /proc/31038/task/34256/fd (opendir: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34257 dashboard ceph cwd unknown /proc/31038/task/34257/cwd (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34257 dashboard ceph rtd unknown /proc/31038/task/34257/root (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34257 dashboard ceph txt unknown /proc/31038/task/34257/exe (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34257 dashboard ceph NOFD /proc/31038/task/34257/fd (opendir: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34258 dashboard ceph cwd unknown /proc/31038/task/34258/cwd (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34258 dashboard ceph rtd unknown /proc/31038/task/34258/root (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34258 dashboard ceph txt unknown /proc/31038/task/34258/exe (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34258 dashboard ceph NOFD /proc/31038/task/34258/fd (opendir: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34272 dashboard ceph cwd unknown /proc/31038/task/34272/cwd (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34272 dashboard ceph rtd unknown /proc/31038/task/34272/root (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34272 dashboard ceph txt unknown /proc/31038/task/34272/exe (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 34272 dashboard ceph NOFD /proc/31038/task/34272/fd (opendir: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49156 devicehea ceph cwd unknown /proc/31038/task/49156/cwd (readlink: Permission denied) 2024-09-12T12:28:08.025 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49156 devicehea ceph rtd unknown /proc/31038/task/49156/root (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49156 devicehea ceph txt unknown /proc/31038/task/49156/exe (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49156 devicehea ceph NOFD /proc/31038/task/49156/fd (opendir: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49166 io_contex ceph cwd unknown /proc/31038/task/49166/cwd (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49166 io_contex ceph rtd unknown /proc/31038/task/49166/root (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49166 io_contex ceph txt unknown /proc/31038/task/49166/exe (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49166 io_contex ceph NOFD /proc/31038/task/49166/fd (opendir: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49167 io_contex ceph cwd unknown /proc/31038/task/49167/cwd (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49167 io_contex ceph rtd unknown /proc/31038/task/49167/root (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49167 io_contex ceph txt unknown /proc/31038/task/49167/exe (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49167 io_contex ceph NOFD /proc/31038/task/49167/fd (opendir: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49168 ceph_time ceph cwd unknown /proc/31038/task/49168/cwd (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49168 ceph_time ceph rtd unknown /proc/31038/task/49168/root (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49168 ceph_time ceph txt unknown /proc/31038/task/49168/exe (readlink: Permission denied) 2024-09-12T12:28:08.026 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49168 ceph_time ceph NOFD /proc/31038/task/49168/fd (opendir: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49169 ms_dispat ceph cwd unknown /proc/31038/task/49169/cwd (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49169 ms_dispat ceph rtd unknown /proc/31038/task/49169/root (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49169 ms_dispat ceph txt unknown /proc/31038/task/49169/exe (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49169 ms_dispat ceph NOFD /proc/31038/task/49169/fd (opendir: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49170 ms_local ceph cwd unknown /proc/31038/task/49170/cwd (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49170 ms_local ceph rtd unknown /proc/31038/task/49170/root (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49170 ms_local ceph txt unknown /proc/31038/task/49170/exe (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49170 ms_local ceph NOFD /proc/31038/task/49170/fd (opendir: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49171 safe_time ceph cwd unknown /proc/31038/task/49171/cwd (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49171 safe_time ceph rtd unknown /proc/31038/task/49171/root (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49171 safe_time ceph txt unknown /proc/31038/task/49171/exe (readlink: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49171 safe_time ceph NOFD /proc/31038/task/49171/fd (opendir: Permission denied) 2024-09-12T12:28:08.027 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49172 safe_time ceph cwd unknown /proc/31038/task/49172/cwd (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49172 safe_time ceph rtd unknown /proc/31038/task/49172/root (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49172 safe_time ceph txt unknown /proc/31038/task/49172/exe (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 31038 49172 safe_time ceph NOFD /proc/31038/task/49172/fd (opendir: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 32000 root cwd unknown /proc/32000/cwd (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 32000 root rtd unknown /proc/32000/root (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 32000 root txt unknown /proc/32000/exe (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 32000 root NOFD /proc/32000/fd (opendir: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 32002 root cwd unknown /proc/32002/cwd (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 32002 root rtd unknown /proc/32002/root (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 32002 root txt unknown /proc/32002/exe (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 32002 root NOFD /proc/32002/fd (opendir: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33609 root cwd unknown /proc/33609/cwd (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33609 root rtd unknown /proc/33609/root (readlink: Permission denied) 2024-09-12T12:28:08.028 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33609 root txt unknown /proc/33609/exe (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33609 root NOFD /proc/33609/fd (opendir: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33612 root cwd unknown /proc/33612/cwd (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33612 root rtd unknown /proc/33612/root (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33612 root txt unknown /proc/33612/exe (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 33612 root NOFD /proc/33612/fd (opendir: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 42660 root cwd unknown /proc/42660/cwd (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 42660 root rtd unknown /proc/42660/root (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 42660 root txt unknown /proc/42660/exe (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 42660 root NOFD /proc/42660/fd (opendir: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 44794 root cwd unknown /proc/44794/cwd (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 44794 root rtd unknown /proc/44794/root (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 44794 root txt unknown /proc/44794/exe (readlink: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 44794 root NOFD /proc/44794/fd (opendir: Permission denied) 2024-09-12T12:28:08.029 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 44796 root cwd unknown /proc/44796/cwd (readlink: Permission denied) 2024-09-12T12:28:08.030 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 44796 root rtd unknown /proc/44796/root (readlink: Permission denied) 2024-09-12T12:28:08.030 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 44796 root txt unknown /proc/44796/exe (readlink: Permission denied) 2024-09-12T12:28:08.030 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 44796 root NOFD /proc/44796/fd (opendir: Permission denied) 2024-09-12T12:28:08.030 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 ceph cwd unknown /proc/44798/cwd (readlink: Permission denied) 2024-09-12T12:28:08.030 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 ceph rtd unknown /proc/44798/root (readlink: Permission denied) 2024-09-12T12:28:08.030 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 ceph txt unknown /proc/44798/exe (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 ceph NOFD /proc/44798/fd (opendir: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44799 log ceph cwd unknown /proc/44798/task/44799/cwd (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44799 log ceph rtd unknown /proc/44798/task/44799/root (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44799 log ceph txt unknown /proc/44798/task/44799/exe (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44799 log ceph NOFD /proc/44798/task/44799/fd (opendir: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44801 msgr-work ceph cwd unknown /proc/44798/task/44801/cwd (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44801 msgr-work ceph rtd unknown /proc/44798/task/44801/root (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44801 msgr-work ceph txt unknown /proc/44798/task/44801/exe (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44801 msgr-work ceph NOFD /proc/44798/task/44801/fd (opendir: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44802 msgr-work ceph cwd unknown /proc/44798/task/44802/cwd (readlink: Permission denied) 2024-09-12T12:28:08.032 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44802 msgr-work ceph rtd unknown /proc/44798/task/44802/root (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44802 msgr-work ceph txt unknown /proc/44798/task/44802/exe (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44802 msgr-work ceph NOFD /proc/44798/task/44802/fd (opendir: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44803 msgr-work ceph cwd unknown /proc/44798/task/44803/cwd (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44803 msgr-work ceph rtd unknown /proc/44798/task/44803/root (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44803 msgr-work ceph txt unknown /proc/44798/task/44803/exe (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44803 msgr-work ceph NOFD /proc/44798/task/44803/fd (opendir: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44807 service ceph cwd unknown /proc/44798/task/44807/cwd (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44807 service ceph rtd unknown /proc/44798/task/44807/root (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44807 service ceph txt unknown /proc/44798/task/44807/exe (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44807 service ceph NOFD /proc/44798/task/44807/fd (opendir: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44808 admin_soc ceph cwd unknown /proc/44798/task/44808/cwd (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44808 admin_soc ceph rtd unknown /proc/44798/task/44808/root (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44808 admin_soc ceph txt unknown /proc/44798/task/44808/exe (readlink: Permission denied) 2024-09-12T12:28:08.033 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 44808 admin_soc ceph NOFD /proc/44798/task/44808/fd (opendir: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45137 signal_ha ceph cwd unknown /proc/44798/task/45137/cwd (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45137 signal_ha ceph rtd unknown /proc/44798/task/45137/root (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45137 signal_ha ceph txt unknown /proc/44798/task/45137/exe (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45137 signal_ha ceph NOFD /proc/44798/task/45137/fd (opendir: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45138 io_contex ceph cwd unknown /proc/44798/task/45138/cwd (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45138 io_contex ceph rtd unknown /proc/44798/task/45138/root (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45138 io_contex ceph txt unknown /proc/44798/task/45138/exe (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45138 io_contex ceph NOFD /proc/44798/task/45138/fd (opendir: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45139 io_contex ceph cwd unknown /proc/44798/task/45139/cwd (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45139 io_contex ceph rtd unknown /proc/44798/task/45139/root (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45139 io_contex ceph txt unknown /proc/44798/task/45139/exe (readlink: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45139 io_contex ceph NOFD /proc/44798/task/45139/fd (opendir: Permission denied) 2024-09-12T12:28:08.034 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45146 OpHistory ceph cwd unknown /proc/44798/task/45146/cwd (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45146 OpHistory ceph rtd unknown /proc/44798/task/45146/root (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45146 OpHistory ceph txt unknown /proc/44798/task/45146/exe (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45146 OpHistory ceph NOFD /proc/44798/task/45146/fd (opendir: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45147 ceph_time ceph cwd unknown /proc/44798/task/45147/cwd (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45147 ceph_time ceph rtd unknown /proc/44798/task/45147/root (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45147 ceph_time ceph txt unknown /proc/44798/task/45147/exe (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45147 ceph_time ceph NOFD /proc/44798/task/45147/fd (opendir: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45319 ceph-osd ceph cwd unknown /proc/44798/task/45319/cwd (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45319 ceph-osd ceph rtd unknown /proc/44798/task/45319/root (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45319 ceph-osd ceph txt unknown /proc/44798/task/45319/exe (readlink: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45319 ceph-osd ceph NOFD /proc/44798/task/45319/fd (opendir: Permission denied) 2024-09-12T12:28:08.035 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45320 safe_time ceph cwd unknown /proc/44798/task/45320/cwd (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45320 safe_time ceph rtd unknown /proc/44798/task/45320/root (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45320 safe_time ceph txt unknown /proc/44798/task/45320/exe (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45320 safe_time ceph NOFD /proc/44798/task/45320/fd (opendir: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45321 safe_time ceph cwd unknown /proc/44798/task/45321/cwd (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45321 safe_time ceph rtd unknown /proc/44798/task/45321/root (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45321 safe_time ceph txt unknown /proc/44798/task/45321/exe (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45321 safe_time ceph NOFD /proc/44798/task/45321/fd (opendir: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45322 safe_time ceph cwd unknown /proc/44798/task/45322/cwd (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45322 safe_time ceph rtd unknown /proc/44798/task/45322/root (readlink: Permission denied) 2024-09-12T12:28:08.036 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45322 safe_time ceph txt unknown /proc/44798/task/45322/exe (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45322 safe_time ceph NOFD /proc/44798/task/45322/fd (opendir: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45323 safe_time ceph cwd unknown /proc/44798/task/45323/cwd (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45323 safe_time ceph rtd unknown /proc/44798/task/45323/root (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45323 safe_time ceph txt unknown /proc/44798/task/45323/exe (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45323 safe_time ceph NOFD /proc/44798/task/45323/fd (opendir: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45324 fn_anonym ceph cwd unknown /proc/44798/task/45324/cwd (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45324 fn_anonym ceph rtd unknown /proc/44798/task/45324/root (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45324 fn_anonym ceph txt unknown /proc/44798/task/45324/exe (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45324 fn_anonym ceph NOFD /proc/44798/task/45324/fd (opendir: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45419 rocksdb:l ceph cwd unknown /proc/44798/task/45419/cwd (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45419 rocksdb:l ceph rtd unknown /proc/44798/task/45419/root (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45419 rocksdb:l ceph txt unknown /proc/44798/task/45419/exe (readlink: Permission denied) 2024-09-12T12:28:08.037 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45419 rocksdb:l ceph NOFD /proc/44798/task/45419/fd (opendir: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45420 rocksdb:l ceph cwd unknown /proc/44798/task/45420/cwd (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45420 rocksdb:l ceph rtd unknown /proc/44798/task/45420/root (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45420 rocksdb:l ceph txt unknown /proc/44798/task/45420/exe (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45420 rocksdb:l ceph NOFD /proc/44798/task/45420/fd (opendir: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45421 rocksdb:l ceph cwd unknown /proc/44798/task/45421/cwd (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45421 rocksdb:l ceph rtd unknown /proc/44798/task/45421/root (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45421 rocksdb:l ceph txt unknown /proc/44798/task/45421/exe (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45421 rocksdb:l ceph NOFD /proc/44798/task/45421/fd (opendir: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45422 rocksdb:h ceph cwd unknown /proc/44798/task/45422/cwd (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45422 rocksdb:h ceph rtd unknown /proc/44798/task/45422/root (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45422 rocksdb:h ceph txt unknown /proc/44798/task/45422/exe (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45422 rocksdb:h ceph NOFD /proc/44798/task/45422/fd (opendir: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45883 bstore_ai ceph cwd unknown /proc/44798/task/45883/cwd (readlink: Permission denied) 2024-09-12T12:28:08.038 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45883 bstore_ai ceph rtd unknown /proc/44798/task/45883/root (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45883 bstore_ai ceph txt unknown /proc/44798/task/45883/exe (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 45883 bstore_ai ceph NOFD /proc/44798/task/45883/fd (opendir: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46067 bstore_ai ceph cwd unknown /proc/44798/task/46067/cwd (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46067 bstore_ai ceph rtd unknown /proc/44798/task/46067/root (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46067 bstore_ai ceph txt unknown /proc/44798/task/46067/exe (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46067 bstore_ai ceph NOFD /proc/44798/task/46067/fd (opendir: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46250 ceph-osd ceph cwd unknown /proc/44798/task/46250/cwd (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46250 ceph-osd ceph rtd unknown /proc/44798/task/46250/root (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46250 ceph-osd ceph txt unknown /proc/44798/task/46250/exe (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46250 ceph-osd ceph NOFD /proc/44798/task/46250/fd (opendir: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46251 cfin ceph cwd unknown /proc/44798/task/46251/cwd (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46251 cfin ceph rtd unknown /proc/44798/task/46251/root (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46251 cfin ceph txt unknown /proc/44798/task/46251/exe (readlink: Permission denied) 2024-09-12T12:28:08.039 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46251 cfin ceph NOFD /proc/44798/task/46251/fd (opendir: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46252 bstore_kv ceph cwd unknown /proc/44798/task/46252/cwd (readlink: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46252 bstore_kv ceph rtd unknown /proc/44798/task/46252/root (readlink: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46252 bstore_kv ceph txt unknown /proc/44798/task/46252/exe (readlink: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46252 bstore_kv ceph NOFD /proc/44798/task/46252/fd (opendir: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46253 bstore_kv ceph cwd unknown /proc/44798/task/46253/cwd (readlink: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46253 bstore_kv ceph rtd unknown /proc/44798/task/46253/root (readlink: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46253 bstore_kv ceph txt unknown /proc/44798/task/46253/exe (readlink: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46253 bstore_kv ceph NOFD /proc/44798/task/46253/fd (opendir: Permission denied) 2024-09-12T12:28:08.040 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46254 bstore_me ceph cwd unknown /proc/44798/task/46254/cwd (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46254 bstore_me ceph rtd unknown /proc/44798/task/46254/root (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46254 bstore_me ceph txt unknown /proc/44798/task/46254/exe (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46254 bstore_me ceph NOFD /proc/44798/task/46254/fd (opendir: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46255 ms_dispat ceph cwd unknown /proc/44798/task/46255/cwd (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46255 ms_dispat ceph rtd unknown /proc/44798/task/46255/root (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46255 ms_dispat ceph txt unknown /proc/44798/task/46255/exe (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46255 ms_dispat ceph NOFD /proc/44798/task/46255/fd (opendir: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46256 ms_local ceph cwd unknown /proc/44798/task/46256/cwd (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46256 ms_local ceph rtd unknown /proc/44798/task/46256/root (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46256 ms_local ceph txt unknown /proc/44798/task/46256/exe (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46256 ms_local ceph NOFD /proc/44798/task/46256/fd (opendir: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46257 safe_time ceph cwd unknown /proc/44798/task/46257/cwd (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46257 safe_time ceph rtd unknown /proc/44798/task/46257/root (readlink: Permission denied) 2024-09-12T12:28:08.041 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46257 safe_time ceph txt unknown /proc/44798/task/46257/exe (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46257 safe_time ceph NOFD /proc/44798/task/46257/fd (opendir: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46258 safe_time ceph cwd unknown /proc/44798/task/46258/cwd (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46258 safe_time ceph rtd unknown /proc/44798/task/46258/root (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46258 safe_time ceph txt unknown /proc/44798/task/46258/exe (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46258 safe_time ceph NOFD /proc/44798/task/46258/fd (opendir: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46259 ms_dispat ceph cwd unknown /proc/44798/task/46259/cwd (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46259 ms_dispat ceph rtd unknown /proc/44798/task/46259/root (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46259 ms_dispat ceph txt unknown /proc/44798/task/46259/exe (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46259 ms_dispat ceph NOFD /proc/44798/task/46259/fd (opendir: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46260 ms_local ceph cwd unknown /proc/44798/task/46260/cwd (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46260 ms_local ceph rtd unknown /proc/44798/task/46260/root (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46260 ms_local ceph txt unknown /proc/44798/task/46260/exe (readlink: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46260 ms_local ceph NOFD /proc/44798/task/46260/fd (opendir: Permission denied) 2024-09-12T12:28:08.042 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46261 ms_dispat ceph cwd unknown /proc/44798/task/46261/cwd (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46261 ms_dispat ceph rtd unknown /proc/44798/task/46261/root (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46261 ms_dispat ceph txt unknown /proc/44798/task/46261/exe (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46261 ms_dispat ceph NOFD /proc/44798/task/46261/fd (opendir: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46262 ms_local ceph cwd unknown /proc/44798/task/46262/cwd (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46262 ms_local ceph rtd unknown /proc/44798/task/46262/root (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46262 ms_local ceph txt unknown /proc/44798/task/46262/exe (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46262 ms_local ceph NOFD /proc/44798/task/46262/fd (opendir: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46263 ms_dispat ceph cwd unknown /proc/44798/task/46263/cwd (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46263 ms_dispat ceph rtd unknown /proc/44798/task/46263/root (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46263 ms_dispat ceph txt unknown /proc/44798/task/46263/exe (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46263 ms_dispat ceph NOFD /proc/44798/task/46263/fd (opendir: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46264 ms_local ceph cwd unknown /proc/44798/task/46264/cwd (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46264 ms_local ceph rtd unknown /proc/44798/task/46264/root (readlink: Permission denied) 2024-09-12T12:28:08.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46264 ms_local ceph txt unknown /proc/44798/task/46264/exe (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46264 ms_local ceph NOFD /proc/44798/task/46264/fd (opendir: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46265 ms_dispat ceph cwd unknown /proc/44798/task/46265/cwd (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46265 ms_dispat ceph rtd unknown /proc/44798/task/46265/root (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46265 ms_dispat ceph txt unknown /proc/44798/task/46265/exe (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46265 ms_dispat ceph NOFD /proc/44798/task/46265/fd (opendir: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46266 ms_local ceph cwd unknown /proc/44798/task/46266/cwd (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46266 ms_local ceph rtd unknown /proc/44798/task/46266/root (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46266 ms_local ceph txt unknown /proc/44798/task/46266/exe (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46266 ms_local ceph NOFD /proc/44798/task/46266/fd (opendir: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46267 ms_dispat ceph cwd unknown /proc/44798/task/46267/cwd (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46267 ms_dispat ceph rtd unknown /proc/44798/task/46267/root (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46267 ms_dispat ceph txt unknown /proc/44798/task/46267/exe (readlink: Permission denied) 2024-09-12T12:28:08.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46267 ms_dispat ceph NOFD /proc/44798/task/46267/fd (opendir: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46268 ms_local ceph cwd unknown /proc/44798/task/46268/cwd (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46268 ms_local ceph rtd unknown /proc/44798/task/46268/root (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46268 ms_local ceph txt unknown /proc/44798/task/46268/exe (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46268 ms_local ceph NOFD /proc/44798/task/46268/fd (opendir: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46269 ms_dispat ceph cwd unknown /proc/44798/task/46269/cwd (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46269 ms_dispat ceph rtd unknown /proc/44798/task/46269/root (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46269 ms_dispat ceph txt unknown /proc/44798/task/46269/exe (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46269 ms_dispat ceph NOFD /proc/44798/task/46269/fd (opendir: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46270 ms_local ceph cwd unknown /proc/44798/task/46270/cwd (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46270 ms_local ceph rtd unknown /proc/44798/task/46270/root (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46270 ms_local ceph txt unknown /proc/44798/task/46270/exe (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46270 ms_local ceph NOFD /proc/44798/task/46270/fd (opendir: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46271 fn_anonym ceph cwd unknown /proc/44798/task/46271/cwd (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46271 fn_anonym ceph rtd unknown /proc/44798/task/46271/root (readlink: Permission denied) 2024-09-12T12:28:08.045 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46271 fn_anonym ceph txt unknown /proc/44798/task/46271/exe (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46271 fn_anonym ceph NOFD /proc/44798/task/46271/fd (opendir: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46272 finisher ceph cwd unknown /proc/44798/task/46272/cwd (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46272 finisher ceph rtd unknown /proc/44798/task/46272/root (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46272 finisher ceph txt unknown /proc/44798/task/46272/exe (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46272 finisher ceph NOFD /proc/44798/task/46272/fd (opendir: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46273 safe_time ceph cwd unknown /proc/44798/task/46273/cwd (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46273 safe_time ceph rtd unknown /proc/44798/task/46273/root (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46273 safe_time ceph txt unknown /proc/44798/task/46273/exe (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46273 safe_time ceph NOFD /proc/44798/task/46273/fd (opendir: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46274 safe_time ceph cwd unknown /proc/44798/task/46274/cwd (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46274 safe_time ceph rtd unknown /proc/44798/task/46274/root (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46274 safe_time ceph txt unknown /proc/44798/task/46274/exe (readlink: Permission denied) 2024-09-12T12:28:08.046 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46274 safe_time ceph NOFD /proc/44798/task/46274/fd (opendir: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46275 ceph-osd ceph cwd unknown /proc/44798/task/46275/cwd (readlink: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46275 ceph-osd ceph rtd unknown /proc/44798/task/46275/root (readlink: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46275 ceph-osd ceph txt unknown /proc/44798/task/46275/exe (readlink: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46275 ceph-osd ceph NOFD /proc/44798/task/46275/fd (opendir: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46276 osd_srv_a ceph cwd unknown /proc/44798/task/46276/cwd (readlink: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46276 osd_srv_a ceph rtd unknown /proc/44798/task/46276/root (readlink: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46276 osd_srv_a ceph txt unknown /proc/44798/task/46276/exe (readlink: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46276 osd_srv_a ceph NOFD /proc/44798/task/46276/fd (opendir: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46277 tp_osd_tp ceph cwd unknown /proc/44798/task/46277/cwd (readlink: Permission denied) 2024-09-12T12:28:08.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46277 tp_osd_tp ceph rtd unknown /proc/44798/task/46277/root (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46277 tp_osd_tp ceph txt unknown /proc/44798/task/46277/exe (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46277 tp_osd_tp ceph NOFD /proc/44798/task/46277/fd (opendir: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46278 tp_osd_tp ceph cwd unknown /proc/44798/task/46278/cwd (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46278 tp_osd_tp ceph rtd unknown /proc/44798/task/46278/root (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46278 tp_osd_tp ceph txt unknown /proc/44798/task/46278/exe (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46278 tp_osd_tp ceph NOFD /proc/44798/task/46278/fd (opendir: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46279 tp_osd_tp ceph cwd unknown /proc/44798/task/46279/cwd (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46279 tp_osd_tp ceph rtd unknown /proc/44798/task/46279/root (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46279 tp_osd_tp ceph txt unknown /proc/44798/task/46279/exe (readlink: Permission denied) 2024-09-12T12:28:08.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46279 tp_osd_tp ceph NOFD /proc/44798/task/46279/fd (opendir: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46280 tp_osd_tp ceph cwd unknown /proc/44798/task/46280/cwd (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46280 tp_osd_tp ceph rtd unknown /proc/44798/task/46280/root (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46280 tp_osd_tp ceph txt unknown /proc/44798/task/46280/exe (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46280 tp_osd_tp ceph NOFD /proc/44798/task/46280/fd (opendir: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46281 tp_osd_tp ceph cwd unknown /proc/44798/task/46281/cwd (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46281 tp_osd_tp ceph rtd unknown /proc/44798/task/46281/root (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46281 tp_osd_tp ceph txt unknown /proc/44798/task/46281/exe (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46281 tp_osd_tp ceph NOFD /proc/44798/task/46281/fd (opendir: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46282 tp_osd_tp ceph cwd unknown /proc/44798/task/46282/cwd (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46282 tp_osd_tp ceph rtd unknown /proc/44798/task/46282/root (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46282 tp_osd_tp ceph txt unknown /proc/44798/task/46282/exe (readlink: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46282 tp_osd_tp ceph NOFD /proc/44798/task/46282/fd (opendir: Permission denied) 2024-09-12T12:28:08.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46283 tp_osd_tp ceph cwd unknown /proc/44798/task/46283/cwd (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46283 tp_osd_tp ceph rtd unknown /proc/44798/task/46283/root (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46283 tp_osd_tp ceph txt unknown /proc/44798/task/46283/exe (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46283 tp_osd_tp ceph NOFD /proc/44798/task/46283/fd (opendir: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46284 tp_osd_tp ceph cwd unknown /proc/44798/task/46284/cwd (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46284 tp_osd_tp ceph rtd unknown /proc/44798/task/46284/root (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46284 tp_osd_tp ceph txt unknown /proc/44798/task/46284/exe (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46284 tp_osd_tp ceph NOFD /proc/44798/task/46284/fd (opendir: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46285 tp_osd_tp ceph cwd unknown /proc/44798/task/46285/cwd (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46285 tp_osd_tp ceph rtd unknown /proc/44798/task/46285/root (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46285 tp_osd_tp ceph txt unknown /proc/44798/task/46285/exe (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46285 tp_osd_tp ceph NOFD /proc/44798/task/46285/fd (opendir: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46286 tp_osd_tp ceph cwd unknown /proc/44798/task/46286/cwd (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46286 tp_osd_tp ceph rtd unknown /proc/44798/task/46286/root (readlink: Permission denied) 2024-09-12T12:28:08.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46286 tp_osd_tp ceph txt unknown /proc/44798/task/46286/exe (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46286 tp_osd_tp ceph NOFD /proc/44798/task/46286/fd (opendir: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46287 tp_osd_tp ceph cwd unknown /proc/44798/task/46287/cwd (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46287 tp_osd_tp ceph rtd unknown /proc/44798/task/46287/root (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46287 tp_osd_tp ceph txt unknown /proc/44798/task/46287/exe (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46287 tp_osd_tp ceph NOFD /proc/44798/task/46287/fd (opendir: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46288 tp_osd_tp ceph cwd unknown /proc/44798/task/46288/cwd (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46288 tp_osd_tp ceph rtd unknown /proc/44798/task/46288/root (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46288 tp_osd_tp ceph txt unknown /proc/44798/task/46288/exe (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46288 tp_osd_tp ceph NOFD /proc/44798/task/46288/fd (opendir: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46289 tp_osd_tp ceph cwd unknown /proc/44798/task/46289/cwd (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46289 tp_osd_tp ceph rtd unknown /proc/44798/task/46289/root (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46289 tp_osd_tp ceph txt unknown /proc/44798/task/46289/exe (readlink: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46289 tp_osd_tp ceph NOFD /proc/44798/task/46289/fd (opendir: Permission denied) 2024-09-12T12:28:08.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46290 tp_osd_tp ceph cwd unknown /proc/44798/task/46290/cwd (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46290 tp_osd_tp ceph rtd unknown /proc/44798/task/46290/root (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46290 tp_osd_tp ceph txt unknown /proc/44798/task/46290/exe (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46290 tp_osd_tp ceph NOFD /proc/44798/task/46290/fd (opendir: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46291 tp_osd_tp ceph cwd unknown /proc/44798/task/46291/cwd (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46291 tp_osd_tp ceph rtd unknown /proc/44798/task/46291/root (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46291 tp_osd_tp ceph txt unknown /proc/44798/task/46291/exe (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46291 tp_osd_tp ceph NOFD /proc/44798/task/46291/fd (opendir: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46292 tp_osd_tp ceph cwd unknown /proc/44798/task/46292/cwd (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46292 tp_osd_tp ceph rtd unknown /proc/44798/task/46292/root (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46292 tp_osd_tp ceph txt unknown /proc/44798/task/46292/exe (readlink: Permission denied) 2024-09-12T12:28:08.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46292 tp_osd_tp ceph NOFD /proc/44798/task/46292/fd (opendir: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46293 osd_srv_h ceph cwd unknown /proc/44798/task/46293/cwd (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46293 osd_srv_h ceph rtd unknown /proc/44798/task/46293/root (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46293 osd_srv_h ceph txt unknown /proc/44798/task/46293/exe (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 44798 46293 osd_srv_h ceph NOFD /proc/44798/task/46293/fd (opendir: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 45816 root cwd unknown /proc/45816/cwd (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 45816 root rtd unknown /proc/45816/root (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 45816 root txt unknown /proc/45816/exe (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 45816 root NOFD /proc/45816/fd (opendir: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 45837 root cwd unknown /proc/45837/cwd (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 45837 root rtd unknown /proc/45837/root (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 45837 root txt unknown /proc/45837/exe (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 45837 root NOFD /proc/45837/fd (opendir: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 51259 root cwd unknown /proc/51259/cwd (readlink: Permission denied) 2024-09-12T12:28:08.053 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 51259 root rtd unknown /proc/51259/root (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 51259 root txt unknown /proc/51259/exe (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 51259 root NOFD /proc/51259/fd (opendir: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 51261 root cwd unknown /proc/51261/cwd (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 51261 root rtd unknown /proc/51261/root (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 51261 root txt unknown /proc/51261/exe (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 51261 root NOFD /proc/51261/fd (opendir: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 ceph cwd unknown /proc/51263/cwd (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 ceph rtd unknown /proc/51263/root (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 ceph txt unknown /proc/51263/exe (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 ceph NOFD /proc/51263/fd (opendir: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51264 log ceph cwd unknown /proc/51263/task/51264/cwd (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51264 log ceph rtd unknown /proc/51263/task/51264/root (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51264 log ceph txt unknown /proc/51263/task/51264/exe (readlink: Permission denied) 2024-09-12T12:28:08.054 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51264 log ceph NOFD /proc/51263/task/51264/fd (opendir: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51266 msgr-work ceph cwd unknown /proc/51263/task/51266/cwd (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51266 msgr-work ceph rtd unknown /proc/51263/task/51266/root (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51266 msgr-work ceph txt unknown /proc/51263/task/51266/exe (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51266 msgr-work ceph NOFD /proc/51263/task/51266/fd (opendir: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51267 msgr-work ceph cwd unknown /proc/51263/task/51267/cwd (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51267 msgr-work ceph rtd unknown /proc/51263/task/51267/root (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51267 msgr-work ceph txt unknown /proc/51263/task/51267/exe (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51267 msgr-work ceph NOFD /proc/51263/task/51267/fd (opendir: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51268 msgr-work ceph cwd unknown /proc/51263/task/51268/cwd (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51268 msgr-work ceph rtd unknown /proc/51263/task/51268/root (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51268 msgr-work ceph txt unknown /proc/51263/task/51268/exe (readlink: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51268 msgr-work ceph NOFD /proc/51263/task/51268/fd (opendir: Permission denied) 2024-09-12T12:28:08.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51272 service ceph cwd unknown /proc/51263/task/51272/cwd (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51272 service ceph rtd unknown /proc/51263/task/51272/root (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51272 service ceph txt unknown /proc/51263/task/51272/exe (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51272 service ceph NOFD /proc/51263/task/51272/fd (opendir: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51273 admin_soc ceph cwd unknown /proc/51263/task/51273/cwd (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51273 admin_soc ceph rtd unknown /proc/51263/task/51273/root (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51273 admin_soc ceph txt unknown /proc/51263/task/51273/exe (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51273 admin_soc ceph NOFD /proc/51263/task/51273/fd (opendir: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51599 signal_ha ceph cwd unknown /proc/51263/task/51599/cwd (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51599 signal_ha ceph rtd unknown /proc/51263/task/51599/root (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51599 signal_ha ceph txt unknown /proc/51263/task/51599/exe (readlink: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51599 signal_ha ceph NOFD /proc/51263/task/51599/fd (opendir: Permission denied) 2024-09-12T12:28:08.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51600 io_contex ceph cwd unknown /proc/51263/task/51600/cwd (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51600 io_contex ceph rtd unknown /proc/51263/task/51600/root (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51600 io_contex ceph txt unknown /proc/51263/task/51600/exe (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51600 io_contex ceph NOFD /proc/51263/task/51600/fd (opendir: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51601 io_contex ceph cwd unknown /proc/51263/task/51601/cwd (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51601 io_contex ceph rtd unknown /proc/51263/task/51601/root (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51601 io_contex ceph txt unknown /proc/51263/task/51601/exe (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51601 io_contex ceph NOFD /proc/51263/task/51601/fd (opendir: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51623 OpHistory ceph cwd unknown /proc/51263/task/51623/cwd (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51623 OpHistory ceph rtd unknown /proc/51263/task/51623/root (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51623 OpHistory ceph txt unknown /proc/51263/task/51623/exe (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51623 OpHistory ceph NOFD /proc/51263/task/51623/fd (opendir: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51624 ceph_time ceph cwd unknown /proc/51263/task/51624/cwd (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51624 ceph_time ceph rtd unknown /proc/51263/task/51624/root (readlink: Permission denied) 2024-09-12T12:28:08.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51624 ceph_time ceph txt unknown /proc/51263/task/51624/exe (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51624 ceph_time ceph NOFD /proc/51263/task/51624/fd (opendir: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51792 ceph-osd ceph cwd unknown /proc/51263/task/51792/cwd (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51792 ceph-osd ceph rtd unknown /proc/51263/task/51792/root (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51792 ceph-osd ceph txt unknown /proc/51263/task/51792/exe (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51792 ceph-osd ceph NOFD /proc/51263/task/51792/fd (opendir: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51793 safe_time ceph cwd unknown /proc/51263/task/51793/cwd (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51793 safe_time ceph rtd unknown /proc/51263/task/51793/root (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51793 safe_time ceph txt unknown /proc/51263/task/51793/exe (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51793 safe_time ceph NOFD /proc/51263/task/51793/fd (opendir: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51794 safe_time ceph cwd unknown /proc/51263/task/51794/cwd (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51794 safe_time ceph rtd unknown /proc/51263/task/51794/root (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51794 safe_time ceph txt unknown /proc/51263/task/51794/exe (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51794 safe_time ceph NOFD /proc/51263/task/51794/fd (opendir: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51795 safe_time ceph cwd unknown /proc/51263/task/51795/cwd (readlink: Permission denied) 2024-09-12T12:28:08.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51795 safe_time ceph rtd unknown /proc/51263/task/51795/root (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51795 safe_time ceph txt unknown /proc/51263/task/51795/exe (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51795 safe_time ceph NOFD /proc/51263/task/51795/fd (opendir: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51796 safe_time ceph cwd unknown /proc/51263/task/51796/cwd (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51796 safe_time ceph rtd unknown /proc/51263/task/51796/root (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51796 safe_time ceph txt unknown /proc/51263/task/51796/exe (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51796 safe_time ceph NOFD /proc/51263/task/51796/fd (opendir: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51797 fn_anonym ceph cwd unknown /proc/51263/task/51797/cwd (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51797 fn_anonym ceph rtd unknown /proc/51263/task/51797/root (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51797 fn_anonym ceph txt unknown /proc/51263/task/51797/exe (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51797 fn_anonym ceph NOFD /proc/51263/task/51797/fd (opendir: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51888 rocksdb:l ceph cwd unknown /proc/51263/task/51888/cwd (readlink: Permission denied) 2024-09-12T12:28:08.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51888 rocksdb:l ceph rtd unknown /proc/51263/task/51888/root (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51888 rocksdb:l ceph txt unknown /proc/51263/task/51888/exe (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51888 rocksdb:l ceph NOFD /proc/51263/task/51888/fd (opendir: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51889 rocksdb:l ceph cwd unknown /proc/51263/task/51889/cwd (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51889 rocksdb:l ceph rtd unknown /proc/51263/task/51889/root (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51889 rocksdb:l ceph txt unknown /proc/51263/task/51889/exe (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51889 rocksdb:l ceph NOFD /proc/51263/task/51889/fd (opendir: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51890 rocksdb:l ceph cwd unknown /proc/51263/task/51890/cwd (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51890 rocksdb:l ceph rtd unknown /proc/51263/task/51890/root (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51890 rocksdb:l ceph txt unknown /proc/51263/task/51890/exe (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51890 rocksdb:l ceph NOFD /proc/51263/task/51890/fd (opendir: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51891 rocksdb:h ceph cwd unknown /proc/51263/task/51891/cwd (readlink: Permission denied) 2024-09-12T12:28:08.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51891 rocksdb:h ceph rtd unknown /proc/51263/task/51891/root (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51891 rocksdb:h ceph txt unknown /proc/51263/task/51891/exe (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 51891 rocksdb:h ceph NOFD /proc/51263/task/51891/fd (opendir: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52333 bstore_ai ceph cwd unknown /proc/51263/task/52333/cwd (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52333 bstore_ai ceph rtd unknown /proc/51263/task/52333/root (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52333 bstore_ai ceph txt unknown /proc/51263/task/52333/exe (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52333 bstore_ai ceph NOFD /proc/51263/task/52333/fd (opendir: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52534 bstore_ai ceph cwd unknown /proc/51263/task/52534/cwd (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52534 bstore_ai ceph rtd unknown /proc/51263/task/52534/root (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52534 bstore_ai ceph txt unknown /proc/51263/task/52534/exe (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52534 bstore_ai ceph NOFD /proc/51263/task/52534/fd (opendir: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52717 ceph-osd ceph cwd unknown /proc/51263/task/52717/cwd (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52717 ceph-osd ceph rtd unknown /proc/51263/task/52717/root (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52717 ceph-osd ceph txt unknown /proc/51263/task/52717/exe (readlink: Permission denied) 2024-09-12T12:28:08.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52717 ceph-osd ceph NOFD /proc/51263/task/52717/fd (opendir: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52718 cfin ceph cwd unknown /proc/51263/task/52718/cwd (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52718 cfin ceph rtd unknown /proc/51263/task/52718/root (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52718 cfin ceph txt unknown /proc/51263/task/52718/exe (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52718 cfin ceph NOFD /proc/51263/task/52718/fd (opendir: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52719 bstore_kv ceph cwd unknown /proc/51263/task/52719/cwd (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52719 bstore_kv ceph rtd unknown /proc/51263/task/52719/root (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52719 bstore_kv ceph txt unknown /proc/51263/task/52719/exe (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52719 bstore_kv ceph NOFD /proc/51263/task/52719/fd (opendir: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52720 bstore_kv ceph cwd unknown /proc/51263/task/52720/cwd (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52720 bstore_kv ceph rtd unknown /proc/51263/task/52720/root (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52720 bstore_kv ceph txt unknown /proc/51263/task/52720/exe (readlink: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52720 bstore_kv ceph NOFD /proc/51263/task/52720/fd (opendir: Permission denied) 2024-09-12T12:28:08.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52721 bstore_me ceph cwd unknown /proc/51263/task/52721/cwd (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52721 bstore_me ceph rtd unknown /proc/51263/task/52721/root (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52721 bstore_me ceph txt unknown /proc/51263/task/52721/exe (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52721 bstore_me ceph NOFD /proc/51263/task/52721/fd (opendir: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52722 ms_dispat ceph cwd unknown /proc/51263/task/52722/cwd (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52722 ms_dispat ceph rtd unknown /proc/51263/task/52722/root (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52722 ms_dispat ceph txt unknown /proc/51263/task/52722/exe (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52722 ms_dispat ceph NOFD /proc/51263/task/52722/fd (opendir: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52723 ms_local ceph cwd unknown /proc/51263/task/52723/cwd (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52723 ms_local ceph rtd unknown /proc/51263/task/52723/root (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52723 ms_local ceph txt unknown /proc/51263/task/52723/exe (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52723 ms_local ceph NOFD /proc/51263/task/52723/fd (opendir: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52724 safe_time ceph cwd unknown /proc/51263/task/52724/cwd (readlink: Permission denied) 2024-09-12T12:28:08.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52724 safe_time ceph rtd unknown /proc/51263/task/52724/root (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52724 safe_time ceph txt unknown /proc/51263/task/52724/exe (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52724 safe_time ceph NOFD /proc/51263/task/52724/fd (opendir: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52725 safe_time ceph cwd unknown /proc/51263/task/52725/cwd (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52725 safe_time ceph rtd unknown /proc/51263/task/52725/root (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52725 safe_time ceph txt unknown /proc/51263/task/52725/exe (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52725 safe_time ceph NOFD /proc/51263/task/52725/fd (opendir: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52726 ms_dispat ceph cwd unknown /proc/51263/task/52726/cwd (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52726 ms_dispat ceph rtd unknown /proc/51263/task/52726/root (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52726 ms_dispat ceph txt unknown /proc/51263/task/52726/exe (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52726 ms_dispat ceph NOFD /proc/51263/task/52726/fd (opendir: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52727 ms_local ceph cwd unknown /proc/51263/task/52727/cwd (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52727 ms_local ceph rtd unknown /proc/51263/task/52727/root (readlink: Permission denied) 2024-09-12T12:28:08.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52727 ms_local ceph txt unknown /proc/51263/task/52727/exe (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52727 ms_local ceph NOFD /proc/51263/task/52727/fd (opendir: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52728 ms_dispat ceph cwd unknown /proc/51263/task/52728/cwd (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52728 ms_dispat ceph rtd unknown /proc/51263/task/52728/root (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52728 ms_dispat ceph txt unknown /proc/51263/task/52728/exe (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52728 ms_dispat ceph NOFD /proc/51263/task/52728/fd (opendir: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52729 ms_local ceph cwd unknown /proc/51263/task/52729/cwd (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52729 ms_local ceph rtd unknown /proc/51263/task/52729/root (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52729 ms_local ceph txt unknown /proc/51263/task/52729/exe (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52729 ms_local ceph NOFD /proc/51263/task/52729/fd (opendir: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52730 ms_dispat ceph cwd unknown /proc/51263/task/52730/cwd (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52730 ms_dispat ceph rtd unknown /proc/51263/task/52730/root (readlink: Permission denied) 2024-09-12T12:28:08.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52730 ms_dispat ceph txt unknown /proc/51263/task/52730/exe (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52730 ms_dispat ceph NOFD /proc/51263/task/52730/fd (opendir: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52731 ms_local ceph cwd unknown /proc/51263/task/52731/cwd (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52731 ms_local ceph rtd unknown /proc/51263/task/52731/root (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52731 ms_local ceph txt unknown /proc/51263/task/52731/exe (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52731 ms_local ceph NOFD /proc/51263/task/52731/fd (opendir: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52732 ms_dispat ceph cwd unknown /proc/51263/task/52732/cwd (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52732 ms_dispat ceph rtd unknown /proc/51263/task/52732/root (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52732 ms_dispat ceph txt unknown /proc/51263/task/52732/exe (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52732 ms_dispat ceph NOFD /proc/51263/task/52732/fd (opendir: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52733 ms_local ceph cwd unknown /proc/51263/task/52733/cwd (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52733 ms_local ceph rtd unknown /proc/51263/task/52733/root (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52733 ms_local ceph txt unknown /proc/51263/task/52733/exe (readlink: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52733 ms_local ceph NOFD /proc/51263/task/52733/fd (opendir: Permission denied) 2024-09-12T12:28:08.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52734 ms_dispat ceph cwd unknown /proc/51263/task/52734/cwd (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52734 ms_dispat ceph rtd unknown /proc/51263/task/52734/root (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52734 ms_dispat ceph txt unknown /proc/51263/task/52734/exe (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52734 ms_dispat ceph NOFD /proc/51263/task/52734/fd (opendir: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52735 ms_local ceph cwd unknown /proc/51263/task/52735/cwd (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52735 ms_local ceph rtd unknown /proc/51263/task/52735/root (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52735 ms_local ceph txt unknown /proc/51263/task/52735/exe (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52735 ms_local ceph NOFD /proc/51263/task/52735/fd (opendir: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52736 ms_dispat ceph cwd unknown /proc/51263/task/52736/cwd (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52736 ms_dispat ceph rtd unknown /proc/51263/task/52736/root (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52736 ms_dispat ceph txt unknown /proc/51263/task/52736/exe (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52736 ms_dispat ceph NOFD /proc/51263/task/52736/fd (opendir: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52737 ms_local ceph cwd unknown /proc/51263/task/52737/cwd (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52737 ms_local ceph rtd unknown /proc/51263/task/52737/root (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52737 ms_local ceph txt unknown /proc/51263/task/52737/exe (readlink: Permission denied) 2024-09-12T12:28:08.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52737 ms_local ceph NOFD /proc/51263/task/52737/fd (opendir: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52738 fn_anonym ceph cwd unknown /proc/51263/task/52738/cwd (readlink: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52738 fn_anonym ceph rtd unknown /proc/51263/task/52738/root (readlink: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52738 fn_anonym ceph txt unknown /proc/51263/task/52738/exe (readlink: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52738 fn_anonym ceph NOFD /proc/51263/task/52738/fd (opendir: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52739 finisher ceph cwd unknown /proc/51263/task/52739/cwd (readlink: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52739 finisher ceph rtd unknown /proc/51263/task/52739/root (readlink: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52739 finisher ceph txt unknown /proc/51263/task/52739/exe (readlink: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52739 finisher ceph NOFD /proc/51263/task/52739/fd (opendir: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52740 safe_time ceph cwd unknown /proc/51263/task/52740/cwd (readlink: Permission denied) 2024-09-12T12:28:08.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52740 safe_time ceph rtd unknown /proc/51263/task/52740/root (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52740 safe_time ceph txt unknown /proc/51263/task/52740/exe (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52740 safe_time ceph NOFD /proc/51263/task/52740/fd (opendir: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52741 safe_time ceph cwd unknown /proc/51263/task/52741/cwd (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52741 safe_time ceph rtd unknown /proc/51263/task/52741/root (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52741 safe_time ceph txt unknown /proc/51263/task/52741/exe (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52741 safe_time ceph NOFD /proc/51263/task/52741/fd (opendir: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52742 ceph-osd ceph cwd unknown /proc/51263/task/52742/cwd (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52742 ceph-osd ceph rtd unknown /proc/51263/task/52742/root (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52742 ceph-osd ceph txt unknown /proc/51263/task/52742/exe (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52742 ceph-osd ceph NOFD /proc/51263/task/52742/fd (opendir: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52743 osd_srv_a ceph cwd unknown /proc/51263/task/52743/cwd (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52743 osd_srv_a ceph rtd unknown /proc/51263/task/52743/root (readlink: Permission denied) 2024-09-12T12:28:08.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52743 osd_srv_a ceph txt unknown /proc/51263/task/52743/exe (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52743 osd_srv_a ceph NOFD /proc/51263/task/52743/fd (opendir: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52744 tp_osd_tp ceph cwd unknown /proc/51263/task/52744/cwd (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52744 tp_osd_tp ceph rtd unknown /proc/51263/task/52744/root (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52744 tp_osd_tp ceph txt unknown /proc/51263/task/52744/exe (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52744 tp_osd_tp ceph NOFD /proc/51263/task/52744/fd (opendir: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52745 tp_osd_tp ceph cwd unknown /proc/51263/task/52745/cwd (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52745 tp_osd_tp ceph rtd unknown /proc/51263/task/52745/root (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52745 tp_osd_tp ceph txt unknown /proc/51263/task/52745/exe (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52745 tp_osd_tp ceph NOFD /proc/51263/task/52745/fd (opendir: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52746 tp_osd_tp ceph cwd unknown /proc/51263/task/52746/cwd (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52746 tp_osd_tp ceph rtd unknown /proc/51263/task/52746/root (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52746 tp_osd_tp ceph txt unknown /proc/51263/task/52746/exe (readlink: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52746 tp_osd_tp ceph NOFD /proc/51263/task/52746/fd (opendir: Permission denied) 2024-09-12T12:28:08.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52747 tp_osd_tp ceph cwd unknown /proc/51263/task/52747/cwd (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52747 tp_osd_tp ceph rtd unknown /proc/51263/task/52747/root (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52747 tp_osd_tp ceph txt unknown /proc/51263/task/52747/exe (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52747 tp_osd_tp ceph NOFD /proc/51263/task/52747/fd (opendir: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52748 tp_osd_tp ceph cwd unknown /proc/51263/task/52748/cwd (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52748 tp_osd_tp ceph rtd unknown /proc/51263/task/52748/root (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52748 tp_osd_tp ceph txt unknown /proc/51263/task/52748/exe (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52748 tp_osd_tp ceph NOFD /proc/51263/task/52748/fd (opendir: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52749 tp_osd_tp ceph cwd unknown /proc/51263/task/52749/cwd (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52749 tp_osd_tp ceph rtd unknown /proc/51263/task/52749/root (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52749 tp_osd_tp ceph txt unknown /proc/51263/task/52749/exe (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52749 tp_osd_tp ceph NOFD /proc/51263/task/52749/fd (opendir: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52750 tp_osd_tp ceph cwd unknown /proc/51263/task/52750/cwd (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52750 tp_osd_tp ceph rtd unknown /proc/51263/task/52750/root (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52750 tp_osd_tp ceph txt unknown /proc/51263/task/52750/exe (readlink: Permission denied) 2024-09-12T12:28:08.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52750 tp_osd_tp ceph NOFD /proc/51263/task/52750/fd (opendir: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52751 tp_osd_tp ceph cwd unknown /proc/51263/task/52751/cwd (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52751 tp_osd_tp ceph rtd unknown /proc/51263/task/52751/root (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52751 tp_osd_tp ceph txt unknown /proc/51263/task/52751/exe (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52751 tp_osd_tp ceph NOFD /proc/51263/task/52751/fd (opendir: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52752 tp_osd_tp ceph cwd unknown /proc/51263/task/52752/cwd (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52752 tp_osd_tp ceph rtd unknown /proc/51263/task/52752/root (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52752 tp_osd_tp ceph txt unknown /proc/51263/task/52752/exe (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52752 tp_osd_tp ceph NOFD /proc/51263/task/52752/fd (opendir: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52753 tp_osd_tp ceph cwd unknown /proc/51263/task/52753/cwd (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52753 tp_osd_tp ceph rtd unknown /proc/51263/task/52753/root (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52753 tp_osd_tp ceph txt unknown /proc/51263/task/52753/exe (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52753 tp_osd_tp ceph NOFD /proc/51263/task/52753/fd (opendir: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52754 tp_osd_tp ceph cwd unknown /proc/51263/task/52754/cwd (readlink: Permission denied) 2024-09-12T12:28:08.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52754 tp_osd_tp ceph rtd unknown /proc/51263/task/52754/root (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52754 tp_osd_tp ceph txt unknown /proc/51263/task/52754/exe (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52754 tp_osd_tp ceph NOFD /proc/51263/task/52754/fd (opendir: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52755 tp_osd_tp ceph cwd unknown /proc/51263/task/52755/cwd (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52755 tp_osd_tp ceph rtd unknown /proc/51263/task/52755/root (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52755 tp_osd_tp ceph txt unknown /proc/51263/task/52755/exe (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52755 tp_osd_tp ceph NOFD /proc/51263/task/52755/fd (opendir: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52756 tp_osd_tp ceph cwd unknown /proc/51263/task/52756/cwd (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52756 tp_osd_tp ceph rtd unknown /proc/51263/task/52756/root (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52756 tp_osd_tp ceph txt unknown /proc/51263/task/52756/exe (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52756 tp_osd_tp ceph NOFD /proc/51263/task/52756/fd (opendir: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52757 tp_osd_tp ceph cwd unknown /proc/51263/task/52757/cwd (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52757 tp_osd_tp ceph rtd unknown /proc/51263/task/52757/root (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52757 tp_osd_tp ceph txt unknown /proc/51263/task/52757/exe (readlink: Permission denied) 2024-09-12T12:28:08.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52757 tp_osd_tp ceph NOFD /proc/51263/task/52757/fd (opendir: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52758 tp_osd_tp ceph cwd unknown /proc/51263/task/52758/cwd (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52758 tp_osd_tp ceph rtd unknown /proc/51263/task/52758/root (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52758 tp_osd_tp ceph txt unknown /proc/51263/task/52758/exe (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52758 tp_osd_tp ceph NOFD /proc/51263/task/52758/fd (opendir: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52759 tp_osd_tp ceph cwd unknown /proc/51263/task/52759/cwd (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52759 tp_osd_tp ceph rtd unknown /proc/51263/task/52759/root (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52759 tp_osd_tp ceph txt unknown /proc/51263/task/52759/exe (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52759 tp_osd_tp ceph NOFD /proc/51263/task/52759/fd (opendir: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52760 osd_srv_h ceph cwd unknown /proc/51263/task/52760/cwd (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52760 osd_srv_h ceph rtd unknown /proc/51263/task/52760/root (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52760 osd_srv_h ceph txt unknown /proc/51263/task/52760/exe (readlink: Permission denied) 2024-09-12T12:28:08.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 51263 52760 osd_srv_h ceph NOFD /proc/51263/task/52760/fd (opendir: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 52283 root cwd unknown /proc/52283/cwd (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 52283 root rtd unknown /proc/52283/root (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 52283 root txt unknown /proc/52283/exe (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 52283 root NOFD /proc/52283/fd (opendir: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 52302 root cwd unknown /proc/52302/cwd (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 52302 root rtd unknown /proc/52302/root (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 52302 root txt unknown /proc/52302/exe (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 52302 root NOFD /proc/52302/fd (opendir: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 54911 root cwd unknown /proc/54911/cwd (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 54911 root rtd unknown /proc/54911/root (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 54911 root txt unknown /proc/54911/exe (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 54911 root NOFD /proc/54911/fd (opendir: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 57010 root cwd unknown /proc/57010/cwd (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 57010 root rtd unknown /proc/57010/root (readlink: Permission denied) 2024-09-12T12:28:08.075 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 57010 root txt unknown /proc/57010/exe (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 57010 root NOFD /proc/57010/fd (opendir: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57011 root cwd unknown /proc/57011/cwd (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57011 root rtd unknown /proc/57011/root (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57011 root txt unknown /proc/57011/exe (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57011 root NOFD /proc/57011/fd (opendir: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57014 root cwd unknown /proc/57014/cwd (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57014 root rtd unknown /proc/57014/root (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57014 root txt unknown /proc/57014/exe (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 57014 root NOFD /proc/57014/fd (opendir: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 57746 root cwd unknown /proc/57746/cwd (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 57746 root rtd unknown /proc/57746/root (readlink: Permission denied) 2024-09-12T12:28:08.076 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 57746 root txt unknown /proc/57746/exe (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 57746 root NOFD /proc/57746/fd (opendir: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 57748 root cwd unknown /proc/57748/cwd (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 57748 root rtd unknown /proc/57748/root (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 57748 root txt unknown /proc/57748/exe (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 57748 root NOFD /proc/57748/fd (opendir: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 ceph cwd unknown /proc/57750/cwd (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 ceph rtd unknown /proc/57750/root (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 ceph txt unknown /proc/57750/exe (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 ceph NOFD /proc/57750/fd (opendir: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57751 log ceph cwd unknown /proc/57750/task/57751/cwd (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57751 log ceph rtd unknown /proc/57750/task/57751/root (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57751 log ceph txt unknown /proc/57750/task/57751/exe (readlink: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57751 log ceph NOFD /proc/57750/task/57751/fd (opendir: Permission denied) 2024-09-12T12:28:08.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57753 msgr-work ceph cwd unknown /proc/57750/task/57753/cwd (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57753 msgr-work ceph rtd unknown /proc/57750/task/57753/root (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57753 msgr-work ceph txt unknown /proc/57750/task/57753/exe (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57753 msgr-work ceph NOFD /proc/57750/task/57753/fd (opendir: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57754 msgr-work ceph cwd unknown /proc/57750/task/57754/cwd (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57754 msgr-work ceph rtd unknown /proc/57750/task/57754/root (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57754 msgr-work ceph txt unknown /proc/57750/task/57754/exe (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57754 msgr-work ceph NOFD /proc/57750/task/57754/fd (opendir: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57755 msgr-work ceph cwd unknown /proc/57750/task/57755/cwd (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57755 msgr-work ceph rtd unknown /proc/57750/task/57755/root (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57755 msgr-work ceph txt unknown /proc/57750/task/57755/exe (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57755 msgr-work ceph NOFD /proc/57750/task/57755/fd (opendir: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57759 service ceph cwd unknown /proc/57750/task/57759/cwd (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57759 service ceph rtd unknown /proc/57750/task/57759/root (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57759 service ceph txt unknown /proc/57750/task/57759/exe (readlink: Permission denied) 2024-09-12T12:28:08.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57759 service ceph NOFD /proc/57750/task/57759/fd (opendir: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57760 admin_soc ceph cwd unknown /proc/57750/task/57760/cwd (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57760 admin_soc ceph rtd unknown /proc/57750/task/57760/root (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57760 admin_soc ceph txt unknown /proc/57750/task/57760/exe (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 57760 admin_soc ceph NOFD /proc/57750/task/57760/fd (opendir: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58078 signal_ha ceph cwd unknown /proc/57750/task/58078/cwd (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58078 signal_ha ceph rtd unknown /proc/57750/task/58078/root (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58078 signal_ha ceph txt unknown /proc/57750/task/58078/exe (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58078 signal_ha ceph NOFD /proc/57750/task/58078/fd (opendir: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58079 io_contex ceph cwd unknown /proc/57750/task/58079/cwd (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58079 io_contex ceph rtd unknown /proc/57750/task/58079/root (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58079 io_contex ceph txt unknown /proc/57750/task/58079/exe (readlink: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58079 io_contex ceph NOFD /proc/57750/task/58079/fd (opendir: Permission denied) 2024-09-12T12:28:08.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58080 io_contex ceph cwd unknown /proc/57750/task/58080/cwd (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58080 io_contex ceph rtd unknown /proc/57750/task/58080/root (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58080 io_contex ceph txt unknown /proc/57750/task/58080/exe (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58080 io_contex ceph NOFD /proc/57750/task/58080/fd (opendir: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58105 OpHistory ceph cwd unknown /proc/57750/task/58105/cwd (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58105 OpHistory ceph rtd unknown /proc/57750/task/58105/root (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58105 OpHistory ceph txt unknown /proc/57750/task/58105/exe (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58105 OpHistory ceph NOFD /proc/57750/task/58105/fd (opendir: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58106 ceph_time ceph cwd unknown /proc/57750/task/58106/cwd (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58106 ceph_time ceph rtd unknown /proc/57750/task/58106/root (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58106 ceph_time ceph txt unknown /proc/57750/task/58106/exe (readlink: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58106 ceph_time ceph NOFD /proc/57750/task/58106/fd (opendir: Permission denied) 2024-09-12T12:28:08.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58126 ceph-osd ceph cwd unknown /proc/57750/task/58126/cwd (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58126 ceph-osd ceph rtd unknown /proc/57750/task/58126/root (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58126 ceph-osd ceph txt unknown /proc/57750/task/58126/exe (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58126 ceph-osd ceph NOFD /proc/57750/task/58126/fd (opendir: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58158 ceph-osd ceph cwd unknown /proc/57750/task/58158/cwd (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58158 ceph-osd ceph rtd unknown /proc/57750/task/58158/root (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58158 ceph-osd ceph txt unknown /proc/57750/task/58158/exe (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58158 ceph-osd ceph NOFD /proc/57750/task/58158/fd (opendir: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58179 ceph-osd ceph cwd unknown /proc/57750/task/58179/cwd (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58179 ceph-osd ceph rtd unknown /proc/57750/task/58179/root (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58179 ceph-osd ceph txt unknown /proc/57750/task/58179/exe (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58179 ceph-osd ceph NOFD /proc/57750/task/58179/fd (opendir: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58205 ceph-osd ceph cwd unknown /proc/57750/task/58205/cwd (readlink: Permission denied) 2024-09-12T12:28:08.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58205 ceph-osd ceph rtd unknown /proc/57750/task/58205/root (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58205 ceph-osd ceph txt unknown /proc/57750/task/58205/exe (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58205 ceph-osd ceph NOFD /proc/57750/task/58205/fd (opendir: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58255 ceph-osd ceph cwd unknown /proc/57750/task/58255/cwd (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58255 ceph-osd ceph rtd unknown /proc/57750/task/58255/root (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58255 ceph-osd ceph txt unknown /proc/57750/task/58255/exe (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58255 ceph-osd ceph NOFD /proc/57750/task/58255/fd (opendir: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58268 ceph-osd ceph cwd unknown /proc/57750/task/58268/cwd (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58268 ceph-osd ceph rtd unknown /proc/57750/task/58268/root (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58268 ceph-osd ceph txt unknown /proc/57750/task/58268/exe (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58268 ceph-osd ceph NOFD /proc/57750/task/58268/fd (opendir: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58289 ceph-osd ceph cwd unknown /proc/57750/task/58289/cwd (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58289 ceph-osd ceph rtd unknown /proc/57750/task/58289/root (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58289 ceph-osd ceph txt unknown /proc/57750/task/58289/exe (readlink: Permission denied) 2024-09-12T12:28:08.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58289 ceph-osd ceph NOFD /proc/57750/task/58289/fd (opendir: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58294 ceph-osd ceph cwd unknown /proc/57750/task/58294/cwd (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58294 ceph-osd ceph rtd unknown /proc/57750/task/58294/root (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58294 ceph-osd ceph txt unknown /proc/57750/task/58294/exe (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58294 ceph-osd ceph NOFD /proc/57750/task/58294/fd (opendir: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58295 ceph-osd ceph cwd unknown /proc/57750/task/58295/cwd (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58295 ceph-osd ceph rtd unknown /proc/57750/task/58295/root (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58295 ceph-osd ceph txt unknown /proc/57750/task/58295/exe (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58295 ceph-osd ceph NOFD /proc/57750/task/58295/fd (opendir: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58296 safe_time ceph cwd unknown /proc/57750/task/58296/cwd (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58296 safe_time ceph rtd unknown /proc/57750/task/58296/root (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58296 safe_time ceph txt unknown /proc/57750/task/58296/exe (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58296 safe_time ceph NOFD /proc/57750/task/58296/fd (opendir: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58297 safe_time ceph cwd unknown /proc/57750/task/58297/cwd (readlink: Permission denied) 2024-09-12T12:28:08.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58297 safe_time ceph rtd unknown /proc/57750/task/58297/root (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58297 safe_time ceph txt unknown /proc/57750/task/58297/exe (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58297 safe_time ceph NOFD /proc/57750/task/58297/fd (opendir: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58298 safe_time ceph cwd unknown /proc/57750/task/58298/cwd (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58298 safe_time ceph rtd unknown /proc/57750/task/58298/root (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58298 safe_time ceph txt unknown /proc/57750/task/58298/exe (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58298 safe_time ceph NOFD /proc/57750/task/58298/fd (opendir: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58299 safe_time ceph cwd unknown /proc/57750/task/58299/cwd (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58299 safe_time ceph rtd unknown /proc/57750/task/58299/root (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58299 safe_time ceph txt unknown /proc/57750/task/58299/exe (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58299 safe_time ceph NOFD /proc/57750/task/58299/fd (opendir: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58300 fn_anonym ceph cwd unknown /proc/57750/task/58300/cwd (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58300 fn_anonym ceph rtd unknown /proc/57750/task/58300/root (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58300 fn_anonym ceph txt unknown /proc/57750/task/58300/exe (readlink: Permission denied) 2024-09-12T12:28:08.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58300 fn_anonym ceph NOFD /proc/57750/task/58300/fd (opendir: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58318 rocksdb:l ceph cwd unknown /proc/57750/task/58318/cwd (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58318 rocksdb:l ceph rtd unknown /proc/57750/task/58318/root (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58318 rocksdb:l ceph txt unknown /proc/57750/task/58318/exe (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58318 rocksdb:l ceph NOFD /proc/57750/task/58318/fd (opendir: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58319 rocksdb:l ceph cwd unknown /proc/57750/task/58319/cwd (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58319 rocksdb:l ceph rtd unknown /proc/57750/task/58319/root (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58319 rocksdb:l ceph txt unknown /proc/57750/task/58319/exe (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58319 rocksdb:l ceph NOFD /proc/57750/task/58319/fd (opendir: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58320 rocksdb:l ceph cwd unknown /proc/57750/task/58320/cwd (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58320 rocksdb:l ceph rtd unknown /proc/57750/task/58320/root (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58320 rocksdb:l ceph txt unknown /proc/57750/task/58320/exe (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58320 rocksdb:l ceph NOFD /proc/57750/task/58320/fd (opendir: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58321 rocksdb:h ceph cwd unknown /proc/57750/task/58321/cwd (readlink: Permission denied) 2024-09-12T12:28:08.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58321 rocksdb:h ceph rtd unknown /proc/57750/task/58321/root (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58321 rocksdb:h ceph txt unknown /proc/57750/task/58321/exe (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58321 rocksdb:h ceph NOFD /proc/57750/task/58321/fd (opendir: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58844 bstore_ai ceph cwd unknown /proc/57750/task/58844/cwd (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58844 bstore_ai ceph rtd unknown /proc/57750/task/58844/root (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58844 bstore_ai ceph txt unknown /proc/57750/task/58844/exe (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 58844 bstore_ai ceph NOFD /proc/57750/task/58844/fd (opendir: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59033 bstore_ai ceph cwd unknown /proc/57750/task/59033/cwd (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59033 bstore_ai ceph rtd unknown /proc/57750/task/59033/root (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59033 bstore_ai ceph txt unknown /proc/57750/task/59033/exe (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59033 bstore_ai ceph NOFD /proc/57750/task/59033/fd (opendir: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59216 ceph-osd ceph cwd unknown /proc/57750/task/59216/cwd (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59216 ceph-osd ceph rtd unknown /proc/57750/task/59216/root (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59216 ceph-osd ceph txt unknown /proc/57750/task/59216/exe (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59216 ceph-osd ceph NOFD /proc/57750/task/59216/fd (opendir: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59217 cfin ceph cwd unknown /proc/57750/task/59217/cwd (readlink: Permission denied) 2024-09-12T12:28:08.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59217 cfin ceph rtd unknown /proc/57750/task/59217/root (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59217 cfin ceph txt unknown /proc/57750/task/59217/exe (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59217 cfin ceph NOFD /proc/57750/task/59217/fd (opendir: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59218 bstore_kv ceph cwd unknown /proc/57750/task/59218/cwd (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59218 bstore_kv ceph rtd unknown /proc/57750/task/59218/root (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59218 bstore_kv ceph txt unknown /proc/57750/task/59218/exe (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59218 bstore_kv ceph NOFD /proc/57750/task/59218/fd (opendir: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59219 bstore_kv ceph cwd unknown /proc/57750/task/59219/cwd (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59219 bstore_kv ceph rtd unknown /proc/57750/task/59219/root (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59219 bstore_kv ceph txt unknown /proc/57750/task/59219/exe (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59219 bstore_kv ceph NOFD /proc/57750/task/59219/fd (opendir: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59220 bstore_me ceph cwd unknown /proc/57750/task/59220/cwd (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59220 bstore_me ceph rtd unknown /proc/57750/task/59220/root (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59220 bstore_me ceph txt unknown /proc/57750/task/59220/exe (readlink: Permission denied) 2024-09-12T12:28:08.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59220 bstore_me ceph NOFD /proc/57750/task/59220/fd (opendir: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59221 ms_dispat ceph cwd unknown /proc/57750/task/59221/cwd (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59221 ms_dispat ceph rtd unknown /proc/57750/task/59221/root (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59221 ms_dispat ceph txt unknown /proc/57750/task/59221/exe (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59221 ms_dispat ceph NOFD /proc/57750/task/59221/fd (opendir: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59222 ms_local ceph cwd unknown /proc/57750/task/59222/cwd (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59222 ms_local ceph rtd unknown /proc/57750/task/59222/root (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59222 ms_local ceph txt unknown /proc/57750/task/59222/exe (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59222 ms_local ceph NOFD /proc/57750/task/59222/fd (opendir: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59223 safe_time ceph cwd unknown /proc/57750/task/59223/cwd (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59223 safe_time ceph rtd unknown /proc/57750/task/59223/root (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59223 safe_time ceph txt unknown /proc/57750/task/59223/exe (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59223 safe_time ceph NOFD /proc/57750/task/59223/fd (opendir: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59224 safe_time ceph cwd unknown /proc/57750/task/59224/cwd (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59224 safe_time ceph rtd unknown /proc/57750/task/59224/root (readlink: Permission denied) 2024-09-12T12:28:08.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59224 safe_time ceph txt unknown /proc/57750/task/59224/exe (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59224 safe_time ceph NOFD /proc/57750/task/59224/fd (opendir: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59225 ms_dispat ceph cwd unknown /proc/57750/task/59225/cwd (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59225 ms_dispat ceph rtd unknown /proc/57750/task/59225/root (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59225 ms_dispat ceph txt unknown /proc/57750/task/59225/exe (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59225 ms_dispat ceph NOFD /proc/57750/task/59225/fd (opendir: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59226 ms_local ceph cwd unknown /proc/57750/task/59226/cwd (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59226 ms_local ceph rtd unknown /proc/57750/task/59226/root (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59226 ms_local ceph txt unknown /proc/57750/task/59226/exe (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59226 ms_local ceph NOFD /proc/57750/task/59226/fd (opendir: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59227 ms_dispat ceph cwd unknown /proc/57750/task/59227/cwd (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59227 ms_dispat ceph rtd unknown /proc/57750/task/59227/root (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59227 ms_dispat ceph txt unknown /proc/57750/task/59227/exe (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59227 ms_dispat ceph NOFD /proc/57750/task/59227/fd (opendir: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59228 ms_local ceph cwd unknown /proc/57750/task/59228/cwd (readlink: Permission denied) 2024-09-12T12:28:08.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59228 ms_local ceph rtd unknown /proc/57750/task/59228/root (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59228 ms_local ceph txt unknown /proc/57750/task/59228/exe (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59228 ms_local ceph NOFD /proc/57750/task/59228/fd (opendir: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59229 ms_dispat ceph cwd unknown /proc/57750/task/59229/cwd (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59229 ms_dispat ceph rtd unknown /proc/57750/task/59229/root (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59229 ms_dispat ceph txt unknown /proc/57750/task/59229/exe (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59229 ms_dispat ceph NOFD /proc/57750/task/59229/fd (opendir: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59230 ms_local ceph cwd unknown /proc/57750/task/59230/cwd (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59230 ms_local ceph rtd unknown /proc/57750/task/59230/root (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59230 ms_local ceph txt unknown /proc/57750/task/59230/exe (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59230 ms_local ceph NOFD /proc/57750/task/59230/fd (opendir: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59231 ms_dispat ceph cwd unknown /proc/57750/task/59231/cwd (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59231 ms_dispat ceph rtd unknown /proc/57750/task/59231/root (readlink: Permission denied) 2024-09-12T12:28:08.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59231 ms_dispat ceph txt unknown /proc/57750/task/59231/exe (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59231 ms_dispat ceph NOFD /proc/57750/task/59231/fd (opendir: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59232 ms_local ceph cwd unknown /proc/57750/task/59232/cwd (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59232 ms_local ceph rtd unknown /proc/57750/task/59232/root (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59232 ms_local ceph txt unknown /proc/57750/task/59232/exe (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59232 ms_local ceph NOFD /proc/57750/task/59232/fd (opendir: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59233 ms_dispat ceph cwd unknown /proc/57750/task/59233/cwd (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59233 ms_dispat ceph rtd unknown /proc/57750/task/59233/root (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59233 ms_dispat ceph txt unknown /proc/57750/task/59233/exe (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59233 ms_dispat ceph NOFD /proc/57750/task/59233/fd (opendir: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59234 ms_local ceph cwd unknown /proc/57750/task/59234/cwd (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59234 ms_local ceph rtd unknown /proc/57750/task/59234/root (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59234 ms_local ceph txt unknown /proc/57750/task/59234/exe (readlink: Permission denied) 2024-09-12T12:28:08.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59234 ms_local ceph NOFD /proc/57750/task/59234/fd (opendir: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59235 ms_dispat ceph cwd unknown /proc/57750/task/59235/cwd (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59235 ms_dispat ceph rtd unknown /proc/57750/task/59235/root (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59235 ms_dispat ceph txt unknown /proc/57750/task/59235/exe (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59235 ms_dispat ceph NOFD /proc/57750/task/59235/fd (opendir: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59236 ms_local ceph cwd unknown /proc/57750/task/59236/cwd (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59236 ms_local ceph rtd unknown /proc/57750/task/59236/root (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59236 ms_local ceph txt unknown /proc/57750/task/59236/exe (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59236 ms_local ceph NOFD /proc/57750/task/59236/fd (opendir: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59237 fn_anonym ceph cwd unknown /proc/57750/task/59237/cwd (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59237 fn_anonym ceph rtd unknown /proc/57750/task/59237/root (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59237 fn_anonym ceph txt unknown /proc/57750/task/59237/exe (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59237 fn_anonym ceph NOFD /proc/57750/task/59237/fd (opendir: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59238 finisher ceph cwd unknown /proc/57750/task/59238/cwd (readlink: Permission denied) 2024-09-12T12:28:08.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59238 finisher ceph rtd unknown /proc/57750/task/59238/root (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59238 finisher ceph txt unknown /proc/57750/task/59238/exe (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59238 finisher ceph NOFD /proc/57750/task/59238/fd (opendir: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59239 safe_time ceph cwd unknown /proc/57750/task/59239/cwd (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59239 safe_time ceph rtd unknown /proc/57750/task/59239/root (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59239 safe_time ceph txt unknown /proc/57750/task/59239/exe (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59239 safe_time ceph NOFD /proc/57750/task/59239/fd (opendir: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59240 safe_time ceph cwd unknown /proc/57750/task/59240/cwd (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59240 safe_time ceph rtd unknown /proc/57750/task/59240/root (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59240 safe_time ceph txt unknown /proc/57750/task/59240/exe (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59240 safe_time ceph NOFD /proc/57750/task/59240/fd (opendir: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59241 ceph-osd ceph cwd unknown /proc/57750/task/59241/cwd (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59241 ceph-osd ceph rtd unknown /proc/57750/task/59241/root (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59241 ceph-osd ceph txt unknown /proc/57750/task/59241/exe (readlink: Permission denied) 2024-09-12T12:28:08.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59241 ceph-osd ceph NOFD /proc/57750/task/59241/fd (opendir: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59242 osd_srv_a ceph cwd unknown /proc/57750/task/59242/cwd (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59242 osd_srv_a ceph rtd unknown /proc/57750/task/59242/root (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59242 osd_srv_a ceph txt unknown /proc/57750/task/59242/exe (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59242 osd_srv_a ceph NOFD /proc/57750/task/59242/fd (opendir: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59243 tp_osd_tp ceph cwd unknown /proc/57750/task/59243/cwd (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59243 tp_osd_tp ceph rtd unknown /proc/57750/task/59243/root (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59243 tp_osd_tp ceph txt unknown /proc/57750/task/59243/exe (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59243 tp_osd_tp ceph NOFD /proc/57750/task/59243/fd (opendir: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59244 tp_osd_tp ceph cwd unknown /proc/57750/task/59244/cwd (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59244 tp_osd_tp ceph rtd unknown /proc/57750/task/59244/root (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59244 tp_osd_tp ceph txt unknown /proc/57750/task/59244/exe (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59244 tp_osd_tp ceph NOFD /proc/57750/task/59244/fd (opendir: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59245 tp_osd_tp ceph cwd unknown /proc/57750/task/59245/cwd (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59245 tp_osd_tp ceph rtd unknown /proc/57750/task/59245/root (readlink: Permission denied) 2024-09-12T12:28:08.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59245 tp_osd_tp ceph txt unknown /proc/57750/task/59245/exe (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59245 tp_osd_tp ceph NOFD /proc/57750/task/59245/fd (opendir: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59246 tp_osd_tp ceph cwd unknown /proc/57750/task/59246/cwd (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59246 tp_osd_tp ceph rtd unknown /proc/57750/task/59246/root (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59246 tp_osd_tp ceph txt unknown /proc/57750/task/59246/exe (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59246 tp_osd_tp ceph NOFD /proc/57750/task/59246/fd (opendir: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59247 tp_osd_tp ceph cwd unknown /proc/57750/task/59247/cwd (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59247 tp_osd_tp ceph rtd unknown /proc/57750/task/59247/root (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59247 tp_osd_tp ceph txt unknown /proc/57750/task/59247/exe (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59247 tp_osd_tp ceph NOFD /proc/57750/task/59247/fd (opendir: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59248 tp_osd_tp ceph cwd unknown /proc/57750/task/59248/cwd (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59248 tp_osd_tp ceph rtd unknown /proc/57750/task/59248/root (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59248 tp_osd_tp ceph txt unknown /proc/57750/task/59248/exe (readlink: Permission denied) 2024-09-12T12:28:08.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59248 tp_osd_tp ceph NOFD /proc/57750/task/59248/fd (opendir: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59249 tp_osd_tp ceph cwd unknown /proc/57750/task/59249/cwd (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59249 tp_osd_tp ceph rtd unknown /proc/57750/task/59249/root (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59249 tp_osd_tp ceph txt unknown /proc/57750/task/59249/exe (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59249 tp_osd_tp ceph NOFD /proc/57750/task/59249/fd (opendir: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59250 tp_osd_tp ceph cwd unknown /proc/57750/task/59250/cwd (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59250 tp_osd_tp ceph rtd unknown /proc/57750/task/59250/root (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59250 tp_osd_tp ceph txt unknown /proc/57750/task/59250/exe (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59250 tp_osd_tp ceph NOFD /proc/57750/task/59250/fd (opendir: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59251 tp_osd_tp ceph cwd unknown /proc/57750/task/59251/cwd (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59251 tp_osd_tp ceph rtd unknown /proc/57750/task/59251/root (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59251 tp_osd_tp ceph txt unknown /proc/57750/task/59251/exe (readlink: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59251 tp_osd_tp ceph NOFD /proc/57750/task/59251/fd (opendir: Permission denied) 2024-09-12T12:28:08.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59252 tp_osd_tp ceph cwd unknown /proc/57750/task/59252/cwd (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59252 tp_osd_tp ceph rtd unknown /proc/57750/task/59252/root (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59252 tp_osd_tp ceph txt unknown /proc/57750/task/59252/exe (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59252 tp_osd_tp ceph NOFD /proc/57750/task/59252/fd (opendir: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59253 tp_osd_tp ceph cwd unknown /proc/57750/task/59253/cwd (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59253 tp_osd_tp ceph rtd unknown /proc/57750/task/59253/root (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59253 tp_osd_tp ceph txt unknown /proc/57750/task/59253/exe (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59253 tp_osd_tp ceph NOFD /proc/57750/task/59253/fd (opendir: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59254 tp_osd_tp ceph cwd unknown /proc/57750/task/59254/cwd (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59254 tp_osd_tp ceph rtd unknown /proc/57750/task/59254/root (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59254 tp_osd_tp ceph txt unknown /proc/57750/task/59254/exe (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59254 tp_osd_tp ceph NOFD /proc/57750/task/59254/fd (opendir: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59255 tp_osd_tp ceph cwd unknown /proc/57750/task/59255/cwd (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59255 tp_osd_tp ceph rtd unknown /proc/57750/task/59255/root (readlink: Permission denied) 2024-09-12T12:28:08.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59255 tp_osd_tp ceph txt unknown /proc/57750/task/59255/exe (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59255 tp_osd_tp ceph NOFD /proc/57750/task/59255/fd (opendir: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59256 tp_osd_tp ceph cwd unknown /proc/57750/task/59256/cwd (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59256 tp_osd_tp ceph rtd unknown /proc/57750/task/59256/root (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59256 tp_osd_tp ceph txt unknown /proc/57750/task/59256/exe (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59256 tp_osd_tp ceph NOFD /proc/57750/task/59256/fd (opendir: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59257 tp_osd_tp ceph cwd unknown /proc/57750/task/59257/cwd (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59257 tp_osd_tp ceph rtd unknown /proc/57750/task/59257/root (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59257 tp_osd_tp ceph txt unknown /proc/57750/task/59257/exe (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59257 tp_osd_tp ceph NOFD /proc/57750/task/59257/fd (opendir: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59258 tp_osd_tp ceph cwd unknown /proc/57750/task/59258/cwd (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59258 tp_osd_tp ceph rtd unknown /proc/57750/task/59258/root (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59258 tp_osd_tp ceph txt unknown /proc/57750/task/59258/exe (readlink: Permission denied) 2024-09-12T12:28:08.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59258 tp_osd_tp ceph NOFD /proc/57750/task/59258/fd (opendir: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59259 osd_srv_h ceph cwd unknown /proc/57750/task/59259/cwd (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59259 osd_srv_h ceph rtd unknown /proc/57750/task/59259/root (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59259 osd_srv_h ceph txt unknown /proc/57750/task/59259/exe (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 57750 59259 osd_srv_h ceph NOFD /proc/57750/task/59259/fd (opendir: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 58288 root cwd unknown /proc/58288/cwd (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 58288 root rtd unknown /proc/58288/root (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 58288 root txt unknown /proc/58288/exe (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 58288 root NOFD /proc/58288/fd (opendir: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 58798 root cwd unknown /proc/58798/cwd (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 58798 root rtd unknown /proc/58798/root (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 58798 root txt unknown /proc/58798/exe (readlink: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 58798 root NOFD /proc/58798/fd (opendir: Permission denied) 2024-09-12T12:28:08.099 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 58829 root cwd unknown /proc/58829/cwd (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 58829 root rtd unknown /proc/58829/root (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 58829 root txt unknown /proc/58829/exe (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 58829 root NOFD /proc/58829/fd (opendir: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 64590 root cwd unknown /proc/64590/cwd (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 64590 root rtd unknown /proc/64590/root (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 64590 root txt unknown /proc/64590/exe (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 64590 root NOFD /proc/64590/fd (opendir: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 64592 root cwd unknown /proc/64592/cwd (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 64592 root rtd unknown /proc/64592/root (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 64592 root txt unknown /proc/64592/exe (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 64592 root NOFD /proc/64592/fd (opendir: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 ceph cwd unknown /proc/64594/cwd (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 ceph rtd unknown /proc/64594/root (readlink: Permission denied) 2024-09-12T12:28:08.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 ceph txt unknown /proc/64594/exe (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 ceph NOFD /proc/64594/fd (opendir: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64595 log ceph cwd unknown /proc/64594/task/64595/cwd (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64595 log ceph rtd unknown /proc/64594/task/64595/root (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64595 log ceph txt unknown /proc/64594/task/64595/exe (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64595 log ceph NOFD /proc/64594/task/64595/fd (opendir: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64597 msgr-work ceph cwd unknown /proc/64594/task/64597/cwd (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64597 msgr-work ceph rtd unknown /proc/64594/task/64597/root (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64597 msgr-work ceph txt unknown /proc/64594/task/64597/exe (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64597 msgr-work ceph NOFD /proc/64594/task/64597/fd (opendir: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64598 msgr-work ceph cwd unknown /proc/64594/task/64598/cwd (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64598 msgr-work ceph rtd unknown /proc/64594/task/64598/root (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64598 msgr-work ceph txt unknown /proc/64594/task/64598/exe (readlink: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64598 msgr-work ceph NOFD /proc/64594/task/64598/fd (opendir: Permission denied) 2024-09-12T12:28:08.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64599 msgr-work ceph cwd unknown /proc/64594/task/64599/cwd (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64599 msgr-work ceph rtd unknown /proc/64594/task/64599/root (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64599 msgr-work ceph txt unknown /proc/64594/task/64599/exe (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64599 msgr-work ceph NOFD /proc/64594/task/64599/fd (opendir: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64603 service ceph cwd unknown /proc/64594/task/64603/cwd (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64603 service ceph rtd unknown /proc/64594/task/64603/root (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64603 service ceph txt unknown /proc/64594/task/64603/exe (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64603 service ceph NOFD /proc/64594/task/64603/fd (opendir: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64604 admin_soc ceph cwd unknown /proc/64594/task/64604/cwd (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64604 admin_soc ceph rtd unknown /proc/64594/task/64604/root (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64604 admin_soc ceph txt unknown /proc/64594/task/64604/exe (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64604 admin_soc ceph NOFD /proc/64594/task/64604/fd (opendir: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64936 signal_ha ceph cwd unknown /proc/64594/task/64936/cwd (readlink: Permission denied) 2024-09-12T12:28:08.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64936 signal_ha ceph rtd unknown /proc/64594/task/64936/root (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64936 signal_ha ceph txt unknown /proc/64594/task/64936/exe (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64936 signal_ha ceph NOFD /proc/64594/task/64936/fd (opendir: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64937 io_contex ceph cwd unknown /proc/64594/task/64937/cwd (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64937 io_contex ceph rtd unknown /proc/64594/task/64937/root (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64937 io_contex ceph txt unknown /proc/64594/task/64937/exe (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64937 io_contex ceph NOFD /proc/64594/task/64937/fd (opendir: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64938 io_contex ceph cwd unknown /proc/64594/task/64938/cwd (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64938 io_contex ceph rtd unknown /proc/64594/task/64938/root (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64938 io_contex ceph txt unknown /proc/64594/task/64938/exe (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64938 io_contex ceph NOFD /proc/64594/task/64938/fd (opendir: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64959 OpHistory ceph cwd unknown /proc/64594/task/64959/cwd (readlink: Permission denied) 2024-09-12T12:28:08.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64959 OpHistory ceph rtd unknown /proc/64594/task/64959/root (readlink: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64959 OpHistory ceph txt unknown /proc/64594/task/64959/exe (readlink: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64959 OpHistory ceph NOFD /proc/64594/task/64959/fd (opendir: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64960 ceph_time ceph cwd unknown /proc/64594/task/64960/cwd (readlink: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64960 ceph_time ceph rtd unknown /proc/64594/task/64960/root (readlink: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64960 ceph_time ceph txt unknown /proc/64594/task/64960/exe (readlink: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64960 ceph_time ceph NOFD /proc/64594/task/64960/fd (opendir: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64980 ceph-osd ceph cwd unknown /proc/64594/task/64980/cwd (readlink: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64980 ceph-osd ceph rtd unknown /proc/64594/task/64980/root (readlink: Permission denied) 2024-09-12T12:28:08.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64980 ceph-osd ceph txt unknown /proc/64594/task/64980/exe (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 64980 ceph-osd ceph NOFD /proc/64594/task/64980/fd (opendir: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65040 ceph-osd ceph cwd unknown /proc/64594/task/65040/cwd (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65040 ceph-osd ceph rtd unknown /proc/64594/task/65040/root (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65040 ceph-osd ceph txt unknown /proc/64594/task/65040/exe (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65040 ceph-osd ceph NOFD /proc/64594/task/65040/fd (opendir: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65069 ceph-osd ceph cwd unknown /proc/64594/task/65069/cwd (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65069 ceph-osd ceph rtd unknown /proc/64594/task/65069/root (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65069 ceph-osd ceph txt unknown /proc/64594/task/65069/exe (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65069 ceph-osd ceph NOFD /proc/64594/task/65069/fd (opendir: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65078 ceph-osd ceph cwd unknown /proc/64594/task/65078/cwd (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65078 ceph-osd ceph rtd unknown /proc/64594/task/65078/root (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65078 ceph-osd ceph txt unknown /proc/64594/task/65078/exe (readlink: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65078 ceph-osd ceph NOFD /proc/64594/task/65078/fd (opendir: Permission denied) 2024-09-12T12:28:08.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65136 ceph-osd ceph cwd unknown /proc/64594/task/65136/cwd (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65136 ceph-osd ceph rtd unknown /proc/64594/task/65136/root (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65136 ceph-osd ceph txt unknown /proc/64594/task/65136/exe (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65136 ceph-osd ceph NOFD /proc/64594/task/65136/fd (opendir: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65158 ceph-osd ceph cwd unknown /proc/64594/task/65158/cwd (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65158 ceph-osd ceph rtd unknown /proc/64594/task/65158/root (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65158 ceph-osd ceph txt unknown /proc/64594/task/65158/exe (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65158 ceph-osd ceph NOFD /proc/64594/task/65158/fd (opendir: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65164 ceph-osd ceph cwd unknown /proc/64594/task/65164/cwd (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65164 ceph-osd ceph rtd unknown /proc/64594/task/65164/root (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65164 ceph-osd ceph txt unknown /proc/64594/task/65164/exe (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65164 ceph-osd ceph NOFD /proc/64594/task/65164/fd (opendir: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65168 ceph-osd ceph cwd unknown /proc/64594/task/65168/cwd (readlink: Permission denied) 2024-09-12T12:28:08.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65168 ceph-osd ceph rtd unknown /proc/64594/task/65168/root (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65168 ceph-osd ceph txt unknown /proc/64594/task/65168/exe (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65168 ceph-osd ceph NOFD /proc/64594/task/65168/fd (opendir: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65169 ceph-osd ceph cwd unknown /proc/64594/task/65169/cwd (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65169 ceph-osd ceph rtd unknown /proc/64594/task/65169/root (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65169 ceph-osd ceph txt unknown /proc/64594/task/65169/exe (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65169 ceph-osd ceph NOFD /proc/64594/task/65169/fd (opendir: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65170 safe_time ceph cwd unknown /proc/64594/task/65170/cwd (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65170 safe_time ceph rtd unknown /proc/64594/task/65170/root (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65170 safe_time ceph txt unknown /proc/64594/task/65170/exe (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65170 safe_time ceph NOFD /proc/64594/task/65170/fd (opendir: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65171 safe_time ceph cwd unknown /proc/64594/task/65171/cwd (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65171 safe_time ceph rtd unknown /proc/64594/task/65171/root (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65171 safe_time ceph txt unknown /proc/64594/task/65171/exe (readlink: Permission denied) 2024-09-12T12:28:08.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65171 safe_time ceph NOFD /proc/64594/task/65171/fd (opendir: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65172 safe_time ceph cwd unknown /proc/64594/task/65172/cwd (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65172 safe_time ceph rtd unknown /proc/64594/task/65172/root (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65172 safe_time ceph txt unknown /proc/64594/task/65172/exe (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65172 safe_time ceph NOFD /proc/64594/task/65172/fd (opendir: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65173 safe_time ceph cwd unknown /proc/64594/task/65173/cwd (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65173 safe_time ceph rtd unknown /proc/64594/task/65173/root (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65173 safe_time ceph txt unknown /proc/64594/task/65173/exe (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65173 safe_time ceph NOFD /proc/64594/task/65173/fd (opendir: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65174 fn_anonym ceph cwd unknown /proc/64594/task/65174/cwd (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65174 fn_anonym ceph rtd unknown /proc/64594/task/65174/root (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65174 fn_anonym ceph txt unknown /proc/64594/task/65174/exe (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65174 fn_anonym ceph NOFD /proc/64594/task/65174/fd (opendir: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65290 rocksdb:l ceph cwd unknown /proc/64594/task/65290/cwd (readlink: Permission denied) 2024-09-12T12:28:08.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65290 rocksdb:l ceph rtd unknown /proc/64594/task/65290/root (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65290 rocksdb:l ceph txt unknown /proc/64594/task/65290/exe (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65290 rocksdb:l ceph NOFD /proc/64594/task/65290/fd (opendir: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65291 rocksdb:l ceph cwd unknown /proc/64594/task/65291/cwd (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65291 rocksdb:l ceph rtd unknown /proc/64594/task/65291/root (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65291 rocksdb:l ceph txt unknown /proc/64594/task/65291/exe (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65291 rocksdb:l ceph NOFD /proc/64594/task/65291/fd (opendir: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65292 rocksdb:l ceph cwd unknown /proc/64594/task/65292/cwd (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65292 rocksdb:l ceph rtd unknown /proc/64594/task/65292/root (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65292 rocksdb:l ceph txt unknown /proc/64594/task/65292/exe (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65292 rocksdb:l ceph NOFD /proc/64594/task/65292/fd (opendir: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65293 rocksdb:h ceph cwd unknown /proc/64594/task/65293/cwd (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65293 rocksdb:h ceph rtd unknown /proc/64594/task/65293/root (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65293 rocksdb:h ceph txt unknown /proc/64594/task/65293/exe (readlink: Permission denied) 2024-09-12T12:28:08.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65293 rocksdb:h ceph NOFD /proc/64594/task/65293/fd (opendir: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65718 bstore_ai ceph cwd unknown /proc/64594/task/65718/cwd (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65718 bstore_ai ceph rtd unknown /proc/64594/task/65718/root (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65718 bstore_ai ceph txt unknown /proc/64594/task/65718/exe (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65718 bstore_ai ceph NOFD /proc/64594/task/65718/fd (opendir: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65912 bstore_ai ceph cwd unknown /proc/64594/task/65912/cwd (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65912 bstore_ai ceph rtd unknown /proc/64594/task/65912/root (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65912 bstore_ai ceph txt unknown /proc/64594/task/65912/exe (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 65912 bstore_ai ceph NOFD /proc/64594/task/65912/fd (opendir: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66096 ceph-osd ceph cwd unknown /proc/64594/task/66096/cwd (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66096 ceph-osd ceph rtd unknown /proc/64594/task/66096/root (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66096 ceph-osd ceph txt unknown /proc/64594/task/66096/exe (readlink: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66096 ceph-osd ceph NOFD /proc/64594/task/66096/fd (opendir: Permission denied) 2024-09-12T12:28:08.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66097 cfin ceph cwd unknown /proc/64594/task/66097/cwd (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66097 cfin ceph rtd unknown /proc/64594/task/66097/root (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66097 cfin ceph txt unknown /proc/64594/task/66097/exe (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66097 cfin ceph NOFD /proc/64594/task/66097/fd (opendir: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66098 bstore_kv ceph cwd unknown /proc/64594/task/66098/cwd (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66098 bstore_kv ceph rtd unknown /proc/64594/task/66098/root (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66098 bstore_kv ceph txt unknown /proc/64594/task/66098/exe (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66098 bstore_kv ceph NOFD /proc/64594/task/66098/fd (opendir: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66099 bstore_kv ceph cwd unknown /proc/64594/task/66099/cwd (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66099 bstore_kv ceph rtd unknown /proc/64594/task/66099/root (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66099 bstore_kv ceph txt unknown /proc/64594/task/66099/exe (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66099 bstore_kv ceph NOFD /proc/64594/task/66099/fd (opendir: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66100 bstore_me ceph cwd unknown /proc/64594/task/66100/cwd (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66100 bstore_me ceph rtd unknown /proc/64594/task/66100/root (readlink: Permission denied) 2024-09-12T12:28:08.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66100 bstore_me ceph txt unknown /proc/64594/task/66100/exe (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66100 bstore_me ceph NOFD /proc/64594/task/66100/fd (opendir: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66101 ms_dispat ceph cwd unknown /proc/64594/task/66101/cwd (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66101 ms_dispat ceph rtd unknown /proc/64594/task/66101/root (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66101 ms_dispat ceph txt unknown /proc/64594/task/66101/exe (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66101 ms_dispat ceph NOFD /proc/64594/task/66101/fd (opendir: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66102 ms_local ceph cwd unknown /proc/64594/task/66102/cwd (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66102 ms_local ceph rtd unknown /proc/64594/task/66102/root (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66102 ms_local ceph txt unknown /proc/64594/task/66102/exe (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66102 ms_local ceph NOFD /proc/64594/task/66102/fd (opendir: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66103 safe_time ceph cwd unknown /proc/64594/task/66103/cwd (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66103 safe_time ceph rtd unknown /proc/64594/task/66103/root (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66103 safe_time ceph txt unknown /proc/64594/task/66103/exe (readlink: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66103 safe_time ceph NOFD /proc/64594/task/66103/fd (opendir: Permission denied) 2024-09-12T12:28:08.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66104 safe_time ceph cwd unknown /proc/64594/task/66104/cwd (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66104 safe_time ceph rtd unknown /proc/64594/task/66104/root (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66104 safe_time ceph txt unknown /proc/64594/task/66104/exe (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66104 safe_time ceph NOFD /proc/64594/task/66104/fd (opendir: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66105 ms_dispat ceph cwd unknown /proc/64594/task/66105/cwd (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66105 ms_dispat ceph rtd unknown /proc/64594/task/66105/root (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66105 ms_dispat ceph txt unknown /proc/64594/task/66105/exe (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66105 ms_dispat ceph NOFD /proc/64594/task/66105/fd (opendir: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66106 ms_local ceph cwd unknown /proc/64594/task/66106/cwd (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66106 ms_local ceph rtd unknown /proc/64594/task/66106/root (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66106 ms_local ceph txt unknown /proc/64594/task/66106/exe (readlink: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66106 ms_local ceph NOFD /proc/64594/task/66106/fd (opendir: Permission denied) 2024-09-12T12:28:08.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66107 ms_dispat ceph cwd unknown /proc/64594/task/66107/cwd (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66107 ms_dispat ceph rtd unknown /proc/64594/task/66107/root (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66107 ms_dispat ceph txt unknown /proc/64594/task/66107/exe (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66107 ms_dispat ceph NOFD /proc/64594/task/66107/fd (opendir: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66108 ms_local ceph cwd unknown /proc/64594/task/66108/cwd (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66108 ms_local ceph rtd unknown /proc/64594/task/66108/root (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66108 ms_local ceph txt unknown /proc/64594/task/66108/exe (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66108 ms_local ceph NOFD /proc/64594/task/66108/fd (opendir: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66109 ms_dispat ceph cwd unknown /proc/64594/task/66109/cwd (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66109 ms_dispat ceph rtd unknown /proc/64594/task/66109/root (readlink: Permission denied) 2024-09-12T12:28:08.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66109 ms_dispat ceph txt unknown /proc/64594/task/66109/exe (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66109 ms_dispat ceph NOFD /proc/64594/task/66109/fd (opendir: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66110 ms_local ceph cwd unknown /proc/64594/task/66110/cwd (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66110 ms_local ceph rtd unknown /proc/64594/task/66110/root (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66110 ms_local ceph txt unknown /proc/64594/task/66110/exe (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66110 ms_local ceph NOFD /proc/64594/task/66110/fd (opendir: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66111 ms_dispat ceph cwd unknown /proc/64594/task/66111/cwd (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66111 ms_dispat ceph rtd unknown /proc/64594/task/66111/root (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66111 ms_dispat ceph txt unknown /proc/64594/task/66111/exe (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66111 ms_dispat ceph NOFD /proc/64594/task/66111/fd (opendir: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66112 ms_local ceph cwd unknown /proc/64594/task/66112/cwd (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66112 ms_local ceph rtd unknown /proc/64594/task/66112/root (readlink: Permission denied) 2024-09-12T12:28:08.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66112 ms_local ceph txt unknown /proc/64594/task/66112/exe (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66112 ms_local ceph NOFD /proc/64594/task/66112/fd (opendir: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66113 ms_dispat ceph cwd unknown /proc/64594/task/66113/cwd (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66113 ms_dispat ceph rtd unknown /proc/64594/task/66113/root (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66113 ms_dispat ceph txt unknown /proc/64594/task/66113/exe (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66113 ms_dispat ceph NOFD /proc/64594/task/66113/fd (opendir: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66114 ms_local ceph cwd unknown /proc/64594/task/66114/cwd (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66114 ms_local ceph rtd unknown /proc/64594/task/66114/root (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66114 ms_local ceph txt unknown /proc/64594/task/66114/exe (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66114 ms_local ceph NOFD /proc/64594/task/66114/fd (opendir: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66115 ms_dispat ceph cwd unknown /proc/64594/task/66115/cwd (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66115 ms_dispat ceph rtd unknown /proc/64594/task/66115/root (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66115 ms_dispat ceph txt unknown /proc/64594/task/66115/exe (readlink: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66115 ms_dispat ceph NOFD /proc/64594/task/66115/fd (opendir: Permission denied) 2024-09-12T12:28:08.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66116 ms_local ceph cwd unknown /proc/64594/task/66116/cwd (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66116 ms_local ceph rtd unknown /proc/64594/task/66116/root (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66116 ms_local ceph txt unknown /proc/64594/task/66116/exe (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66116 ms_local ceph NOFD /proc/64594/task/66116/fd (opendir: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66117 fn_anonym ceph cwd unknown /proc/64594/task/66117/cwd (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66117 fn_anonym ceph rtd unknown /proc/64594/task/66117/root (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66117 fn_anonym ceph txt unknown /proc/64594/task/66117/exe (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66117 fn_anonym ceph NOFD /proc/64594/task/66117/fd (opendir: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66118 finisher ceph cwd unknown /proc/64594/task/66118/cwd (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66118 finisher ceph rtd unknown /proc/64594/task/66118/root (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66118 finisher ceph txt unknown /proc/64594/task/66118/exe (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66118 finisher ceph NOFD /proc/64594/task/66118/fd (opendir: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66119 safe_time ceph cwd unknown /proc/64594/task/66119/cwd (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66119 safe_time ceph rtd unknown /proc/64594/task/66119/root (readlink: Permission denied) 2024-09-12T12:28:08.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66119 safe_time ceph txt unknown /proc/64594/task/66119/exe (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66119 safe_time ceph NOFD /proc/64594/task/66119/fd (opendir: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66120 safe_time ceph cwd unknown /proc/64594/task/66120/cwd (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66120 safe_time ceph rtd unknown /proc/64594/task/66120/root (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66120 safe_time ceph txt unknown /proc/64594/task/66120/exe (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66120 safe_time ceph NOFD /proc/64594/task/66120/fd (opendir: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66121 ceph-osd ceph cwd unknown /proc/64594/task/66121/cwd (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66121 ceph-osd ceph rtd unknown /proc/64594/task/66121/root (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66121 ceph-osd ceph txt unknown /proc/64594/task/66121/exe (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66121 ceph-osd ceph NOFD /proc/64594/task/66121/fd (opendir: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66122 osd_srv_a ceph cwd unknown /proc/64594/task/66122/cwd (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66122 osd_srv_a ceph rtd unknown /proc/64594/task/66122/root (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66122 osd_srv_a ceph txt unknown /proc/64594/task/66122/exe (readlink: Permission denied) 2024-09-12T12:28:08.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66122 osd_srv_a ceph NOFD /proc/64594/task/66122/fd (opendir: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66123 tp_osd_tp ceph cwd unknown /proc/64594/task/66123/cwd (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66123 tp_osd_tp ceph rtd unknown /proc/64594/task/66123/root (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66123 tp_osd_tp ceph txt unknown /proc/64594/task/66123/exe (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66123 tp_osd_tp ceph NOFD /proc/64594/task/66123/fd (opendir: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66124 tp_osd_tp ceph cwd unknown /proc/64594/task/66124/cwd (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66124 tp_osd_tp ceph rtd unknown /proc/64594/task/66124/root (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66124 tp_osd_tp ceph txt unknown /proc/64594/task/66124/exe (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66124 tp_osd_tp ceph NOFD /proc/64594/task/66124/fd (opendir: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66125 tp_osd_tp ceph cwd unknown /proc/64594/task/66125/cwd (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66125 tp_osd_tp ceph rtd unknown /proc/64594/task/66125/root (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66125 tp_osd_tp ceph txt unknown /proc/64594/task/66125/exe (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66125 tp_osd_tp ceph NOFD /proc/64594/task/66125/fd (opendir: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66126 tp_osd_tp ceph cwd unknown /proc/64594/task/66126/cwd (readlink: Permission denied) 2024-09-12T12:28:08.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66126 tp_osd_tp ceph rtd unknown /proc/64594/task/66126/root (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66126 tp_osd_tp ceph txt unknown /proc/64594/task/66126/exe (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66126 tp_osd_tp ceph NOFD /proc/64594/task/66126/fd (opendir: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66127 tp_osd_tp ceph cwd unknown /proc/64594/task/66127/cwd (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66127 tp_osd_tp ceph rtd unknown /proc/64594/task/66127/root (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66127 tp_osd_tp ceph txt unknown /proc/64594/task/66127/exe (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66127 tp_osd_tp ceph NOFD /proc/64594/task/66127/fd (opendir: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66128 tp_osd_tp ceph cwd unknown /proc/64594/task/66128/cwd (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66128 tp_osd_tp ceph rtd unknown /proc/64594/task/66128/root (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66128 tp_osd_tp ceph txt unknown /proc/64594/task/66128/exe (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66128 tp_osd_tp ceph NOFD /proc/64594/task/66128/fd (opendir: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66129 tp_osd_tp ceph cwd unknown /proc/64594/task/66129/cwd (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66129 tp_osd_tp ceph rtd unknown /proc/64594/task/66129/root (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66129 tp_osd_tp ceph txt unknown /proc/64594/task/66129/exe (readlink: Permission denied) 2024-09-12T12:28:08.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66129 tp_osd_tp ceph NOFD /proc/64594/task/66129/fd (opendir: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66130 tp_osd_tp ceph cwd unknown /proc/64594/task/66130/cwd (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66130 tp_osd_tp ceph rtd unknown /proc/64594/task/66130/root (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66130 tp_osd_tp ceph txt unknown /proc/64594/task/66130/exe (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66130 tp_osd_tp ceph NOFD /proc/64594/task/66130/fd (opendir: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66131 tp_osd_tp ceph cwd unknown /proc/64594/task/66131/cwd (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66131 tp_osd_tp ceph rtd unknown /proc/64594/task/66131/root (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66131 tp_osd_tp ceph txt unknown /proc/64594/task/66131/exe (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66131 tp_osd_tp ceph NOFD /proc/64594/task/66131/fd (opendir: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66132 tp_osd_tp ceph cwd unknown /proc/64594/task/66132/cwd (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66132 tp_osd_tp ceph rtd unknown /proc/64594/task/66132/root (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66132 tp_osd_tp ceph txt unknown /proc/64594/task/66132/exe (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66132 tp_osd_tp ceph NOFD /proc/64594/task/66132/fd (opendir: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66133 tp_osd_tp ceph cwd unknown /proc/64594/task/66133/cwd (readlink: Permission denied) 2024-09-12T12:28:08.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66133 tp_osd_tp ceph rtd unknown /proc/64594/task/66133/root (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66133 tp_osd_tp ceph txt unknown /proc/64594/task/66133/exe (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66133 tp_osd_tp ceph NOFD /proc/64594/task/66133/fd (opendir: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66134 tp_osd_tp ceph cwd unknown /proc/64594/task/66134/cwd (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66134 tp_osd_tp ceph rtd unknown /proc/64594/task/66134/root (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66134 tp_osd_tp ceph txt unknown /proc/64594/task/66134/exe (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66134 tp_osd_tp ceph NOFD /proc/64594/task/66134/fd (opendir: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66135 tp_osd_tp ceph cwd unknown /proc/64594/task/66135/cwd (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66135 tp_osd_tp ceph rtd unknown /proc/64594/task/66135/root (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66135 tp_osd_tp ceph txt unknown /proc/64594/task/66135/exe (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66135 tp_osd_tp ceph NOFD /proc/64594/task/66135/fd (opendir: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66136 tp_osd_tp ceph cwd unknown /proc/64594/task/66136/cwd (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66136 tp_osd_tp ceph rtd unknown /proc/64594/task/66136/root (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66136 tp_osd_tp ceph txt unknown /proc/64594/task/66136/exe (readlink: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66136 tp_osd_tp ceph NOFD /proc/64594/task/66136/fd (opendir: Permission denied) 2024-09-12T12:28:08.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66137 tp_osd_tp ceph cwd unknown /proc/64594/task/66137/cwd (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66137 tp_osd_tp ceph rtd unknown /proc/64594/task/66137/root (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66137 tp_osd_tp ceph txt unknown /proc/64594/task/66137/exe (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66137 tp_osd_tp ceph NOFD /proc/64594/task/66137/fd (opendir: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66138 tp_osd_tp ceph cwd unknown /proc/64594/task/66138/cwd (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66138 tp_osd_tp ceph rtd unknown /proc/64594/task/66138/root (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66138 tp_osd_tp ceph txt unknown /proc/64594/task/66138/exe (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66138 tp_osd_tp ceph NOFD /proc/64594/task/66138/fd (opendir: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66139 osd_srv_h ceph cwd unknown /proc/64594/task/66139/cwd (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66139 osd_srv_h ceph rtd unknown /proc/64594/task/66139/root (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66139 osd_srv_h ceph txt unknown /proc/64594/task/66139/exe (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-osd 64594 66139 osd_srv_h ceph NOFD /proc/64594/task/66139/fd (opendir: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 65664 root cwd unknown /proc/65664/cwd (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 65664 root rtd unknown /proc/65664/root (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 65664 root txt unknown /proc/65664/exe (readlink: Permission denied) 2024-09-12T12:28:08.123 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 65664 root NOFD /proc/65664/fd (opendir: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 65692 root cwd unknown /proc/65692/cwd (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 65692 root rtd unknown /proc/65692/root (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 65692 root txt unknown /proc/65692/exe (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 65692 root NOFD /proc/65692/fd (opendir: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69268 root cwd unknown /proc/69268/cwd (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69268 root rtd unknown /proc/69268/root (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69268 root txt unknown /proc/69268/exe (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69268 root NOFD /proc/69268/fd (opendir: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69284 root cwd unknown /proc/69284/cwd (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69284 root rtd unknown /proc/69284/root (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69284 root txt unknown /proc/69284/exe (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69284 root NOFD /proc/69284/fd (opendir: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69291 root cwd unknown /proc/69291/cwd (readlink: Permission denied) 2024-09-12T12:28:08.124 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69291 root rtd unknown /proc/69291/root (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69291 root txt unknown /proc/69291/exe (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69291 root NOFD /proc/69291/fd (opendir: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69303 root cwd unknown /proc/69303/cwd (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69303 root rtd unknown /proc/69303/root (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69303 root txt unknown /proc/69303/exe (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69303 root NOFD /proc/69303/fd (opendir: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69305 root cwd unknown /proc/69305/cwd (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69305 root rtd unknown /proc/69305/root (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69305 root txt unknown /proc/69305/exe (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69305 root NOFD /proc/69305/fd (opendir: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69321 root cwd unknown /proc/69321/cwd (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69321 root rtd unknown /proc/69321/root (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69321 root txt unknown /proc/69321/exe (readlink: Permission denied) 2024-09-12T12:28:08.125 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 69321 root NOFD /proc/69321/fd (opendir: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69324 root cwd unknown /proc/69324/cwd (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69324 root rtd unknown /proc/69324/root (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69324 root txt unknown /proc/69324/exe (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69324 root NOFD /proc/69324/fd (opendir: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69339 root cwd unknown /proc/69339/cwd (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69339 root rtd unknown /proc/69339/root (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69339 root txt unknown /proc/69339/exe (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:journalct 69339 root NOFD /proc/69339/fd (opendir: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 69850 root cwd unknown /proc/69850/cwd (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 69850 root rtd unknown /proc/69850/root (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 69850 root txt unknown /proc/69850/exe (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 69850 root NOFD /proc/69850/fd (opendir: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 69853 root cwd unknown /proc/69853/cwd (readlink: Permission denied) 2024-09-12T12:28:08.126 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 69853 root rtd unknown /proc/69853/root (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 69853 root txt unknown /proc/69853/exe (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 69853 root NOFD /proc/69853/fd (opendir: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 ceph cwd unknown /proc/69862/cwd (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 ceph rtd unknown /proc/69862/root (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 ceph txt unknown /proc/69862/exe (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 ceph NOFD /proc/69862/fd (opendir: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69868 log ceph cwd unknown /proc/69862/task/69868/cwd (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69868 log ceph rtd unknown /proc/69862/task/69868/root (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69868 log ceph txt unknown /proc/69862/task/69868/exe (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69868 log ceph NOFD /proc/69862/task/69868/fd (opendir: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69870 msgr-work ceph cwd unknown /proc/69862/task/69870/cwd (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69870 msgr-work ceph rtd unknown /proc/69862/task/69870/root (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69870 msgr-work ceph txt unknown /proc/69862/task/69870/exe (readlink: Permission denied) 2024-09-12T12:28:08.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69870 msgr-work ceph NOFD /proc/69862/task/69870/fd (opendir: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69871 msgr-work ceph cwd unknown /proc/69862/task/69871/cwd (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69871 msgr-work ceph rtd unknown /proc/69862/task/69871/root (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69871 msgr-work ceph txt unknown /proc/69862/task/69871/exe (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69871 msgr-work ceph NOFD /proc/69862/task/69871/fd (opendir: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69872 msgr-work ceph cwd unknown /proc/69862/task/69872/cwd (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69872 msgr-work ceph rtd unknown /proc/69862/task/69872/root (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69872 msgr-work ceph txt unknown /proc/69862/task/69872/exe (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69872 msgr-work ceph NOFD /proc/69862/task/69872/fd (opendir: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69876 service ceph cwd unknown /proc/69862/task/69876/cwd (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69876 service ceph rtd unknown /proc/69862/task/69876/root (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69876 service ceph txt unknown /proc/69862/task/69876/exe (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69876 service ceph NOFD /proc/69862/task/69876/fd (opendir: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69877 admin_soc ceph cwd unknown /proc/69862/task/69877/cwd (readlink: Permission denied) 2024-09-12T12:28:08.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69877 admin_soc ceph rtd unknown /proc/69862/task/69877/root (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69877 admin_soc ceph txt unknown /proc/69862/task/69877/exe (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69877 admin_soc ceph NOFD /proc/69862/task/69877/fd (opendir: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69878 signal_ha ceph cwd unknown /proc/69862/task/69878/cwd (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69878 signal_ha ceph rtd unknown /proc/69862/task/69878/root (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69878 signal_ha ceph txt unknown /proc/69862/task/69878/exe (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69878 signal_ha ceph NOFD /proc/69862/task/69878/fd (opendir: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69879 io_contex ceph cwd unknown /proc/69862/task/69879/cwd (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69879 io_contex ceph rtd unknown /proc/69862/task/69879/root (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69879 io_contex ceph txt unknown /proc/69862/task/69879/exe (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69879 io_contex ceph NOFD /proc/69862/task/69879/fd (opendir: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69880 io_contex ceph cwd unknown /proc/69862/task/69880/cwd (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69880 io_contex ceph rtd unknown /proc/69862/task/69880/root (readlink: Permission denied) 2024-09-12T12:28:08.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69880 io_contex ceph txt unknown /proc/69862/task/69880/exe (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69880 io_contex ceph NOFD /proc/69862/task/69880/fd (opendir: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69881 ms_dispat ceph cwd unknown /proc/69862/task/69881/cwd (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69881 ms_dispat ceph rtd unknown /proc/69862/task/69881/root (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69881 ms_dispat ceph txt unknown /proc/69862/task/69881/exe (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69881 ms_dispat ceph NOFD /proc/69862/task/69881/fd (opendir: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69882 ms_local ceph cwd unknown /proc/69862/task/69882/cwd (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69882 ms_local ceph rtd unknown /proc/69862/task/69882/root (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69882 ms_local ceph txt unknown /proc/69862/task/69882/exe (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69882 ms_local ceph NOFD /proc/69862/task/69882/fd (opendir: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69883 safe_time ceph cwd unknown /proc/69862/task/69883/cwd (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69883 safe_time ceph rtd unknown /proc/69862/task/69883/root (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69883 safe_time ceph txt unknown /proc/69862/task/69883/exe (readlink: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69883 safe_time ceph NOFD /proc/69862/task/69883/fd (opendir: Permission denied) 2024-09-12T12:28:08.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69884 safe_time ceph cwd unknown /proc/69862/task/69884/cwd (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69884 safe_time ceph rtd unknown /proc/69862/task/69884/root (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69884 safe_time ceph txt unknown /proc/69862/task/69884/exe (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69884 safe_time ceph NOFD /proc/69862/task/69884/fd (opendir: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69885 ceph-mds ceph cwd unknown /proc/69862/task/69885/cwd (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69885 ceph-mds ceph rtd unknown /proc/69862/task/69885/root (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69885 ceph-mds ceph txt unknown /proc/69862/task/69885/exe (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69885 ceph-mds ceph NOFD /proc/69862/task/69885/fd (opendir: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69995 safe_time ceph cwd unknown /proc/69862/task/69995/cwd (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69995 safe_time ceph rtd unknown /proc/69862/task/69995/root (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69995 safe_time ceph txt unknown /proc/69862/task/69995/exe (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 69862 69995 safe_time ceph NOFD /proc/69862/task/69995/fd (opendir: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 70269 root cwd unknown /proc/70269/cwd (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 70269 root rtd unknown /proc/70269/root (readlink: Permission denied) 2024-09-12T12:28:08.131 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 70269 root txt unknown /proc/70269/exe (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 70269 root NOFD /proc/70269/fd (opendir: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 70272 root cwd unknown /proc/70272/cwd (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 70272 root rtd unknown /proc/70272/root (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 70272 root txt unknown /proc/70272/exe (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 70272 root NOFD /proc/70272/fd (opendir: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 ceph cwd unknown /proc/70283/cwd (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 ceph rtd unknown /proc/70283/root (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 ceph txt unknown /proc/70283/exe (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 ceph NOFD /proc/70283/fd (opendir: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70284 log ceph cwd unknown /proc/70283/task/70284/cwd (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70284 log ceph rtd unknown /proc/70283/task/70284/root (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70284 log ceph txt unknown /proc/70283/task/70284/exe (readlink: Permission denied) 2024-09-12T12:28:08.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70284 log ceph NOFD /proc/70283/task/70284/fd (opendir: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70286 msgr-work ceph cwd unknown /proc/70283/task/70286/cwd (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70286 msgr-work ceph rtd unknown /proc/70283/task/70286/root (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70286 msgr-work ceph txt unknown /proc/70283/task/70286/exe (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70286 msgr-work ceph NOFD /proc/70283/task/70286/fd (opendir: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70287 msgr-work ceph cwd unknown /proc/70283/task/70287/cwd (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70287 msgr-work ceph rtd unknown /proc/70283/task/70287/root (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70287 msgr-work ceph txt unknown /proc/70283/task/70287/exe (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70287 msgr-work ceph NOFD /proc/70283/task/70287/fd (opendir: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70288 msgr-work ceph cwd unknown /proc/70283/task/70288/cwd (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70288 msgr-work ceph rtd unknown /proc/70283/task/70288/root (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70288 msgr-work ceph txt unknown /proc/70283/task/70288/exe (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70288 msgr-work ceph NOFD /proc/70283/task/70288/fd (opendir: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70292 service ceph cwd unknown /proc/70283/task/70292/cwd (readlink: Permission denied) 2024-09-12T12:28:08.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70292 service ceph rtd unknown /proc/70283/task/70292/root (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70292 service ceph txt unknown /proc/70283/task/70292/exe (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70292 service ceph NOFD /proc/70283/task/70292/fd (opendir: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70293 admin_soc ceph cwd unknown /proc/70283/task/70293/cwd (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70293 admin_soc ceph rtd unknown /proc/70283/task/70293/root (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70293 admin_soc ceph txt unknown /proc/70283/task/70293/exe (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70293 admin_soc ceph NOFD /proc/70283/task/70293/fd (opendir: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70294 signal_ha ceph cwd unknown /proc/70283/task/70294/cwd (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70294 signal_ha ceph rtd unknown /proc/70283/task/70294/root (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70294 signal_ha ceph txt unknown /proc/70283/task/70294/exe (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70294 signal_ha ceph NOFD /proc/70283/task/70294/fd (opendir: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70295 io_contex ceph cwd unknown /proc/70283/task/70295/cwd (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70295 io_contex ceph rtd unknown /proc/70283/task/70295/root (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70295 io_contex ceph txt unknown /proc/70283/task/70295/exe (readlink: Permission denied) 2024-09-12T12:28:08.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70295 io_contex ceph NOFD /proc/70283/task/70295/fd (opendir: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70296 io_contex ceph cwd unknown /proc/70283/task/70296/cwd (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70296 io_contex ceph rtd unknown /proc/70283/task/70296/root (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70296 io_contex ceph txt unknown /proc/70283/task/70296/exe (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70296 io_contex ceph NOFD /proc/70283/task/70296/fd (opendir: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70297 ms_dispat ceph cwd unknown /proc/70283/task/70297/cwd (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70297 ms_dispat ceph rtd unknown /proc/70283/task/70297/root (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70297 ms_dispat ceph txt unknown /proc/70283/task/70297/exe (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70297 ms_dispat ceph NOFD /proc/70283/task/70297/fd (opendir: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70298 ms_local ceph cwd unknown /proc/70283/task/70298/cwd (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70298 ms_local ceph rtd unknown /proc/70283/task/70298/root (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70298 ms_local ceph txt unknown /proc/70283/task/70298/exe (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70298 ms_local ceph NOFD /proc/70283/task/70298/fd (opendir: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70299 safe_time ceph cwd unknown /proc/70283/task/70299/cwd (readlink: Permission denied) 2024-09-12T12:28:08.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70299 safe_time ceph rtd unknown /proc/70283/task/70299/root (readlink: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70299 safe_time ceph txt unknown /proc/70283/task/70299/exe (readlink: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70299 safe_time ceph NOFD /proc/70283/task/70299/fd (opendir: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70300 safe_time ceph cwd unknown /proc/70283/task/70300/cwd (readlink: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70300 safe_time ceph rtd unknown /proc/70283/task/70300/root (readlink: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70300 safe_time ceph txt unknown /proc/70283/task/70300/exe (readlink: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70300 safe_time ceph NOFD /proc/70283/task/70300/fd (opendir: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70301 ceph-mds ceph cwd unknown /proc/70283/task/70301/cwd (readlink: Permission denied) 2024-09-12T12:28:08.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70301 ceph-mds ceph rtd unknown /proc/70283/task/70301/root (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70301 ceph-mds ceph txt unknown /proc/70283/task/70301/exe (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70301 ceph-mds ceph NOFD /proc/70283/task/70301/fd (opendir: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70375 safe_time ceph cwd unknown /proc/70283/task/70375/cwd (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70375 safe_time ceph rtd unknown /proc/70283/task/70375/root (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70375 safe_time ceph txt unknown /proc/70283/task/70375/exe (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 70283 70375 safe_time ceph NOFD /proc/70283/task/70375/fd (opendir: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 70342 root cwd unknown /proc/70342/cwd (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 70342 root rtd unknown /proc/70342/root (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 70342 root txt unknown /proc/70342/exe (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 70342 root NOFD /proc/70342/fd (opendir: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71041 root cwd unknown /proc/71041/cwd (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71041 root rtd unknown /proc/71041/root (readlink: Permission denied) 2024-09-12T12:28:08.137 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71041 root txt unknown /proc/71041/exe (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71041 root NOFD /proc/71041/fd (opendir: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71043 root cwd unknown /proc/71043/cwd (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71043 root rtd unknown /proc/71043/root (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71043 root txt unknown /proc/71043/exe (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71043 root NOFD /proc/71043/fd (opendir: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 ceph cwd unknown /proc/71045/cwd (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 ceph rtd unknown /proc/71045/root (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 ceph txt unknown /proc/71045/exe (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 ceph NOFD /proc/71045/fd (opendir: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71046 log ceph cwd unknown /proc/71045/task/71046/cwd (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71046 log ceph rtd unknown /proc/71045/task/71046/root (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71046 log ceph txt unknown /proc/71045/task/71046/exe (readlink: Permission denied) 2024-09-12T12:28:08.138 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71046 log ceph NOFD /proc/71045/task/71046/fd (opendir: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71048 msgr-work ceph cwd unknown /proc/71045/task/71048/cwd (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71048 msgr-work ceph rtd unknown /proc/71045/task/71048/root (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71048 msgr-work ceph txt unknown /proc/71045/task/71048/exe (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71048 msgr-work ceph NOFD /proc/71045/task/71048/fd (opendir: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71049 msgr-work ceph cwd unknown /proc/71045/task/71049/cwd (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71049 msgr-work ceph rtd unknown /proc/71045/task/71049/root (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71049 msgr-work ceph txt unknown /proc/71045/task/71049/exe (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71049 msgr-work ceph NOFD /proc/71045/task/71049/fd (opendir: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71050 msgr-work ceph cwd unknown /proc/71045/task/71050/cwd (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71050 msgr-work ceph rtd unknown /proc/71045/task/71050/root (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71050 msgr-work ceph txt unknown /proc/71045/task/71050/exe (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71050 msgr-work ceph NOFD /proc/71045/task/71050/fd (opendir: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71054 service ceph cwd unknown /proc/71045/task/71054/cwd (readlink: Permission denied) 2024-09-12T12:28:08.139 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71054 service ceph rtd unknown /proc/71045/task/71054/root (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71054 service ceph txt unknown /proc/71045/task/71054/exe (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71054 service ceph NOFD /proc/71045/task/71054/fd (opendir: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71055 admin_soc ceph cwd unknown /proc/71045/task/71055/cwd (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71055 admin_soc ceph rtd unknown /proc/71045/task/71055/root (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71055 admin_soc ceph txt unknown /proc/71045/task/71055/exe (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71055 admin_soc ceph NOFD /proc/71045/task/71055/fd (opendir: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71056 signal_ha ceph cwd unknown /proc/71045/task/71056/cwd (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71056 signal_ha ceph rtd unknown /proc/71045/task/71056/root (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71056 signal_ha ceph txt unknown /proc/71045/task/71056/exe (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71056 signal_ha ceph NOFD /proc/71045/task/71056/fd (opendir: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71057 io_contex ceph cwd unknown /proc/71045/task/71057/cwd (readlink: Permission denied) 2024-09-12T12:28:08.140 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71057 io_contex ceph rtd unknown /proc/71045/task/71057/root (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71057 io_contex ceph txt unknown /proc/71045/task/71057/exe (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71057 io_contex ceph NOFD /proc/71045/task/71057/fd (opendir: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71058 io_contex ceph cwd unknown /proc/71045/task/71058/cwd (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71058 io_contex ceph rtd unknown /proc/71045/task/71058/root (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71058 io_contex ceph txt unknown /proc/71045/task/71058/exe (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71058 io_contex ceph NOFD /proc/71045/task/71058/fd (opendir: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71059 ms_dispat ceph cwd unknown /proc/71045/task/71059/cwd (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71059 ms_dispat ceph rtd unknown /proc/71045/task/71059/root (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71059 ms_dispat ceph txt unknown /proc/71045/task/71059/exe (readlink: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71059 ms_dispat ceph NOFD /proc/71045/task/71059/fd (opendir: Permission denied) 2024-09-12T12:28:08.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71060 ms_local ceph cwd unknown /proc/71045/task/71060/cwd (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71060 ms_local ceph rtd unknown /proc/71045/task/71060/root (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71060 ms_local ceph txt unknown /proc/71045/task/71060/exe (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71060 ms_local ceph NOFD /proc/71045/task/71060/fd (opendir: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71061 safe_time ceph cwd unknown /proc/71045/task/71061/cwd (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71061 safe_time ceph rtd unknown /proc/71045/task/71061/root (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71061 safe_time ceph txt unknown /proc/71045/task/71061/exe (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71061 safe_time ceph NOFD /proc/71045/task/71061/fd (opendir: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71062 safe_time ceph cwd unknown /proc/71045/task/71062/cwd (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71062 safe_time ceph rtd unknown /proc/71045/task/71062/root (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71062 safe_time ceph txt unknown /proc/71045/task/71062/exe (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71062 safe_time ceph NOFD /proc/71045/task/71062/fd (opendir: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71063 ceph-mds ceph cwd unknown /proc/71045/task/71063/cwd (readlink: Permission denied) 2024-09-12T12:28:08.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71063 ceph-mds ceph rtd unknown /proc/71045/task/71063/root (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71063 ceph-mds ceph txt unknown /proc/71045/task/71063/exe (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71063 ceph-mds ceph NOFD /proc/71045/task/71063/fd (opendir: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71098 safe_time ceph cwd unknown /proc/71045/task/71098/cwd (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71098 safe_time ceph rtd unknown /proc/71045/task/71098/root (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71098 safe_time ceph txt unknown /proc/71045/task/71098/exe (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 71098 safe_time ceph NOFD /proc/71045/task/71098/fd (opendir: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75813 ceph_time ceph cwd unknown /proc/71045/task/75813/cwd (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75813 ceph_time ceph rtd unknown /proc/71045/task/75813/root (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75813 ceph_time ceph txt unknown /proc/71045/task/75813/exe (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75813 ceph_time ceph NOFD /proc/71045/task/75813/fd (opendir: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75815 OpHistory ceph cwd unknown /proc/71045/task/75815/cwd (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75815 OpHistory ceph rtd unknown /proc/71045/task/75815/root (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75815 OpHistory ceph txt unknown /proc/71045/task/75815/exe (readlink: Permission denied) 2024-09-12T12:28:08.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75815 OpHistory ceph NOFD /proc/71045/task/75815/fd (opendir: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75818 ms_dispat ceph cwd unknown /proc/71045/task/75818/cwd (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75818 ms_dispat ceph rtd unknown /proc/71045/task/75818/root (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75818 ms_dispat ceph txt unknown /proc/71045/task/75818/exe (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75818 ms_dispat ceph NOFD /proc/71045/task/75818/fd (opendir: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75819 ms_dispat ceph cwd unknown /proc/71045/task/75819/cwd (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75819 ms_dispat ceph rtd unknown /proc/71045/task/75819/root (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75819 ms_dispat ceph txt unknown /proc/71045/task/75819/exe (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75819 ms_dispat ceph NOFD /proc/71045/task/75819/fd (opendir: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75822 mds_rank_ ceph cwd unknown /proc/71045/task/75822/cwd (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75822 mds_rank_ ceph rtd unknown /proc/71045/task/75822/root (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75822 mds_rank_ ceph txt unknown /proc/71045/task/75822/exe (readlink: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75822 mds_rank_ ceph NOFD /proc/71045/task/75822/fd (opendir: Permission denied) 2024-09-12T12:28:08.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75825 PQ_Finish ceph cwd unknown /proc/71045/task/75825/cwd (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75825 PQ_Finish ceph rtd unknown /proc/71045/task/75825/root (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75825 PQ_Finish ceph txt unknown /proc/71045/task/75825/exe (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75825 PQ_Finish ceph NOFD /proc/71045/task/75825/fd (opendir: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75826 safe_time ceph cwd unknown /proc/71045/task/75826/cwd (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75826 safe_time ceph rtd unknown /proc/71045/task/75826/root (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75826 safe_time ceph txt unknown /proc/71045/task/75826/exe (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75826 safe_time ceph NOFD /proc/71045/task/75826/fd (opendir: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75828 MR_Finish ceph cwd unknown /proc/71045/task/75828/cwd (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75828 MR_Finish ceph rtd unknown /proc/71045/task/75828/root (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75828 MR_Finish ceph txt unknown /proc/71045/task/75828/exe (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75828 MR_Finish ceph NOFD /proc/71045/task/75828/fd (opendir: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75831 md_submit ceph cwd unknown /proc/71045/task/75831/cwd (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75831 md_submit ceph rtd unknown /proc/71045/task/75831/root (readlink: Permission denied) 2024-09-12T12:28:08.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75831 md_submit ceph txt unknown /proc/71045/task/75831/exe (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71045 75831 md_submit ceph NOFD /proc/71045/task/75831/fd (opendir: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71409 root cwd unknown /proc/71409/cwd (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71409 root rtd unknown /proc/71409/root (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71409 root txt unknown /proc/71409/exe (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 71409 root NOFD /proc/71409/fd (opendir: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71411 root cwd unknown /proc/71411/cwd (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71411 root rtd unknown /proc/71411/root (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71411 root txt unknown /proc/71411/exe (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:podman-in 71411 root NOFD /proc/71411/fd (opendir: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 ceph cwd unknown /proc/71413/cwd (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 ceph rtd unknown /proc/71413/root (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 ceph txt unknown /proc/71413/exe (readlink: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 ceph NOFD /proc/71413/fd (opendir: Permission denied) 2024-09-12T12:28:08.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71414 log ceph cwd unknown /proc/71413/task/71414/cwd (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71414 log ceph rtd unknown /proc/71413/task/71414/root (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71414 log ceph txt unknown /proc/71413/task/71414/exe (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71414 log ceph NOFD /proc/71413/task/71414/fd (opendir: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71416 msgr-work ceph cwd unknown /proc/71413/task/71416/cwd (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71416 msgr-work ceph rtd unknown /proc/71413/task/71416/root (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71416 msgr-work ceph txt unknown /proc/71413/task/71416/exe (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71416 msgr-work ceph NOFD /proc/71413/task/71416/fd (opendir: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71417 msgr-work ceph cwd unknown /proc/71413/task/71417/cwd (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71417 msgr-work ceph rtd unknown /proc/71413/task/71417/root (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71417 msgr-work ceph txt unknown /proc/71413/task/71417/exe (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71417 msgr-work ceph NOFD /proc/71413/task/71417/fd (opendir: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71418 msgr-work ceph cwd unknown /proc/71413/task/71418/cwd (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71418 msgr-work ceph rtd unknown /proc/71413/task/71418/root (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71418 msgr-work ceph txt unknown /proc/71413/task/71418/exe (readlink: Permission denied) 2024-09-12T12:28:08.147 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71418 msgr-work ceph NOFD /proc/71413/task/71418/fd (opendir: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71422 service ceph cwd unknown /proc/71413/task/71422/cwd (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71422 service ceph rtd unknown /proc/71413/task/71422/root (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71422 service ceph txt unknown /proc/71413/task/71422/exe (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71422 service ceph NOFD /proc/71413/task/71422/fd (opendir: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71423 admin_soc ceph cwd unknown /proc/71413/task/71423/cwd (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71423 admin_soc ceph rtd unknown /proc/71413/task/71423/root (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71423 admin_soc ceph txt unknown /proc/71413/task/71423/exe (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71423 admin_soc ceph NOFD /proc/71413/task/71423/fd (opendir: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71424 signal_ha ceph cwd unknown /proc/71413/task/71424/cwd (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71424 signal_ha ceph rtd unknown /proc/71413/task/71424/root (readlink: Permission denied) 2024-09-12T12:28:08.148 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71424 signal_ha ceph txt unknown /proc/71413/task/71424/exe (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71424 signal_ha ceph NOFD /proc/71413/task/71424/fd (opendir: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71425 io_contex ceph cwd unknown /proc/71413/task/71425/cwd (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71425 io_contex ceph rtd unknown /proc/71413/task/71425/root (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71425 io_contex ceph txt unknown /proc/71413/task/71425/exe (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71425 io_contex ceph NOFD /proc/71413/task/71425/fd (opendir: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71426 io_contex ceph cwd unknown /proc/71413/task/71426/cwd (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71426 io_contex ceph rtd unknown /proc/71413/task/71426/root (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71426 io_contex ceph txt unknown /proc/71413/task/71426/exe (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71426 io_contex ceph NOFD /proc/71413/task/71426/fd (opendir: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71427 ms_dispat ceph cwd unknown /proc/71413/task/71427/cwd (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71427 ms_dispat ceph rtd unknown /proc/71413/task/71427/root (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71427 ms_dispat ceph txt unknown /proc/71413/task/71427/exe (readlink: Permission denied) 2024-09-12T12:28:08.149 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71427 ms_dispat ceph NOFD /proc/71413/task/71427/fd (opendir: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71428 ms_local ceph cwd unknown /proc/71413/task/71428/cwd (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71428 ms_local ceph rtd unknown /proc/71413/task/71428/root (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71428 ms_local ceph txt unknown /proc/71413/task/71428/exe (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71428 ms_local ceph NOFD /proc/71413/task/71428/fd (opendir: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71429 safe_time ceph cwd unknown /proc/71413/task/71429/cwd (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71429 safe_time ceph rtd unknown /proc/71413/task/71429/root (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71429 safe_time ceph txt unknown /proc/71413/task/71429/exe (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71429 safe_time ceph NOFD /proc/71413/task/71429/fd (opendir: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71430 safe_time ceph cwd unknown /proc/71413/task/71430/cwd (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71430 safe_time ceph rtd unknown /proc/71413/task/71430/root (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71430 safe_time ceph txt unknown /proc/71413/task/71430/exe (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71430 safe_time ceph NOFD /proc/71413/task/71430/fd (opendir: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71431 ceph-mds ceph cwd unknown /proc/71413/task/71431/cwd (readlink: Permission denied) 2024-09-12T12:28:08.150 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71431 ceph-mds ceph rtd unknown /proc/71413/task/71431/root (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71431 ceph-mds ceph txt unknown /proc/71413/task/71431/exe (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71431 ceph-mds ceph NOFD /proc/71413/task/71431/fd (opendir: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71513 safe_time ceph cwd unknown /proc/71413/task/71513/cwd (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71513 safe_time ceph rtd unknown /proc/71413/task/71513/root (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71513 safe_time ceph txt unknown /proc/71413/task/71513/exe (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 71513 safe_time ceph NOFD /proc/71413/task/71513/fd (opendir: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75812 ceph_time ceph cwd unknown /proc/71413/task/75812/cwd (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75812 ceph_time ceph rtd unknown /proc/71413/task/75812/root (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75812 ceph_time ceph txt unknown /proc/71413/task/75812/exe (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75812 ceph_time ceph NOFD /proc/71413/task/75812/fd (opendir: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75814 OpHistory ceph cwd unknown /proc/71413/task/75814/cwd (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75814 OpHistory ceph rtd unknown /proc/71413/task/75814/root (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75814 OpHistory ceph txt unknown /proc/71413/task/75814/exe (readlink: Permission denied) 2024-09-12T12:28:08.151 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75814 OpHistory ceph NOFD /proc/71413/task/75814/fd (opendir: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75816 ms_dispat ceph cwd unknown /proc/71413/task/75816/cwd (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75816 ms_dispat ceph rtd unknown /proc/71413/task/75816/root (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75816 ms_dispat ceph txt unknown /proc/71413/task/75816/exe (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75816 ms_dispat ceph NOFD /proc/71413/task/75816/fd (opendir: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75817 ms_dispat ceph cwd unknown /proc/71413/task/75817/cwd (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75817 ms_dispat ceph rtd unknown /proc/71413/task/75817/root (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75817 ms_dispat ceph txt unknown /proc/71413/task/75817/exe (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75817 ms_dispat ceph NOFD /proc/71413/task/75817/fd (opendir: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75820 mds_rank_ ceph cwd unknown /proc/71413/task/75820/cwd (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75820 mds_rank_ ceph rtd unknown /proc/71413/task/75820/root (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75820 mds_rank_ ceph txt unknown /proc/71413/task/75820/exe (readlink: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75820 mds_rank_ ceph NOFD /proc/71413/task/75820/fd (opendir: Permission denied) 2024-09-12T12:28:08.152 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75821 PQ_Finish ceph cwd unknown /proc/71413/task/75821/cwd (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75821 PQ_Finish ceph rtd unknown /proc/71413/task/75821/root (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75821 PQ_Finish ceph txt unknown /proc/71413/task/75821/exe (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75821 PQ_Finish ceph NOFD /proc/71413/task/75821/fd (opendir: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75823 safe_time ceph cwd unknown /proc/71413/task/75823/cwd (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75823 safe_time ceph rtd unknown /proc/71413/task/75823/root (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75823 safe_time ceph txt unknown /proc/71413/task/75823/exe (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75823 safe_time ceph NOFD /proc/71413/task/75823/fd (opendir: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75824 MR_Finish ceph cwd unknown /proc/71413/task/75824/cwd (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75824 MR_Finish ceph rtd unknown /proc/71413/task/75824/root (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75824 MR_Finish ceph txt unknown /proc/71413/task/75824/exe (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75824 MR_Finish ceph NOFD /proc/71413/task/75824/fd (opendir: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75829 md_submit ceph cwd unknown /proc/71413/task/75829/cwd (readlink: Permission denied) 2024-09-12T12:28:08.153 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75829 md_submit ceph rtd unknown /proc/71413/task/75829/root (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75829 md_submit ceph txt unknown /proc/71413/task/75829/exe (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 71413 75829 md_submit ceph NOFD /proc/71413/task/75829/fd (opendir: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 71436 root cwd unknown /proc/71436/cwd (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 71436 root rtd unknown /proc/71436/root (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 71436 root txt unknown /proc/71436/exe (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 71436 root NOFD /proc/71436/fd (opendir: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73623 root cwd unknown /proc/73623/cwd (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73623 root rtd unknown /proc/73623/root (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73623 root txt unknown /proc/73623/exe (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 73623 root NOFD /proc/73623/fd (opendir: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 74287 root cwd unknown /proc/74287/cwd (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 74287 root rtd unknown /proc/74287/root (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 74287 root txt unknown /proc/74287/exe (readlink: Permission denied) 2024-09-12T12:28:08.154 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 74287 root NOFD /proc/74287/fd (opendir: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 80570 root cwd unknown /proc/80570/cwd (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 80570 root rtd unknown /proc/80570/root (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 80570 root txt unknown /proc/80570/exe (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 80570 root NOFD /proc/80570/fd (opendir: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 84159 root cwd unknown /proc/84159/cwd (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 84159 root rtd unknown /proc/84159/root (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 84159 root txt unknown /proc/84159/exe (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 84159 root NOFD /proc/84159/fd (opendir: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 84219 root cwd unknown /proc/84219/cwd (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 84219 root rtd unknown /proc/84219/root (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 84219 root txt unknown /proc/84219/exe (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 84219 root NOFD /proc/84219/fd (opendir: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84697 root cwd unknown /proc/84697/cwd (readlink: Permission denied) 2024-09-12T12:28:08.155 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84697 root rtd unknown /proc/84697/root (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84697 root txt unknown /proc/84697/exe (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84697 root NOFD /proc/84697/fd (opendir: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84712 root cwd unknown /proc/84712/cwd (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84712 root rtd unknown /proc/84712/root (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84712 root txt unknown /proc/84712/exe (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84712 root NOFD /proc/84712/fd (opendir: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84713 root cwd unknown /proc/84713/cwd (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84713 root rtd unknown /proc/84713/root (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84713 root txt unknown /proc/84713/exe (readlink: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/R 84713 root NOFD /proc/84713/fd (opendir: Permission denied) 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-12T12:28:08.156 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T12:28:08.157 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu 0r FIFO 0,14 0t0 219659 pipe 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu 1w FIFO 0,14 0t0 219660 pipe 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 88180 ubuntu 2w FIFO 0,14 0t0 219661 pipe 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T12:28:08.158 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu 0r FIFO 0,14 0t0 219659 pipe 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu 1w FIFO 0,14 0t0 219660 pipe 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu 2w FIFO 0,14 0t0 219661 pipe 2024-09-12T12:28:08.159 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 88201 ubuntu 255r REG 8,1 207 671770 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88557 root cwd unknown /proc/88557/cwd (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88557 root rtd unknown /proc/88557/root (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88557 root txt unknown /proc/88557/exe (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88557 root NOFD /proc/88557/fd (opendir: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88558 root cwd unknown /proc/88558/cwd (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88558 root rtd unknown /proc/88558/root (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88558 root txt unknown /proc/88558/exe (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 88558 root NOFD /proc/88558/fd (opendir: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 88559 root cwd unknown /proc/88559/cwd (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 88559 root rtd unknown /proc/88559/root (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 88559 root txt unknown /proc/88559/exe (readlink: Permission denied) 2024-09-12T12:28:08.160 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 88559 root NOFD /proc/88559/fd (opendir: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 88560 root cwd unknown /proc/88560/cwd (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 88560 root rtd unknown /proc/88560/root (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 88560 root txt unknown /proc/88560/exe (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 88560 root NOFD /proc/88560/fd (opendir: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 88561 root cwd unknown /proc/88561/cwd (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 88561 root rtd unknown /proc/88561/root (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 88561 root txt unknown /proc/88561/exe (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 88561 root NOFD /proc/88561/fd (opendir: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 setroubleshoot cwd unknown /proc/89773/cwd (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 setroubleshoot rtd unknown /proc/89773/root (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 setroubleshoot txt unknown /proc/89773/exe (readlink: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 setroubleshoot NOFD /proc/89773/fd (opendir: Permission denied) 2024-09-12T12:28:08.161 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89781 setrouble setroubleshoot cwd unknown /proc/89773/task/89781/cwd (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89781 setrouble setroubleshoot rtd unknown /proc/89773/task/89781/root (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89781 setrouble setroubleshoot txt unknown /proc/89773/task/89781/exe (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89781 setrouble setroubleshoot NOFD /proc/89773/task/89781/fd (opendir: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89786 gmain setroubleshoot cwd unknown /proc/89773/task/89786/cwd (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89786 gmain setroubleshoot rtd unknown /proc/89773/task/89786/root (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89786 gmain setroubleshoot txt unknown /proc/89773/task/89786/exe (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89786 gmain setroubleshoot NOFD /proc/89773/task/89786/fd (opendir: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89787 gdbus setroubleshoot cwd unknown /proc/89773/task/89787/cwd (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89787 gdbus setroubleshoot rtd unknown /proc/89773/task/89787/root (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89787 gdbus setroubleshoot txt unknown /proc/89773/task/89787/exe (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:setrouble 89773 89787 gdbus setroubleshoot NOFD /proc/89773/task/89787/fd (opendir: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 root cwd unknown /proc/89788/cwd (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 root rtd unknown /proc/89788/root (readlink: Permission denied) 2024-09-12T12:28:08.162 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 root txt unknown /proc/89788/exe (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 root NOFD /proc/89788/fd (opendir: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89807 gmain root cwd unknown /proc/89788/task/89807/cwd (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89807 gmain root rtd unknown /proc/89788/task/89807/root (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89807 gmain root txt unknown /proc/89788/task/89807/exe (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89807 gmain root NOFD /proc/89788/task/89807/fd (opendir: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89808 gdbus root cwd unknown /proc/89788/task/89808/cwd (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89808 gdbus root rtd unknown /proc/89788/task/89808/root (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89808 gdbus root txt unknown /proc/89788/task/89808/exe (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:Setrouble 89788 89808 gdbus root NOFD /proc/89788/task/89808/fd (opendir: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 90298 root cwd unknown /proc/90298/cwd (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 90298 root rtd unknown /proc/90298/root (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 90298 root txt unknown /proc/90298/exe (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 90298 root NOFD /proc/90298/fd (opendir: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:cephadm 90315 root cwd unknown /proc/90315/cwd (readlink: Permission denied) 2024-09-12T12:28:08.163 INFO:tasks.workunit.client.0.smithi038.stdout:cephadm 90315 root rtd unknown /proc/90315/root (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:cephadm 90315 root txt unknown /proc/90315/exe (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:cephadm 90315 root NOFD /proc/90315/fd (opendir: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 root cwd unknown /proc/90355/cwd (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 root rtd unknown /proc/90355/root (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 root txt unknown /proc/90355/exe (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 root NOFD /proc/90355/fd (opendir: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90356 podman root cwd unknown /proc/90355/task/90356/cwd (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90356 podman root rtd unknown /proc/90355/task/90356/root (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90356 podman root txt unknown /proc/90355/task/90356/exe (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90356 podman root NOFD /proc/90355/task/90356/fd (opendir: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90357 podman root cwd unknown /proc/90355/task/90357/cwd (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90357 podman root rtd unknown /proc/90355/task/90357/root (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90357 podman root txt unknown /proc/90355/task/90357/exe (readlink: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90357 podman root NOFD /proc/90355/task/90357/fd (opendir: Permission denied) 2024-09-12T12:28:08.164 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90358 podman root cwd unknown /proc/90355/task/90358/cwd (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90358 podman root rtd unknown /proc/90355/task/90358/root (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90358 podman root txt unknown /proc/90355/task/90358/exe (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90358 podman root NOFD /proc/90355/task/90358/fd (opendir: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90359 podman root cwd unknown /proc/90355/task/90359/cwd (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90359 podman root rtd unknown /proc/90355/task/90359/root (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90359 podman root txt unknown /proc/90355/task/90359/exe (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90359 podman root NOFD /proc/90355/task/90359/fd (opendir: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90360 podman root cwd unknown /proc/90355/task/90360/cwd (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90360 podman root rtd unknown /proc/90355/task/90360/root (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90360 podman root txt unknown /proc/90355/task/90360/exe (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90360 podman root NOFD /proc/90355/task/90360/fd (opendir: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90361 podman root cwd unknown /proc/90355/task/90361/cwd (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90361 podman root rtd unknown /proc/90355/task/90361/root (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90361 podman root txt unknown /proc/90355/task/90361/exe (readlink: Permission denied) 2024-09-12T12:28:08.165 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90361 podman root NOFD /proc/90355/task/90361/fd (opendir: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90362 podman root cwd unknown /proc/90355/task/90362/cwd (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90362 podman root rtd unknown /proc/90355/task/90362/root (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90362 podman root txt unknown /proc/90355/task/90362/exe (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90362 podman root NOFD /proc/90355/task/90362/fd (opendir: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90363 podman root cwd unknown /proc/90355/task/90363/cwd (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90363 podman root rtd unknown /proc/90355/task/90363/root (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90363 podman root txt unknown /proc/90355/task/90363/exe (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90363 podman root NOFD /proc/90355/task/90363/fd (opendir: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90364 podman root cwd unknown /proc/90355/task/90364/cwd (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90364 podman root rtd unknown /proc/90355/task/90364/root (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90364 podman root txt unknown /proc/90355/task/90364/exe (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90364 podman root NOFD /proc/90355/task/90364/fd (opendir: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90365 podman root cwd unknown /proc/90355/task/90365/cwd (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90365 podman root rtd unknown /proc/90355/task/90365/root (readlink: Permission denied) 2024-09-12T12:28:08.166 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90365 podman root txt unknown /proc/90355/task/90365/exe (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90365 podman root NOFD /proc/90355/task/90365/fd (opendir: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90366 podman root cwd unknown /proc/90355/task/90366/cwd (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90366 podman root rtd unknown /proc/90355/task/90366/root (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90366 podman root txt unknown /proc/90355/task/90366/exe (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90366 podman root NOFD /proc/90355/task/90366/fd (opendir: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90367 podman root cwd unknown /proc/90355/task/90367/cwd (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90367 podman root rtd unknown /proc/90355/task/90367/root (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90367 podman root txt unknown /proc/90355/task/90367/exe (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90367 podman root NOFD /proc/90355/task/90367/fd (opendir: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90368 podman root cwd unknown /proc/90355/task/90368/cwd (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90368 podman root rtd unknown /proc/90355/task/90368/root (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90368 podman root txt unknown /proc/90355/task/90368/exe (readlink: Permission denied) 2024-09-12T12:28:08.167 INFO:tasks.workunit.client.0.smithi038.stdout:podman 90355 90368 podman root NOFD /proc/90355/task/90368/fd (opendir: Permission denied) 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 90370 root cwd unknown /proc/90370/cwd (readlink: Permission denied) 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 90370 root rtd unknown /proc/90370/root (readlink: Permission denied) 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 90370 root txt unknown /proc/90370/exe (readlink: Permission denied) 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:conmon 90370 root NOFD /proc/90370/fd (opendir: Permission denied) 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T12:28:08.168 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu 0r FIFO 0,14 0t0 219659 pipe 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu 1w FIFO 0,14 0t0 219660 pipe 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu 2w FIFO 0,14 0t0 219661 pipe 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu 3r DIR 0,21 0 1 /proc 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu 4r DIR 0,21 7 222774 /proc/90376/fd 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu 5w FIFO 0,14 0t0 222779 pipe 2024-09-12T12:28:08.169 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90376 ubuntu 6r FIFO 0,14 0t0 222780 pipe 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T12:28:08.170 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T12:28:08.171 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T12:28:08.171 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T12:28:08.171 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T12:28:08.171 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T12:28:08.171 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T12:28:08.171 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu 4r FIFO 0,14 0t0 222779 pipe 2024-09-12T12:28:08.171 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 90383 ubuntu 7w FIFO 0,14 0t0 222780 pipe 2024-09-12T12:28:08.171 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T12:28:08.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T12:28:08.173 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:07 smithi038 ceph-mon[30810]: pgmap v459: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:28:08.173 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:07 smithi154 ceph-mon[35578]: pgmap v459: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:28:08.173 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:07 smithi071 ceph-mon[34859]: pgmap v459: 129 pgs: 129 active+clean; 258 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-12T12:28:08.248 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-12T12:28:08.248 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T12:28:08.922 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:28:09.504 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:09.763 DEBUG:teuthology.parallel:result is None 2024-09-12T12:28:09.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T12:28:09.830 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T12:28:09.830 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T12:28:09.840 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T12:28:09.951 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:09 smithi038 ceph-mon[30810]: pgmap v460: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-09-12T12:28:10.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:09 smithi071 ceph-mon[34859]: pgmap v460: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-09-12T12:28:10.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:09 smithi154 ceph-mon[35578]: pgmap v460: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 -- 172.21.15.38:0/733948472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf38106f20 msgr2=0x7faf3810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 --2- 172.21.15.38:0/733948472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf38106f20 0x7faf3810eaa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ca0 tx=0x7faf3002a8b0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 -- 172.21.15.38:0/733948472 shutdown_connections 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 --2- 172.21.15.38:0/733948472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf38106f20 0x7faf3810eaa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 --2- 172.21.15.38:0/733948472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf381027a0 0x7faf381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 --2- 172.21.15.38:0/733948472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf38101df0 0x7faf381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 -- 172.21.15.38:0/733948472 >> 172.21.15.38:0/733948472 conn(0x7faf380fd8b0 msgr2=0x7faf380ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 -- 172.21.15.38:0/733948472 shutdown_connections 2024-09-12T12:28:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.226+0000 7faf3f200640 1 -- 172.21.15.38:0/733948472 wait complete. 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.227+0000 7faf3f200640 1 Processor -- start 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.227+0000 7faf3f200640 1 -- start start 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf3f200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf38101df0 0x7faf3819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf3f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf381027a0 0x7faf3819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf3f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf38106f20 0x7faf3819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf3f200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf38111f80 con 0x7faf381027a0 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf3f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf38111e00 con 0x7faf38106f20 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf3f200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112100 con 0x7faf38101df0 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf2f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf381027a0 0x7faf3819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf2f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf381027a0 0x7faf3819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54190/0 (socket says 172.21.15.38:54190) 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf37e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf38101df0 0x7faf3819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf3d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf38106f20 0x7faf3819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.228+0000 7faf2f400640 1 -- 172.21.15.38:0/319763929 learned_addr learned my addr 172.21.15.38:0/319763929 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:10.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3d200640 1 -- 172.21.15.38:0/319763929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf38101df0 msgr2=0x7faf3819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3d200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf38101df0 0x7faf3819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3d200640 1 -- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf381027a0 msgr2=0x7faf3819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3d200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf381027a0 0x7faf3819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3d200640 1 -- 172.21.15.38:0/319763929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3819f550 con 0x7faf38106f20 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf2f400640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf381027a0 0x7faf3819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3d200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf38106f20 0x7faf3819ee70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ca0 tx=0x7faf30030e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf35600640 1 -- 172.21.15.38:0/319763929 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30003e40 con 0x7faf38106f20 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf35600640 1 -- 172.21.15.38:0/319763929 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf30040070 con 0x7faf38106f20 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3819f7e0 con 0x7faf38106f20 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf35600640 1 -- 172.21.15.38:0/319763929 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30045b70 con 0x7faf38106f20 2024-09-12T12:28:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.229+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf381a7120 con 0x7faf38106f20 2024-09-12T12:28:10.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.232+0000 7faf35600640 1 -- 172.21.15.38:0/319763929 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faf30004040 con 0x7faf38106f20 2024-09-12T12:28:10.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 Processor -- start 2024-09-12T12:28:10.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 -- start start 2024-09-12T12:28:10.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416f4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241701240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d24165a3e0 con 0x55d2416f4590 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d241601d80 con 0x55d2416f3c70 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf41c39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d2416563a0 con 0x55d2416fee50 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf37e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf2f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf37e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54200/0 (socket says 172.21.15.38:54200) 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf2f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:49004/0 (socket says 172.21.15.38:49004) 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.233+0000 7faf37e00640 1 -- 172.21.15.38:0/499447466 learned_addr learned my addr 172.21.15.38:0/499447466 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf2f400640 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241701240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf37e00640 1 -- 172.21.15.38:0/499447466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 msgr2=0x55d241701240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf37e00640 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241701240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf37e00640 1 -- 172.21.15.38:0/499447466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 msgr2=0x55d2416f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf37e00640 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf37e00640 1 -- 172.21.15.38:0/499447466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d241620ae0 con 0x55d2416f4590 2024-09-12T12:28:10.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf35600640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf1c0a2b80 0x7faf1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf35600640 1 -- 172.21.15.38:0/319763929 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faf300f04b0 con 0x7faf38106f20 2024-09-12T12:28:10.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf37e00640 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fe910 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b760 tx=0x7faf2800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8a393e5941f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:10.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.234+0000 7faf2f400640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf1c0a2b80 0x7faf1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf2d600640 1 -- 172.21.15.38:0/499447466 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28003dd0 con 0x55d2416f4590 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf2d600640 1 -- 172.21.15.38:0/499447466 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf28015070 con 0x55d2416f4590 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf2d600640 1 -- 172.21.15.38:0/499447466 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28004e10 con 0x55d2416f4590 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf41c39740 1 -- 172.21.15.38:0/499447466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 msgr2=0x55d2416fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf41c39740 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fe910 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b760 tx=0x7faf2800bc20 comp rx=0 tx=0).stop 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf2f400640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf1c0a2b80 0x7faf1c0a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d2416f1580 tx=0x7faf2000b700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf41c39740 1 -- 172.21.15.38:0/499447466 shutdown_connections 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf41c39740 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241701240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf41c39740 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fe910 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf41c39740 1 --2- 172.21.15.38:0/499447466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.235+0000 7faf41c39740 1 -- 172.21.15.38:0/499447466 >> 172.21.15.38:0/499447466 conn(0x55d2416f0200 msgr2=0x55d2416f05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:10.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.236+0000 7faf41c39740 1 -- 172.21.15.38:0/499447466 shutdown_connections 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.236+0000 7faf41c39740 1 -- 172.21.15.38:0/499447466 wait complete. 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.236+0000 7faf41c39740 1 -- start start 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.236+0000 7faf41c39740 1 Processor -- start 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf41c39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf41c39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf41c39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d2416fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf41c39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d241701a20 con 0x55d2416f4590 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf41c39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d2416150f0 con 0x55d2416f3c70 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf41c39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d241701ba0 con 0x55d2416fee50 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf41c39740 10 client.0 _ll_register_callbacks cb 0x55d2415fcbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf2f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf2f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54202/0 (socket says 172.21.15.38:54202) 2024-09-12T12:28:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf2f400640 1 -- 172.21.15.38:0/2492285941 learned_addr learned my addr 172.21.15.38:0/2492285941 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:10.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf3d200640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d2416fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf37e00640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf2f400640 1 -- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 msgr2=0x55d2416fc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf2f400640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d2416fc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.237+0000 7faf2f400640 1 -- 172.21.15.38:0/2492285941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 msgr2=0x55d2416fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf2f400640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416fbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf2f400640 1 -- 172.21.15.38:0/2492285941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2413cb3c0 con 0x55d2416f4590 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf3d200640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d2416fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf37e00640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf2f400640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fc270 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf20003d60 tx=0x7faf20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acab9f30bc1493d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf26000640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf26000640 1 -- 172.21.15.38:0/2492285941 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20003e50 con 0x55d2416f4590 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf28015070 con 0x55d2416f4590 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf26000640 1 -- 172.21.15.38:0/2492285941 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faf2001b030 con 0x55d2416f4590 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf26000640 1 -- 172.21.15.38:0/2492285941 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faf2002e540 con 0x55d2416f4590 2024-09-12T12:28:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf41c39740 10 client.15795 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.238+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d24170db10 con 0x55d2416f4590 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf26000640 1 -- 172.21.15.38:0/2492285941 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf28015070 con 0x55d2416f4590 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf26000640 1 -- 172.21.15.38:0/2492285941 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7faf20029410 con 0x55d2416f4590 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf41c39740 10 client.15795 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf41c39740 10 client.15795 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf41c39740 20 client.15795 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf41c39740 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d24170efe0 0x55d241711440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf41c39740 4 client.15795 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d241667950 con 0x55d24170efe0 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.239+0000 7faf37e00640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d24170efe0 0x55d241711440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.240+0000 7faf37e00640 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d24170efe0 0x55d241711440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b39b73dc775caa1 server_cookie=695fefba0d692e19 in_seq=0 out_seq=0 2024-09-12T12:28:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.240+0000 7faf26000640 10 client.15795 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf26000640 1 -- 172.21.15.38:0/2492285941 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d241667950 con 0x55d24170efe0 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf26000640 10 client.15795 handle_command_reply: tid=0 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 client.15795 shutdown 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 msgr2=0x55d2416fc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fc270 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf20003d60 tx=0x7faf20004730 comp rx=0 tx=0).stop 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 shutdown_connections 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d24170efe0 0x55d241711440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d2416fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f4590 0x55d2416fc270 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 --2- 172.21.15.38:0/2492285941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f3c70 0x55d2416fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf26000640 0 client.15795 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 >> 172.21.15.38:0/2492285941 conn(0x55d2416f0200 msgr2=0x55d2416ef380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 shutdown_connections 2024-09-12T12:28:10.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.241+0000 7faf41c39740 1 -- 172.21.15.38:0/2492285941 wait complete. 2024-09-12T12:28:10.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.242+0000 7faf41c39740 20 client.15795 trim_cache size 0 max 16384 2024-09-12T12:28:10.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.255+0000 7faf41c39740 1 Processor -- start 2024-09-12T12:28:10.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.255+0000 7faf41c39740 1 -- start start 2024-09-12T12:28:10.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf41c39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f3c70 0x55d2416f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf41c39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241716d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf41c39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241717250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf41c39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf381b0e40 con 0x55d2416f3c70 2024-09-12T12:28:10.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf41c39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf381b2980 con 0x55d2416f4590 2024-09-12T12:28:10.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf41c39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf381b1510 con 0x55d2416fee50 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f3c70 0x55d2416f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f3c70 0x55d2416f66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54218/0 (socket says 172.21.15.38:54218) 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 -- 172.21.15.38:0/3073382284 learned_addr learned my addr 172.21.15.38:0/3073382284 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf3d200640 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241717250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf2f400640 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241716d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 -- 172.21.15.38:0/3073382284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 msgr2=0x55d241717250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241717250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 -- 172.21.15.38:0/3073382284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 msgr2=0x55d241716d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241716d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf37e00640 1 -- 172.21.15.38:0/3073382284 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2416eb770 con 0x55d2416f3c70 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf3d200640 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241717250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:10.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.256+0000 7faf2f400640 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241716d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:10.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.257+0000 7faf37e00640 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f3c70 0x55d2416f66d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b760 tx=0x7faf280049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5e02ba2e94534a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:10.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.257+0000 7faf2cc00640 1 -- 172.21.15.38:0/3073382284 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28003dd0 con 0x55d2416f3c70 2024-09-12T12:28:10.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.257+0000 7faf2cc00640 1 -- 172.21.15.38:0/3073382284 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf28015040 con 0x55d2416f3c70 2024-09-12T12:28:10.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.257+0000 7faf2cc00640 1 -- 172.21.15.38:0/3073382284 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28019420 con 0x55d2416f3c70 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 -- 172.21.15.38:0/3073382284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f3c70 msgr2=0x55d2416f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f3c70 0x55d2416f66d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b760 tx=0x7faf280049f0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 -- 172.21.15.38:0/3073382284 shutdown_connections 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416fee50 0x55d241717250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241716d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 --2- 172.21.15.38:0/3073382284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416f3c70 0x55d2416f66d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 -- 172.21.15.38:0/3073382284 >> 172.21.15.38:0/3073382284 conn(0x55d2416f0200 msgr2=0x55d2416fae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 -- 172.21.15.38:0/3073382284 shutdown_connections 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 -- 172.21.15.38:0/3073382284 wait complete. 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 -- start start 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.258+0000 7faf41c39740 1 Processor -- start 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf41c39740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416f3c70 0x55d241706df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf41c39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241707330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf41c39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416fee50 0x55d2416f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf41c39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf381b22b0 con 0x55d2416fee50 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf41c39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf381b1be0 con 0x55d2416f4590 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf41c39740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf381aee20 con 0x55d2416f3c70 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf41c39740 10 client.0 _ll_register_callbacks cb 0x7faf20012c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf2f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241707330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf2f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241707330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:49024/0 (socket says 172.21.15.38:49024) 2024-09-12T12:28:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf2f400640 1 -- 172.21.15.38:0/1328580642 learned_addr learned my addr 172.21.15.38:0/1328580642 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf37e00640 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416f3c70 0x55d241706df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.259+0000 7faf3d200640 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416fee50 0x55d2416f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf2f400640 1 -- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416f3c70 msgr2=0x55d241706df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf2f400640 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416f3c70 0x55d241706df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf2f400640 1 -- 172.21.15.38:0/1328580642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416fee50 msgr2=0x55d2416f8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf2f400640 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416fee50 0x55d2416f8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf2f400640 1 -- 172.21.15.38:0/1328580642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2416f0e90 con 0x55d2416f4590 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf2f400640 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241707330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faf20029880 tx=0x7faf20029d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa462ac2202c5ded server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf26000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf26000640 1 -- 172.21.15.38:0/1328580642 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2000bcc0 con 0x55d2416f4590 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf28015040 con 0x55d2416f4590 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.260+0000 7faf26000640 1 -- 172.21.15.38:0/1328580642 <== mon.2 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7faf20012250 con 0x55d2416f4590 2024-09-12T12:28:10.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf26000640 1 -- 172.21.15.38:0/1328580642 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faf20003e50 con 0x55d2416f4590 2024-09-12T12:28:10.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 10 client.25808 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:10.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d2417792b0 con 0x55d2416f4590 2024-09-12T12:28:10.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf26000640 1 -- 172.21.15.38:0/1328580642 <== mon.2 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf28015040 con 0x55d2416f4590 2024-09-12T12:28:10.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf26000640 1 -- 172.21.15.38:0/1328580642 <== mon.2 v2:172.21.15.71:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7faf2002ec50 con 0x55d2416f4590 2024-09-12T12:28:10.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 10 client.25808 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:10.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 10 client.25808 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T12:28:10.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 20 client.25808 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d241779a80 0x55d24177bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 4 client.25808 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.261+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 --> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d241661e60 con 0x55d241779a80 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.262+0000 7faf37e00640 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d241779a80 0x55d24177bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.262+0000 7faf37e00640 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d241779a80 0x55d24177bea0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0f497f430787ad2 server_cookie=e6c38603c21c465a in_seq=0 out_seq=0 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.262+0000 7faf26000640 10 client.25808 ms_handle_connect on v2:172.21.15.154:6838/2253548650 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.262+0000 7faf26000640 1 -- 172.21.15.38:0/1328580642 <== mds.1 v2:172.21.15.154:6838/2253548650 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d241661e60 con 0x55d241779a80 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.262+0000 7faf26000640 10 client.25808 handle_command_reply: tid=0 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.262+0000 7faf41c39740 1 client.25808 shutdown 2024-09-12T12:28:10.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 msgr2=0x55d241707330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241707330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faf20029880 tx=0x7faf20029d20 comp rx=0 tx=0).stop 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 shutdown_connections 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:6838/2253548650,v1:172.21.15.154:6839/2253548650] conn(0x55d241779a80 0x55d24177bea0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2416fee50 0x55d2416f8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2416f4590 0x55d241707330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 --2- 172.21.15.38:0/1328580642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2416f3c70 0x55d241706df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf26000640 0 client.25808 ms_handle_reset on v2:172.21.15.154:6838/2253548650 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 >> 172.21.15.38:0/1328580642 conn(0x55d2416f0200 msgr2=0x55d2416fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 shutdown_connections 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 1 -- 172.21.15.38:0/1328580642 wait complete. 2024-09-12T12:28:10.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.263+0000 7faf41c39740 20 client.25808 trim_cache size 0 max 16384 2024-09-12T12:28:10.268 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:28:10.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf1c0a2b80 msgr2=0x7faf1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf1c0a2b80 0x7faf1c0a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d2416f1580 tx=0x7faf2000b700 comp rx=0 tx=0).stop 2024-09-12T12:28:10.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf38106f20 msgr2=0x7faf3819ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf38106f20 0x7faf3819ee70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ca0 tx=0x7faf30030e60 comp rx=0 tx=0).stop 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 shutdown_connections 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7faf1c0a2b80 0x7faf1c0a5040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf38106f20 0x7faf3819ee70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf381027a0 0x7faf3819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 --2- 172.21.15.38:0/319763929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf38101df0 0x7faf3819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 >> 172.21.15.38:0/319763929 conn(0x7faf380fd8b0 msgr2=0x7faf380fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 shutdown_connections 2024-09-12T12:28:10.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:10.264+0000 7faf3f200640 1 -- 172.21.15.38:0/319763929 wait complete. 2024-09-12T12:28:11.114 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:28:11.506 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:11.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:11 smithi038 ceph-mon[30810]: pgmap v461: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 774 KiB/s wr, 11 op/s 2024-09-12T12:28:12.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:11 smithi071 ceph-mon[34859]: pgmap v461: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 774 KiB/s wr, 11 op/s 2024-09-12T12:28:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 -- 172.21.15.38:0/1190993313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180076720 msgr2=0x7f1180076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 --2- 172.21.15.38:0/1190993313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180076720 0x7f1180076b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1174009900 tx=0x7f117402a400 comp rx=0 tx=0).stop 2024-09-12T12:28:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 -- 172.21.15.38:0/1190993313 shutdown_connections 2024-09-12T12:28:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 --2- 172.21.15.38:0/1190993313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1180112a30 0x7f1180114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 --2- 172.21.15.38:0/1190993313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1180077040 0x7f11801124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 --2- 172.21.15.38:0/1190993313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180076720 0x7f1180076b00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 -- 172.21.15.38:0/1190993313 >> 172.21.15.38:0/1190993313 conn(0x7f11800ffa90 msgr2=0x7f1180101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 -- 172.21.15.38:0/1190993313 shutdown_connections 2024-09-12T12:28:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.112+0000 7f1188800640 1 -- 172.21.15.38:0/1190993313 wait complete. 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.113+0000 7f1188800640 1 Processor -- start 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.113+0000 7f1188800640 1 -- start start 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1188800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1180076720 0x7f11801a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1188800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1180077040 0x7f11801a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1188800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180112a30 0x7f118019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1188800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f11801185a0 con 0x7f1180112a30 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1188800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1180118420 con 0x7f1180076720 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1188800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1180118720 con 0x7f1180077040 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1186800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180112a30 0x7f118019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1186800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180112a30 0x7f118019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54254/0 (socket says 172.21.15.38:54254) 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1186800640 1 -- 172.21.15.38:0/3725194978 learned_addr learned my addr 172.21.15.38:0/3725194978 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1185e00640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1180076720 0x7f11801a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.114+0000 7f1185400640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1180077040 0x7f11801a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f1186800640 1 -- 172.21.15.38:0/3725194978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1180077040 msgr2=0x7f11801a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f1186800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1180077040 0x7f11801a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f1186800640 1 -- 172.21.15.38:0/3725194978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1180076720 msgr2=0x7f11801a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f1186800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1180076720 0x7f11801a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f1186800640 1 -- 172.21.15.38:0/3725194978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118019f000 con 0x7f1180112a30 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f1186800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180112a30 0x7f118019e8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f117c009fd0 tx=0x7f117c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f117aa00640 1 -- 172.21.15.38:0/3725194978 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c004d20 con 0x7f1180112a30 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f117aa00640 1 -- 172.21.15.38:0/3725194978 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c005020 con 0x7f1180112a30 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118019f2f0 con 0x7f1180112a30 2024-09-12T12:28:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.115+0000 7f117aa00640 1 -- 172.21.15.38:0/3725194978 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c0116d0 con 0x7f1180112a30 2024-09-12T12:28:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.116+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11801ab5e0 con 0x7f1180112a30 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 Processor -- start 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f117aa00640 1 -- 172.21.15.38:0/3725194978 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f117c0051d0 con 0x7f1180112a30 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 -- start start 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d185050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d185590 0x55700d18f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d18fe50 0x55700d192240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55700d0eb3e0 con 0x55700d184c70 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55700d092d80 con 0x55700d185590 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.119+0000 7f118b445740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55700d0e73a0 con 0x55700d18fe50 2024-09-12T12:28:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d185050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d185050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54260/0 (socket says 172.21.15.38:54260) 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185400640 1 -- 172.21.15.38:0/2485307590 learned_addr learned my addr 172.21.15.38:0/2485307590 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185e00640 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d185590 0x55700d18f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185400640 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d18fe50 0x55700d192240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185e00640 1 -- 172.21.15.38:0/2485307590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d18fe50 msgr2=0x55700d192240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185e00640 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d18fe50 0x55700d192240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185e00640 1 -- 172.21.15.38:0/2485307590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 msgr2=0x55700d185050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185e00640 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d185050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.120+0000 7f1185e00640 1 -- 172.21.15.38:0/2485307590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55700d0b1ae0 con 0x55700d185590 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.121+0000 7f117aa00640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11680a2b80 0x7f11680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.121+0000 7f1185e00640 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d185590 0x55700d18f910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1174005940 tx=0x7f1174005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc64aa71f8546963 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.121+0000 7f117aa00640 1 -- 172.21.15.38:0/3725194978 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f117c0cf8a0 con 0x7f1180112a30 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.121+0000 7f1185400640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11680a2b80 0x7f11680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.121+0000 7f116f000640 1 -- 172.21.15.38:0/2485307590 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174040070 con 0x55700d185590 2024-09-12T12:28:12.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.121+0000 7f116f000640 1 -- 172.21.15.38:0/2485307590 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11740319f0 con 0x55700d185590 2024-09-12T12:28:12.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.121+0000 7f116f000640 1 -- 172.21.15.38:0/2485307590 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174035040 con 0x55700d185590 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 -- 172.21.15.38:0/2485307590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d185590 msgr2=0x55700d18f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f1185400640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11680a2b80 0x7f11680a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55700d182580 tx=0x7f117000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d185590 0x55700d18f910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1174005940 tx=0x7f1174005e80 comp rx=0 tx=0).stop 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 -- 172.21.15.38:0/2485307590 shutdown_connections 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d18fe50 0x55700d192240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d185590 0x55700d18f910 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 --2- 172.21.15.38:0/2485307590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d185050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 -- 172.21.15.38:0/2485307590 >> 172.21.15.38:0/2485307590 conn(0x55700d181200 msgr2=0x55700d1815e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 -- 172.21.15.38:0/2485307590 shutdown_connections 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.122+0000 7f118b445740 1 -- 172.21.15.38:0/2485307590 wait complete. 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 -- start start 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 Processor -- start 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d18cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d18d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55700d192a20 con 0x55700d185590 2024-09-12T12:28:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55700d0a60f0 con 0x55700d18fe50 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55700d192ba0 con 0x55700d184c70 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.123+0000 7f118b445740 10 client.0 _ll_register_callbacks cb 0x55700d08dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d18d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d18d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54276/0 (socket says 172.21.15.38:54276) 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d18cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185400640 1 -- 172.21.15.38:0/3735887804 learned_addr learned my addr 172.21.15.38:0/3735887804 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1186800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185e00640 1 -- 172.21.15.38:0/3735887804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 msgr2=0x55700d18d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185e00640 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185e00640 1 -- 172.21.15.38:0/3735887804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 msgr2=0x55700d18d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185e00640 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d18d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185e00640 1 -- 172.21.15.38:0/3735887804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55700ce5c3c0 con 0x55700d184c70 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.124+0000 7f1185400640 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d18d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f1185e00640 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d18cdc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f117402a920 tx=0x7f1174004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5520463a1f79a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f1163400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f1163400640 1 -- 172.21.15.38:0/3735887804 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174040070 con 0x55700d184c70 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11740319f0 con 0x55700d184c70 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f1163400640 1 -- 172.21.15.38:0/3735887804 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f1174004240 con 0x55700d184c70 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f1163400640 1 -- 172.21.15.38:0/3735887804 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1174056050 con 0x55700d184c70 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f118b445740 10 client.25789 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.125+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55700d192a20 con 0x55700d184c70 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f1163400640 1 -- 172.21.15.38:0/3735887804 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11740319f0 con 0x55700d184c70 2024-09-12T12:28:12.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f1163400640 1 -- 172.21.15.38:0/3735887804 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f1174004d20 con 0x55700d184c70 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f118b445740 10 client.25789 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f118b445740 10 client.25789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f118b445740 20 client.25789 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f118b445740 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d19fc50 0x55700d1a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f118b445740 4 client.25789 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55700d0f8950 con 0x55700d19fc50 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.126+0000 7f1185400640 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d19fc50 0x55700d1a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.127+0000 7f1185400640 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d19fc50 0x55700d1a2040 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7bcc1733391d624 server_cookie=358eb9dc845e4979 in_seq=0 out_seq=0 2024-09-12T12:28:12.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.127+0000 7f1163400640 10 client.25789 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:28:12.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f1163400640 1 -- 172.21.15.38:0/3735887804 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55700d0f8950 con 0x55700d19fc50 2024-09-12T12:28:12.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f1163400640 10 client.25789 handle_command_reply: tid=0 2024-09-12T12:28:12.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 client.25789 shutdown 2024-09-12T12:28:12.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 msgr2=0x55700d18cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d18cdc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f117402a920 tx=0x7f1174004980 comp rx=0 tx=0).stop 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 shutdown_connections 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d19fc50 0x55700d1a2040 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d18d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 --2- 172.21.15.38:0/3735887804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d18cdc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f1163400640 0 client.25789 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 >> 172.21.15.38:0/3735887804 conn(0x55700d181200 msgr2=0x55700d180380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 shutdown_connections 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 1 -- 172.21.15.38:0/3735887804 wait complete. 2024-09-12T12:28:12.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.128+0000 7f118b445740 20 client.25789 trim_cache size 0 max 16384 2024-09-12T12:28:12.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.142+0000 7f118b445740 1 Processor -- start 2024-09-12T12:28:12.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.142+0000 7f118b445740 1 -- start start 2024-09-12T12:28:12.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f118b445740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d1a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f118b445740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d1a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f118b445740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f118b445740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f11801b5380 con 0x55700d185590 2024-09-12T12:28:12.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f118b445740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f11801b6ec0 con 0x55700d18fe50 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f118b445740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11801b5a50 con 0x55700d184c70 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d1a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d1a7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54284/0 (socket says 172.21.15.38:54284) 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 -- 172.21.15.38:0/3494786881 learned_addr learned my addr 172.21.15.38:0/3494786881 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1186800640 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185e00640 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d1a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 -- 172.21.15.38:0/3494786881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 msgr2=0x55700d1a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d1a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 -- 172.21.15.38:0/3494786881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 msgr2=0x55700d18a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.143+0000 7f1185400640 1 -- 172.21.15.38:0/3494786881 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55700d181030 con 0x55700d185590 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.144+0000 7f1185400640 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d1a7d10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1170012340 tx=0x7f1170011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34cbf1e39fef17d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:12.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.144+0000 7f116e600640 1 -- 172.21.15.38:0/3494786881 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117001f450 con 0x55700d185590 2024-09-12T12:28:12.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.144+0000 7f116e600640 1 -- 172.21.15.38:0/3494786881 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117001fad0 con 0x55700d185590 2024-09-12T12:28:12.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.144+0000 7f116e600640 1 -- 172.21.15.38:0/3494786881 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117002baf0 con 0x55700d185590 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.144+0000 7f118b445740 1 -- 172.21.15.38:0/3494786881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 msgr2=0x55700d1a7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.144+0000 7f118b445740 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d1a7d10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1170012340 tx=0x7f1170011000 comp rx=0 tx=0).stop 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 -- 172.21.15.38:0/3494786881 shutdown_connections 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d18a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d185590 0x55700d1a7d10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 --2- 172.21.15.38:0/3494786881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d184c70 0x55700d1a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 -- 172.21.15.38:0/3494786881 >> 172.21.15.38:0/3494786881 conn(0x55700d181200 msgr2=0x55700d18ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 -- 172.21.15.38:0/3494786881 shutdown_connections 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 -- 172.21.15.38:0/3494786881 wait complete. 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 -- start start 2024-09-12T12:28:12.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.145+0000 7f118b445740 1 Processor -- start 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f118b445740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d193c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f118b445740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d185590 0x55700d194170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f118b445740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d1946b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f118b445740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f11801b67f0 con 0x55700d184c70 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f118b445740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f11801b6120 con 0x55700d18fe50 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f118b445740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11801b3360 con 0x55700d185590 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f118b445740 10 client.0 _ll_register_callbacks cb 0x7f117000bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d193c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d185590 0x55700d194170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d193c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54292/0 (socket says 172.21.15.38:54292) 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 -- 172.21.15.38:0/3028779980 learned_addr learned my addr 172.21.15.38:0/3028779980 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1186800640 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d1946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 -- 172.21.15.38:0/3028779980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d185590 msgr2=0x55700d194170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d185590 0x55700d194170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 -- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 msgr2=0x55700d1946b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d1946b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185e00640 1 -- 172.21.15.38:0/3028779980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55700d17c770 con 0x55700d184c70 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.146+0000 7f1185400640 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d185590 0x55700d194170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f1185e00640 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d193c30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1174006010 tx=0x7f1174005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9ab81f64f3b56d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f1163400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f1163400640 1 -- 172.21.15.38:0/3028779980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117405f060 con 0x55700d184c70 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f1163400640 1 -- 172.21.15.38:0/3028779980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f1174004240 con 0x55700d184c70 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117001fad0 con 0x55700d184c70 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f1163400640 1 -- 172.21.15.38:0/3028779980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1174066050 con 0x55700d184c70 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f118b445740 10 client.15819 fetch_fsmap learned FSMap version 30 2024-09-12T12:28:12.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.147+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55700d20a990 con 0x55700d184c70 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f1163400640 1 -- 172.21.15.38:0/3028779980 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117001fad0 con 0x55700d184c70 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f1163400640 1 -- 172.21.15.38:0/3028779980 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f1174003950 con 0x55700d184c70 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f118b445740 10 client.15819 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f118b445740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f118b445740 20 client.15819 populate_metadata read hostname 'smithi038' 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f118b445740 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d20b050 0x55700d20d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f118b445740 4 client.15819 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.148+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 --> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55700d0f2e60 con 0x55700d20b050 2024-09-12T12:28:12.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.149+0000 7f1185400640 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d20b050 0x55700d20d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:12.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.149+0000 7f1185400640 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d20b050 0x55700d20d470 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=684e608dc21204a3 server_cookie=ff45d91c884e715e in_seq=0 out_seq=0 2024-09-12T12:28:12.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.149+0000 7f1163400640 10 client.15819 ms_handle_connect on v2:172.21.15.71:6838/3960727102 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.149+0000 7f1163400640 1 -- 172.21.15.38:0/3028779980 <== mds.0 v2:172.21.15.71:6838/3960727102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55700d0f2e60 con 0x55700d20b050 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.149+0000 7f1163400640 10 client.15819 handle_command_reply: tid=0 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.149+0000 7f118b445740 1 client.15819 shutdown 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 msgr2=0x55700d193c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d193c30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1174006010 tx=0x7f1174005570 comp rx=0 tx=0).stop 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 shutdown_connections 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:6838/3960727102,v1:172.21.15.71:6839/3960727102] conn(0x55700d20b050 0x55700d20d470 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55700d18fe50 0x55700d1946b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55700d185590 0x55700d194170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 --2- 172.21.15.38:0/3028779980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55700d184c70 0x55700d193c30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 >> 172.21.15.38:0/3028779980 conn(0x55700d181200 msgr2=0x55700d1866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:12.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f1163400640 0 client.15819 ms_handle_reset on v2:172.21.15.71:6838/3960727102 2024-09-12T12:28:12.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 shutdown_connections 2024-09-12T12:28:12.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 1 -- 172.21.15.38:0/3028779980 wait complete. 2024-09-12T12:28:12.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.150+0000 7f118b445740 20 client.15819 trim_cache size 0 max 16384 2024-09-12T12:28:12.155 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-12T12:28:12.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11680a2b80 msgr2=0x7f11680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11680a2b80 0x7f11680a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55700d182580 tx=0x7f117000b390 comp rx=0 tx=0).stop 2024-09-12T12:28:12.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180112a30 msgr2=0x7f118019e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:12.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180112a30 0x7f118019e8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f117c009fd0 tx=0x7f117c00ee60 comp rx=0 tx=0).stop 2024-09-12T12:28:12.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 shutdown_connections 2024-09-12T12:28:12.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f11680a2b80 0x7f11680a5040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1180112a30 0x7f118019e8d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1180077040 0x7f11801a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 --2- 172.21.15.38:0/3725194978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1180076720 0x7f11801a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:12.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 >> 172.21.15.38:0/3725194978 conn(0x7f11800ffa90 msgr2=0x7f1180101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:12.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 shutdown_connections 2024-09-12T12:28:12.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:12.151+0000 7f1188800640 1 -- 172.21.15.38:0/3725194978 wait complete. 2024-09-12T12:28:12.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:11 smithi154 ceph-mon[35578]: pgmap v461: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 774 KiB/s wr, 11 op/s 2024-09-12T12:28:12.983 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T12:28:12.984 INFO:tasks.fwd_scrub:done joining 2024-09-12T12:28:12.984 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T12:28:12.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:28:13.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 -- 172.21.15.38:0/3360290609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e441058e0 msgr2=0x7f7e4410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/3360290609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e441058e0 0x7f7e4410c170 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009ca0 tx=0x7f7e3c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 -- 172.21.15.38:0/3360290609 shutdown_connections 2024-09-12T12:28:13.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/3360290609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e441058e0 0x7f7e4410c170 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/3360290609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e44104f20 0x7f7e441053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/3360290609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 0x7f7e44104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 -- 172.21.15.38:0/3360290609 >> 172.21.15.38:0/3360290609 conn(0x7f7e440ff4b0 msgr2=0x7f7e441018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:13.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 -- 172.21.15.38:0/3360290609 shutdown_connections 2024-09-12T12:28:13.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.154+0000 7f7e4aa00640 1 -- 172.21.15.38:0/3360290609 wait complete. 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 Processor -- start 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 -- start start 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 0x7f7e4419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e44104f20 0x7f7e4419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e441058e0 0x7f7e441a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410fa00 con 0x7f7e44104f20 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410f880 con 0x7f7e441058e0 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.155+0000 7f7e4aa00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410fb80 con 0x7f7e44103d30 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 0x7f7e4419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 0x7f7e4419a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:43752/0 (socket says 172.21.15.38:43752) 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 -- 172.21.15.38:0/2180927386 learned_addr learned my addr 172.21.15.38:0/2180927386 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e3be00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e44104f20 0x7f7e4419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e48a00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e441058e0 0x7f7e441a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 -- 172.21.15.38:0/2180927386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e441058e0 msgr2=0x7f7e441a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e441058e0 0x7f7e441a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 -- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e44104f20 msgr2=0x7f7e4419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e44104f20 0x7f7e4419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 -- 172.21.15.38:0/2180927386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e441a1c20 con 0x7f7e44103d30 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.156+0000 7f7e43e00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 0x7f7e4419a000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400e9c0 tx=0x7f7e3400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.157+0000 7f7e41600640 1 -- 172.21.15.38:0/2180927386 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400cd80 con 0x7f7e44103d30 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.157+0000 7f7e41600640 1 -- 172.21.15.38:0/2180927386 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e340035f0 con 0x7f7e44103d30 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.157+0000 7f7e41600640 1 -- 172.21.15.38:0/2180927386 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34010690 con 0x7f7e44103d30 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.157+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e441a1f10 con 0x7f7e44103d30 2024-09-12T12:28:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.157+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e441a2320 con 0x7f7e44103d30 2024-09-12T12:28:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.158+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4410b050 con 0x7f7e44103d30 2024-09-12T12:28:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.160+0000 7f7e41600640 1 -- 172.21.15.38:0/2180927386 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7e340037a0 con 0x7f7e44103d30 2024-09-12T12:28:13.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.161+0000 7f7e41600640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e280a2b90 0x7f7e280a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.161+0000 7f7e41600640 1 -- 172.21.15.38:0/2180927386 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f7e340cf940 con 0x7f7e44103d30 2024-09-12T12:28:13.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.162+0000 7f7e3be00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e280a2b90 0x7f7e280a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.162+0000 7f7e3be00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e280a2b90 0x7f7e280a5050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e4419b510 tx=0x7f7e2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:13.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.164+0000 7f7e41600640 1 -- 172.21.15.38:0/2180927386 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e3409c490 con 0x7f7e44103d30 2024-09-12T12:28:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.353+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e4402da30 con 0x7f7e44103d30 2024-09-12T12:28:13.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.355+0000 7f7e41600640 1 -- 172.21.15.38:0/2180927386 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24865 (secure 0 0 0) 0x7f7e3409bd90 con 0x7f7e44103d30 2024-09-12T12:28:13.356 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:28:13.356 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:24:35.829591+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:28:13.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e280a2b90 msgr2=0x7f7e280a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e280a2b90 0x7f7e280a5050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e4419b510 tx=0x7f7e2c005f90 comp rx=0 tx=0).stop 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 msgr2=0x7f7e4419a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 0x7f7e4419a000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400e9c0 tx=0x7f7e3400ee80 comp rx=0 tx=0).stop 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 shutdown_connections 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f7e280a2b90 0x7f7e280a5050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e441058e0 0x7f7e441a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e44104f20 0x7f7e4419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 --2- 172.21.15.38:0/2180927386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e44103d30 0x7f7e4419a000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 >> 172.21.15.38:0/2180927386 conn(0x7f7e440ff4b0 msgr2=0x7f7e44108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 shutdown_connections 2024-09-12T12:28:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.357+0000 7f7e4aa00640 1 -- 172.21.15.38:0/2180927386 wait complete. 2024-09-12T12:28:13.374 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:17:58.604590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T12:22:50.782584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T12:22:53.282254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T12:23:01.880311+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T12:28:13.374 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 -- 172.21.15.38:0/2126427165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 msgr2=0x7f0b081071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 --2- 172.21.15.38:0/2126427165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b081071a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009860 tx=0x7f0af002a340 comp rx=0 tx=0).stop 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 -- 172.21.15.38:0/2126427165 shutdown_connections 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 --2- 172.21.15.38:0/2126427165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b081076e0 0x7f0b08109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 --2- 172.21.15.38:0/2126427165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b081071a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 --2- 172.21.15.38:0/2126427165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b08102480 0x7f0b08104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 -- 172.21.15.38:0/2126427165 >> 172.21.15.38:0/2126427165 conn(0x7f0b080fc0a0 msgr2=0x7f0b080fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 -- 172.21.15.38:0/2126427165 shutdown_connections 2024-09-12T12:28:13.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.536+0000 7f0b0e400640 1 -- 172.21.15.38:0/2126427165 wait complete. 2024-09-12T12:28:13.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 Processor -- start 2024-09-12T12:28:13.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 -- start start 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b08102480 0x7f0b08101df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b08100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b081076e0 0x7f0b08100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0810d690 con 0x7f0b08102480 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0810d510 con 0x7f0b08104db0 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.537+0000 7f0b0e400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0810d810 con 0x7f0b081076e0 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b08100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0b0d000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b08102480 0x7f0b08101df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b08100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:49116/0 (socket says 172.21.15.38:49116) 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 -- 172.21.15.38:0/3436970596 learned_addr learned my addr 172.21.15.38:0/3436970596 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0b0da00640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b081076e0 0x7f0b08100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 -- 172.21.15.38:0/3436970596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b081076e0 msgr2=0x7f0b08100970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b081076e0 0x7f0b08100970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 -- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b08102480 msgr2=0x7f0b08101df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b08102480 0x7f0b08101df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 -- 172.21.15.38:0/3436970596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b08101200 con 0x7f0b08104db0 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0b0d000640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b08102480 0x7f0b08101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.538+0000 7f0affe00640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b08100430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0af0035040 tx=0x7f0af0033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.539+0000 7f0b06000640 1 -- 172.21.15.38:0/3436970596 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0037040 con 0x7f0b08104db0 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.539+0000 7f0b06000640 1 -- 172.21.15.38:0/3436970596 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af0030850 con 0x7f0b08104db0 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.539+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b081a1e60 con 0x7f0b08104db0 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.539+0000 7f0b06000640 1 -- 172.21.15.38:0/3436970596 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0004920 con 0x7f0b08104db0 2024-09-12T12:28:13.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.539+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b081a22c0 con 0x7f0b08104db0 2024-09-12T12:28:13.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.540+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b080fdb90 con 0x7f0b08104db0 2024-09-12T12:28:13.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.542+0000 7f0b06000640 1 -- 172.21.15.38:0/3436970596 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0af0004050 con 0x7f0b08104db0 2024-09-12T12:28:13.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.543+0000 7f0b06000640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0aec0a2b90 0x7f0aec0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.543+0000 7f0b06000640 1 -- 172.21.15.38:0/3436970596 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f0af00ef4f0 con 0x7f0b08104db0 2024-09-12T12:28:13.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.543+0000 7f0b0d000640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0aec0a2b90 0x7f0aec0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.544+0000 7f0b0d000640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0aec0a2b90 0x7f0aec0a5050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009fc0 tx=0x7f0af8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:13.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.545+0000 7f0b06000640 1 -- 172.21.15.38:0/3436970596 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0af00bc040 con 0x7f0b08104db0 2024-09-12T12:28:13.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.735+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b0802da10 con 0x7f0b08104db0 2024-09-12T12:28:13.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.736+0000 7f0b06000640 1 -- 172.21.15.38:0/3436970596 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f0af00bb940 con 0x7f0b08104db0 2024-09-12T12:28:13.737 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0aec0a2b90 msgr2=0x7f0aec0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0aec0a2b90 0x7f0aec0a5050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009fc0 tx=0x7f0af8005f90 comp rx=0 tx=0).stop 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 msgr2=0x7f0b08100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b08100430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0af0035040 tx=0x7f0af0033d90 comp rx=0 tx=0).stop 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 shutdown_connections 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f0aec0a2b90 0x7f0aec0a5050 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b081076e0 0x7f0b08100970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08104db0 0x7f0b08100430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 --2- 172.21.15.38:0/3436970596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b08102480 0x7f0b08101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 >> 172.21.15.38:0/3436970596 conn(0x7f0b080fc0a0 msgr2=0x7f0b08102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:13.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 shutdown_connections 2024-09-12T12:28:13.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.738+0000 7f0b0e400640 1 -- 172.21.15.38:0/3436970596 wait complete. 2024-09-12T12:28:13.755 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T12:28:13.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.919+0000 7fb945c00640 1 -- 172.21.15.38:0/992665582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 msgr2=0x7fb940105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.919+0000 7fb945c00640 1 --2- 172.21.15.38:0/992665582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 0x7fb940105390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb928009900 tx=0x7fb92802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.920+0000 7fb945c00640 1 -- 172.21.15.38:0/992665582 shutdown_connections 2024-09-12T12:28:13.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.920+0000 7fb945c00640 1 --2- 172.21.15.38:0/992665582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9401058d0 0x7fb94010c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.920+0000 7fb945c00640 1 --2- 172.21.15.38:0/992665582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 0x7fb940105390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.920+0000 7fb945c00640 1 --2- 172.21.15.38:0/992665582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb940103d20 0x7fb940104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.920+0000 7fb945c00640 1 -- 172.21.15.38:0/992665582 >> 172.21.15.38:0/992665582 conn(0x7fb9400ff4a0 msgr2=0x7fb9401018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:13.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.920+0000 7fb945c00640 1 -- 172.21.15.38:0/992665582 shutdown_connections 2024-09-12T12:28:13.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.920+0000 7fb945c00640 1 -- 172.21.15.38:0/992665582 wait complete. 2024-09-12T12:28:13.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 Processor -- start 2024-09-12T12:28:13.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 -- start start 2024-09-12T12:28:13.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb940103d20 0x7fb94019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 0x7fb94019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9401058d0 0x7fb9401a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb94010f9d0 con 0x7fb940103d20 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb94010f850 con 0x7fb940104f10 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb945c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb94010fb50 con 0x7fb9401058d0 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb93ea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb940103d20 0x7fb94019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb93ea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb940103d20 0x7fb94019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54338/0 (socket says 172.21.15.38:54338) 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb93ea00640 1 -- 172.21.15.38:0/3153817595 learned_addr learned my addr 172.21.15.38:0/3153817595 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb93f400640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9401058d0 0x7fb9401a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.921+0000 7fb937e00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 0x7fb94019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb93ea00640 1 -- 172.21.15.38:0/3153817595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9401058d0 msgr2=0x7fb9401a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb93ea00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9401058d0 0x7fb9401a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb93ea00640 1 -- 172.21.15.38:0/3153817595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 msgr2=0x7fb94019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb93ea00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 0x7fb94019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb93ea00640 1 -- 172.21.15.38:0/3153817595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9401a1ca0 con 0x7fb940103d20 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb937e00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 0x7fb94019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb93ea00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb940103d20 0x7fb94019a080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb93000e9c0 tx=0x7fb93000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb937400640 1 -- 172.21.15.38:0/3153817595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93000cd80 con 0x7fb940103d20 2024-09-12T12:28:13.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb937400640 1 -- 172.21.15.38:0/3153817595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb930010910 con 0x7fb940103d20 2024-09-12T12:28:13.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9401a1f90 con 0x7fb940103d20 2024-09-12T12:28:13.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb937400640 1 -- 172.21.15.38:0/3153817595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930018950 con 0x7fb940103d20 2024-09-12T12:28:13.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.922+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9401a2400 con 0x7fb940103d20 2024-09-12T12:28:13.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.923+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94010b160 con 0x7fb940103d20 2024-09-12T12:28:13.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.925+0000 7fb937400640 1 -- 172.21.15.38:0/3153817595 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb93001f020 con 0x7fb940103d20 2024-09-12T12:28:13.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.926+0000 7fb937400640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb9240a2c10 0x7fb9240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:13.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.927+0000 7fb937400640 1 -- 172.21.15.38:0/3153817595 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fb9300cf540 con 0x7fb940103d20 2024-09-12T12:28:13.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.927+0000 7fb937e00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb9240a2c10 0x7fb9240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:13.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.927+0000 7fb937e00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb9240a2c10 0x7fb9240a50d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb928006010 tx=0x7fb928000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:13.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:13.931+0000 7fb937400640 1 -- 172.21.15.38:0/3153817595 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb93001e2c0 con 0x7fb940103d20 2024-09-12T12:28:13.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:13 smithi038 ceph-mon[30810]: pgmap v462: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 17 op/s 2024-09-12T12:28:13.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:13 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2180927386' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:28:14.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:13 smithi071 ceph-mon[34859]: pgmap v462: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 17 op/s 2024-09-12T12:28:14.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:13 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2180927386' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:28:14.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.116+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb940062ef0 con 0x7fb940103d20 2024-09-12T12:28:14.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.116+0000 7fb937400640 1 -- 172.21.15.38:0/3153817595 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7fb93009c090 con 0x7fb940103d20 2024-09-12T12:28:14.117 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-12T12:28:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb9240a2c10 msgr2=0x7fb9240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb9240a2c10 0x7fb9240a50d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb928006010 tx=0x7fb928000bc0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb940103d20 msgr2=0x7fb94019a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb940103d20 0x7fb94019a080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb93000e9c0 tx=0x7fb93000edc0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 shutdown_connections 2024-09-12T12:28:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fb9240a2c10 0x7fb9240a50d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9401058d0 0x7fb9401a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb940104f10 0x7fb94019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 --2- 172.21.15.38:0/3153817595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb940103d20 0x7fb94019a080 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.118+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 >> 172.21.15.38:0/3153817595 conn(0x7fb9400ff4a0 msgr2=0x7fb940108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:14.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.119+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 shutdown_connections 2024-09-12T12:28:14.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.119+0000 7fb945c00640 1 -- 172.21.15.38:0/3153817595 wait complete. 2024-09-12T12:28:14.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T12:28:14.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:13 smithi154 ceph-mon[35578]: pgmap v462: 129 pgs: 129 active+clean; 258 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 17 op/s 2024-09-12T12:28:14.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:13 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2180927386' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:28:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 -- 172.21.15.38:0/642273289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 msgr2=0x7fa4a0104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 --2- 172.21.15.38:0/642273289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 0x7fa4a0104010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa490009900 tx=0x7fa49002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 -- 172.21.15.38:0/642273289 shutdown_connections 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 --2- 172.21.15.38:0/642273289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a01057c0 0x7fa4a010c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 --2- 172.21.15.38:0/642273289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 0x7fa4a0105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 --2- 172.21.15.38:0/642273289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 0x7fa4a0104010 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 -- 172.21.15.38:0/642273289 >> 172.21.15.38:0/642273289 conn(0x7fa4a00ff390 msgr2=0x7fa4a01017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 -- 172.21.15.38:0/642273289 shutdown_connections 2024-09-12T12:28:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.296+0000 7fa49fe00640 1 -- 172.21.15.38:0/642273289 wait complete. 2024-09-12T12:28:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 Processor -- start 2024-09-12T12:28:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 -- start start 2024-09-12T12:28:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 0x7fa4a0199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 0x7fa4a019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a01057c0 0x7fa4a01a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a010f8c0 con 0x7fa4a0104e00 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a010f740 con 0x7fa4a0103c10 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.297+0000 7fa49fe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a010fa40 con 0x7fa4a01057c0 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 0x7fa4a019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 0x7fa4a019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54356/0 (socket says 172.21.15.38:54356) 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 -- 172.21.15.38:0/1394231219 learned_addr learned my addr 172.21.15.38:0/1394231219 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49ea00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 0x7fa4a0199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49f400640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a01057c0 0x7fa4a01a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 -- 172.21.15.38:0/1394231219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a01057c0 msgr2=0x7fa4a01a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a01057c0 0x7fa4a01a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 -- 172.21.15.38:0/1394231219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 msgr2=0x7fa4a0199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 0x7fa4a0199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 -- 172.21.15.38:0/1394231219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a01a1b90 con 0x7fa4a0104e00 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49ea00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 0x7fa4a0199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.298+0000 7fa49e000640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 0x7fa4a019a4b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00e9f0 tx=0x7fa48c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.299+0000 7fa497400640 1 -- 172.21.15.38:0/1394231219 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00cd80 con 0x7fa4a0104e00 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.299+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a01a1e80 con 0x7fa4a0104e00 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.299+0000 7fa497400640 1 -- 172.21.15.38:0/1394231219 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa48c010910 con 0x7fa4a0104e00 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.299+0000 7fa497400640 1 -- 172.21.15.38:0/1394231219 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0188f0 con 0x7fa4a0104e00 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.299+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a01a2340 con 0x7fa4a0104e00 2024-09-12T12:28:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.300+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a010b000 con 0x7fa4a0104e00 2024-09-12T12:28:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.302+0000 7fa497400640 1 -- 172.21.15.38:0/1394231219 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa48c010ac0 con 0x7fa4a0104e00 2024-09-12T12:28:14.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.303+0000 7fa497400640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4840a2b90 0x7fa4840a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.303+0000 7fa497400640 1 -- 172.21.15.38:0/1394231219 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fa48c0cf800 con 0x7fa4a0104e00 2024-09-12T12:28:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.303+0000 7fa49ea00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4840a2b90 0x7fa4840a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.304+0000 7fa49ea00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4840a2b90 0x7fa4840a5050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa49002a9e0 tx=0x7fa4900315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.307+0000 7fa497400640 1 -- 172.21.15.38:0/1394231219 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa48c09bd00 con 0x7fa4a0104e00 2024-09-12T12:28:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.496+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa4a0062df0 con 0x7fa4a0104e00 2024-09-12T12:28:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.496+0000 7fa497400640 1 -- 172.21.15.38:0/1394231219 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fa48c0a0000 con 0x7fa4a0104e00 2024-09-12T12:28:14.497 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-09-12T12:28:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4840a2b90 msgr2=0x7fa4840a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4840a2b90 0x7fa4840a5050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa49002a9e0 tx=0x7fa4900315b0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 msgr2=0x7fa4a019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 0x7fa4a019a4b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00e9f0 tx=0x7fa48c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 shutdown_connections 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fa4840a2b90 0x7fa4840a5050 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a01057c0 0x7fa4a01a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4a0104e00 0x7fa4a019a4b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 --2- 172.21.15.38:0/1394231219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a0103c10 0x7fa4a0199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 >> 172.21.15.38:0/1394231219 conn(0x7fa4a00ff390 msgr2=0x7fa4a01081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 shutdown_connections 2024-09-12T12:28:14.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.499+0000 7fa49fe00640 1 -- 172.21.15.38:0/1394231219 wait complete. 2024-09-12T12:28:14.517 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T12:28:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.678+0000 7fe77d600640 1 -- 172.21.15.38:0/3000712718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 msgr2=0x7fe77810c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.678+0000 7fe77d600640 1 --2- 172.21.15.38:0/3000712718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 0x7fe77810c160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe770009ca0 tx=0x7fe77002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.679+0000 7fe77d600640 1 -- 172.21.15.38:0/3000712718 shutdown_connections 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.679+0000 7fe77d600640 1 --2- 172.21.15.38:0/3000712718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 0x7fe77810c160 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.679+0000 7fe77d600640 1 --2- 172.21.15.38:0/3000712718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe778104f10 0x7fe778105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.679+0000 7fe77d600640 1 --2- 172.21.15.38:0/3000712718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe778103d20 0x7fe778104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.679+0000 7fe77d600640 1 -- 172.21.15.38:0/3000712718 >> 172.21.15.38:0/3000712718 conn(0x7fe7780ff4a0 msgr2=0x7fe7781018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.679+0000 7fe77d600640 1 -- 172.21.15.38:0/3000712718 shutdown_connections 2024-09-12T12:28:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.679+0000 7fe77d600640 1 -- 172.21.15.38:0/3000712718 wait complete. 2024-09-12T12:28:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 Processor -- start 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 -- start start 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe778103d20 0x7fe77819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe778104f10 0x7fe77819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 0x7fe7781a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810f9a0 con 0x7fe7781058d0 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810f820 con 0x7fe778103d20 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe77d600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810fb20 con 0x7fe778104f10 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe777400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 0x7fe7781a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe776000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe778104f10 0x7fe77819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe776a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe778103d20 0x7fe77819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe777400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 0x7fe7781a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54362/0 (socket says 172.21.15.38:54362) 2024-09-12T12:28:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.680+0000 7fe777400640 1 -- 172.21.15.38:0/1381293149 learned_addr learned my addr 172.21.15.38:0/1381293149 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.681+0000 7fe776000640 1 -- 172.21.15.38:0/1381293149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe778103d20 msgr2=0x7fe77819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.681+0000 7fe776000640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe778103d20 0x7fe77819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.681+0000 7fe776000640 1 -- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 msgr2=0x7fe7781a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.681+0000 7fe776000640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 0x7fe7781a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.681+0000 7fe776000640 1 -- 172.21.15.38:0/1381293149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7781a1c40 con 0x7fe778104f10 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.681+0000 7fe776000640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe778104f10 0x7fe77819a560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9f0 tx=0x7fe76400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.681+0000 7fe76f400640 1 -- 172.21.15.38:0/1381293149 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76400cd80 con 0x7fe778104f10 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.682+0000 7fe76f400640 1 -- 172.21.15.38:0/1381293149 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7640035f0 con 0x7fe778104f10 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.682+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7781a1f30 con 0x7fe778104f10 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.682+0000 7fe76f400640 1 -- 172.21.15.38:0/1381293149 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764010670 con 0x7fe778104f10 2024-09-12T12:28:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.682+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781a2440 con 0x7fe778104f10 2024-09-12T12:28:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.683+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77810b0e0 con 0x7fe778104f10 2024-09-12T12:28:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.685+0000 7fe76f400640 1 -- 172.21.15.38:0/1381293149 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe7640037a0 con 0x7fe778104f10 2024-09-12T12:28:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.687+0000 7fe76f400640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe75c0a2c10 0x7fe75c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.687+0000 7fe76f400640 1 -- 172.21.15.38:0/1381293149 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fe7640cf6c0 con 0x7fe778104f10 2024-09-12T12:28:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.687+0000 7fe776a00640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe75c0a2c10 0x7fe75c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.688+0000 7fe776a00640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe75c0a2c10 0x7fe75c0a50d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe778104d70 tx=0x7fe768005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.688+0000 7fe76f400640 1 -- 172.21.15.38:0/1381293149 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe76409c2a0 con 0x7fe778104f10 2024-09-12T12:28:14.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.878+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe77802da10 con 0x7fe778104f10 2024-09-12T12:28:14.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.879+0000 7fe76f400640 1 -- 172.21.15.38:0/1381293149 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7fe76409bba0 con 0x7fe778104f10 2024-09-12T12:28:14.879 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-12T12:28:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe75c0a2c10 msgr2=0x7fe75c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe75c0a2c10 0x7fe75c0a50d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe778104d70 tx=0x7fe768005f90 comp rx=0 tx=0).stop 2024-09-12T12:28:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe778104f10 msgr2=0x7fe77819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe778104f10 0x7fe77819a560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9f0 tx=0x7fe76400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 shutdown_connections 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe75c0a2c10 0x7fe75c0a50d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7781058d0 0x7fe7781a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe778104f10 0x7fe77819a560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 --2- 172.21.15.38:0/1381293149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe778103d20 0x7fe77819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 >> 172.21.15.38:0/1381293149 conn(0x7fe7780ff4a0 msgr2=0x7fe7781082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 shutdown_connections 2024-09-12T12:28:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:14.881+0000 7fe77d600640 1 -- 172.21.15.38:0/1381293149 wait complete. 2024-09-12T12:28:14.896 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:14 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3436970596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:28:14.896 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:14 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3153817595' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:28:14.896 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:14 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1394231219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:28:14.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T12:28:15.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:14 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3436970596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:28:15.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:14 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3153817595' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:28:15.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:14 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1394231219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:28:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.055+0000 7fba72a00640 1 -- 172.21.15.38:0/3636139733 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c02f310 con 0x7fba741058e0 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 -- 172.21.15.38:0/3636139733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 msgr2=0x7fba7410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 --2- 172.21.15.38:0/3636139733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 0x7fba7410c170 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009ca0 tx=0x7fba6c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 -- 172.21.15.38:0/3636139733 shutdown_connections 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 --2- 172.21.15.38:0/3636139733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 0x7fba7410c170 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 --2- 172.21.15.38:0/3636139733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74104f20 0x7fba741053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 --2- 172.21.15.38:0/3636139733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 0x7fba74104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 -- 172.21.15.38:0/3636139733 >> 172.21.15.38:0/3636139733 conn(0x7fba740ff4b0 msgr2=0x7fba741018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 -- 172.21.15.38:0/3636139733 shutdown_connections 2024-09-12T12:28:15.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.056+0000 7fba7ae00640 1 -- 172.21.15.38:0/3636139733 wait complete. 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.057+0000 7fba7ae00640 1 Processor -- start 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.057+0000 7fba7ae00640 1 -- start start 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.057+0000 7fba7ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 0x7fba74199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.057+0000 7fba7ae00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74104f20 0x7fba7419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba7ae00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 0x7fba741a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba7ae00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fba7410f9b0 con 0x7fba741058e0 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba7ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba7410f830 con 0x7fba74103d30 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba7ae00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba7410fb30 con 0x7fba74104f20 2024-09-12T12:28:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 0x7fba74199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba78e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 0x7fba741a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 0x7fba74199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:49196/0 (socket says 172.21.15.38:49196) 2024-09-12T12:28:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 -- 172.21.15.38:0/1710966565 learned_addr learned my addr 172.21.15.38:0/1710966565 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73400640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74104f20 0x7fba7419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 -- 172.21.15.38:0/1710966565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74104f20 msgr2=0x7fba7419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74104f20 0x7fba7419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 -- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 msgr2=0x7fba741a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 0x7fba741a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba73e00640 1 -- 172.21.15.38:0/1710966565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba741a1c00 con 0x7fba74103d30 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.058+0000 7fba78e00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 0x7fba741a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.059+0000 7fba73e00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 0x7fba74199fe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba6400e9c0 tx=0x7fba6400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.059+0000 7fba70c00640 1 -- 172.21.15.38:0/1710966565 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6400cde0 con 0x7fba74103d30 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.059+0000 7fba70c00640 1 -- 172.21.15.38:0/1710966565 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba64010910 con 0x7fba74103d30 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.059+0000 7fba70c00640 1 -- 172.21.15.38:0/1710966565 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64018a00 con 0x7fba74103d30 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.059+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba741a1ef0 con 0x7fba74103d30 2024-09-12T12:28:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.059+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba741a22a0 con 0x7fba74103d30 2024-09-12T12:28:15.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.060+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba7410b0d0 con 0x7fba74103d30 2024-09-12T12:28:15.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.062+0000 7fba70c00640 1 -- 172.21.15.38:0/1710966565 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fba6401f020 con 0x7fba74103d30 2024-09-12T12:28:15.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.063+0000 7fba70c00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fba580a2b90 0x7fba580a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:15.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.064+0000 7fba70c00640 1 -- 172.21.15.38:0/1710966565 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fba640cf610 con 0x7fba74103d30 2024-09-12T12:28:15.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.064+0000 7fba73400640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fba580a2b90 0x7fba580a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:15.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.064+0000 7fba73400640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fba580a2b90 0x7fba580a5050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fba7419b4f0 tx=0x7fba60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:15.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.067+0000 7fba70c00640 1 -- 172.21.15.38:0/1710966565 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba6409c160 con 0x7fba74103d30 2024-09-12T12:28:15.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:14 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3436970596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:28:15.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:14 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3153817595' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:28:15.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:14 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1394231219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:28:15.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.303+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fba74062ef0 con 0x7fba74103d30 2024-09-12T12:28:15.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.312+0000 7fba70c00640 1 -- 172.21.15.38:0/1710966565 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740371 (secure 0 0 0) 0x7fba6409ba60 con 0x7fba74103d30 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 18, 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: "active_gid": 14150, 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: "active_name": "x", 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: "active_addrs": { 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1234723065 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1234723065 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "active_addr": "172.21.15.38:6801/1234723065", 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "active_change": "2024-09-12T12:15:33.977060+0000", 2024-09-12T12:28:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "available": true, 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "standbys": [ 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "gid": 24109, 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "z", 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_features": 4540701547738038271, 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2024-09-12T12:28:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2024-09-12T12:28:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2024-09-12T12:28:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2024-09-12T12:28:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2024-09-12T12:28:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2024-09-12T12:28:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2024-09-12T12:28:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:28:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2024-09-12T12:28:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2024-09-12T12:28:15.348 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2024-09-12T12:28:15.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:28:15.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2024-09-12T12:28:15.351 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:28:15.352 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:28:15.353 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2359", 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.354 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-12T12:28:15.355 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.356 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.357 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.358 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.359 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.361 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.362 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.362 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.362 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2024-09-12T12:28:15.362 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.363 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2024-09-12T12:28:15.364 INFO:teuthology.orchestra.run.smithi038.stdout: "read", 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap", 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap-read" 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2024-09-12T12:28:15.365 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:15.366 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.367 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.368 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.369 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2024-09-12T12:28:15.370 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_down_multiplier": { 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_down_multiplier", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:28:15.371 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_refresh_rate": { 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_refresh_rate", 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "20", 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.372 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_starting_port": { 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_starting_port", 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4721", 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.373 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.374 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2024-09-12T12:28:15.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:28:15.376 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.377 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm_log_destination": { 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm_log_destination", 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.378 INFO:teuthology.orchestra.run.smithi038.stdout: "file", 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "file,syslog", 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "syslog" 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "cgroups_split": { 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cgroups_split", 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.379 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.380 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.381 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.382 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.383 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.384 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_elasticsearch": { 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.385 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "elasticsearch container image", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.386 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2024-09-12T12:28:15.387 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_agent": { 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_collector": { 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.390 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_query": { 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger query container image", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.391 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.392 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_loki": { 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_loki", 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:28:15.393 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Loki container image", 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.394 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nvmeof": { 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nvmeof", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.395 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nvme-of container image", 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2024-09-12T12:28:15.396 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.397 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_promtail": { 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_promtail", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Promtail container image", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.398 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba": { 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.399 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:28:15.400 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.402 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "900", 2024-09-12T12:28:15.403 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.404 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2024-09-12T12:28:15.405 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.406 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.407 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.408 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "grafana_dashboards_path": { 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.410 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "hw_monitoring": { 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hw_monitoring", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.411 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "inventory_list_all": { 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "inventory_list_all", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.412 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.413 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "log_refresh_metadata": { 2024-09-12T12:28:15.414 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_refresh_metadata", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.415 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.416 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.417 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.420 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2024-09-12T12:28:15.421 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2024-09-12T12:28:15.422 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2024-09-12T12:28:15.423 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-12T12:28:15.424 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.425 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "oob_default_addr": { 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "oob_default_addr", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "169.254.1.1", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.426 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:28:15.427 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.428 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.429 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2024-09-12T12:28:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.431 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.432 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "secure_monitoring_stack": { 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.433 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "service_discovery_port": { 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "service_discovery_port", 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.434 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8765", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.435 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "use_agent": { 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_agent", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.436 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.437 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.438 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.439 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.441 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.442 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.443 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.444 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.445 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.446 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.447 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.448 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:28:15.449 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.450 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.451 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.452 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.453 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.454 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.455 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.456 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.457 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:28:15.458 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.459 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.460 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.463 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.464 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.465 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.466 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:28:15.467 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:28:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.469 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.470 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.471 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.472 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.473 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.474 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.475 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.476 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.477 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.478 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.479 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.480 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:28:15.481 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.482 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:28:15.483 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:28:15.484 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.485 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.488 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.489 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.490 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2024-09-12T12:28:15.491 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.495 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.496 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.497 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2024-09-12T12:28:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2024-09-12T12:28:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2024-09-12T12:28:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2024-09-12T12:28:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-12T12:28:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.511 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.512 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.513 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.514 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2024-09-12T12:28:15.515 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.516 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-12T12:28:15.517 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.518 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.519 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.520 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.520 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.520 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.520 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.520 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.521 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-12T12:28:15.521 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.521 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.521 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.521 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2024-09-12T12:28:15.521 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2024-09-12T12:28:15.522 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.523 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.524 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.525 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.526 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.527 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.528 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.529 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2024-09-12T12:28:15.530 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:28:15.531 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.532 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.534 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2024-09-12T12:28:15.535 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.536 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.537 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.538 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.539 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.540 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.541 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.542 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.543 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2024-09-12T12:28:15.544 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.545 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.546 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2024-09-12T12:28:15.548 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.549 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.550 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "5", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.551 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.552 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.553 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.554 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.555 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.556 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.557 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.558 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server port", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.559 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.560 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "32", 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2024-09-12T12:28:15.561 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2024-09-12T12:28:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.563 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.564 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.565 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.566 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.567 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.568 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.569 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2024-09-12T12:28:15.570 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.571 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.572 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.573 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.574 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.575 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "k8sevents", 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_event_retention_days": { 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:28:15.576 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.577 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "config_check_secs": { 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_check_secs", 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "10", 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.578 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.579 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.580 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.581 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.582 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.583 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.584 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.585 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.585 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.585 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2024-09-12T12:28:15.585 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.585 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.585 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.585 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2024-09-12T12:28:15.588 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2024-09-12T12:28:15.588 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.588 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.588 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2024-09-12T12:28:15.588 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.589 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.590 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.591 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.592 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.593 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2024-09-12T12:28:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.596 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:28:15.597 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:28:15.598 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.600 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.601 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.602 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.603 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.604 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.605 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.606 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.607 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.608 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.610 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.611 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.612 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2024-09-12T12:28:15.613 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.614 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.615 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.617 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.618 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.619 INFO:teuthology.orchestra.run.smithi038.stdout: "fail_fs": { 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "fail_fs", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.621 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.622 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.623 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.624 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.625 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2024-09-12T12:28:15.626 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_perf_query", 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.627 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.628 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.629 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.631 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.632 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.633 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.634 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.637 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.640 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.641 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.642 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.645 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.646 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "threshold": { 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threshold", 2024-09-12T12:28:15.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1.0", 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "scaling threshold", 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:28:15.648 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.649 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_pg_recovery_event": { 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.650 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.651 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.652 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.653 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.654 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.655 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.659 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.660 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "exclude_perf_counters": { 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "exclude_perf_counters", 2024-09-12T12:28:15.661 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.663 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.664 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.665 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.666 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.670 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:15.671 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:15.672 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2024-09-12T12:28:15.673 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.674 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.675 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.676 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.677 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.678 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.679 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.680 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.681 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2024-09-12T12:28:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.683 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.684 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.685 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.686 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.687 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.688 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.689 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.690 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.691 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.692 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rgw", 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.696 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.697 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.698 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.699 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.700 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.701 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2024-09-12T12:28:15.702 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.703 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.704 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.705 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.707 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.708 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "storage_class": { 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "storage_class", 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.709 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "local", 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.710 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.711 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.713 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.714 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.715 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2024-09-12T12:28:15.716 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2024-09-12T12:28:15.717 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2024-09-12T12:28:15.718 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2024-09-12T12:28:15.719 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.720 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.721 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.722 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.723 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.724 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption7": { 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption7", 2024-09-12T12:28:15.725 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "42", 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2024-09-12T12:28:15.726 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2024-09-12T12:28:15.727 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2024-09-12T12:28:15.728 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.729 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.731 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.732 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.733 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.734 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.735 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.736 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.737 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.738 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.739 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.740 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.742 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.743 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.744 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.745 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.746 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.747 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.748 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.749 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.750 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.751 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.752 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.753 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.754 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.755 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.756 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.757 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.758 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2024-09-12T12:28:15.759 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2024-09-12T12:28:15.760 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_perf": { 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_perf", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.769 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard_description": { 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard_description", 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.771 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.772 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.773 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.774 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.775 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.776 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.777 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.778 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.779 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.781 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.782 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.784 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.785 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.786 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.787 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.788 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.789 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.790 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.791 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.792 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "periodic_async_work": { 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "periodic_async_work", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.793 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Periodically check for async work", 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.795 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2024-09-12T12:28:15.796 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.797 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.798 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.799 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.800 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.807 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.808 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: "gid": 24119, 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "y", 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_features": 4540701547738038271, 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.809 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.810 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.811 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.813 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.815 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.816 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.817 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.818 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.819 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.820 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.821 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.822 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.823 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.824 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:28:15.825 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:28:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:28:15.827 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:28:15.828 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:28:15.829 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.830 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2359", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.831 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-12T12:28:15.832 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.833 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.834 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.835 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.836 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.838 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2024-09-12T12:28:15.840 INFO:teuthology.orchestra.run.smithi038.stdout: "read", 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap", 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap-read" 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.841 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.842 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.843 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:15.844 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.845 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_down_multiplier": { 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_down_multiplier", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:28:15.846 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_refresh_rate": { 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_refresh_rate", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "20", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:28:15.847 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_starting_port": { 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_starting_port", 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4721", 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.849 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.850 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:15.851 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm_log_destination": { 2024-09-12T12:28:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm_log_destination", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "file", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "file,syslog", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "syslog" 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.853 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "cgroups_split": { 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cgroups_split", 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:28:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:28:15.855 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.856 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.857 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.858 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_elasticsearch": { 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.859 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "elasticsearch container image", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.860 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.861 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_agent": { 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.862 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_collector": { 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.863 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_query": { 2024-09-12T12:28:15.864 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger query container image", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.865 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.866 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_loki": { 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_loki", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Loki container image", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.868 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nvmeof": { 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nvmeof", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nvme-of container image", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.869 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.870 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_promtail": { 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_promtail", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.871 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Promtail container image", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba": { 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.872 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.873 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.874 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.875 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "900", 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.876 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.877 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.878 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.879 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2024-09-12T12:28:15.880 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.881 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "grafana_dashboards_path": { 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.882 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.883 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "hw_monitoring": { 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hw_monitoring", 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.884 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "inventory_list_all": { 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "inventory_list_all", 2024-09-12T12:28:15.885 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.886 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.887 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "log_refresh_metadata": { 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_refresh_metadata", 2024-09-12T12:28:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.890 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.891 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.892 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.893 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.894 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.895 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.896 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.897 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.898 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.899 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:28:15.900 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "oob_default_addr": { 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "oob_default_addr", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "169.254.1.1", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:28:15.901 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:28:15.902 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:28:15.903 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:28:15.904 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.905 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.906 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "secure_monitoring_stack": { 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.907 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "service_discovery_port": { 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "service_discovery_port", 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8765", 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.908 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.909 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "use_agent": { 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_agent", 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.910 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.911 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.912 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:28:15.913 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.914 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.915 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.916 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.917 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.918 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.919 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.920 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.921 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.922 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2024-09-12T12:28:15.923 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:28:15.926 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.927 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.929 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.930 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.931 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.932 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.935 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.936 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.937 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.938 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.939 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.940 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:15.941 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.942 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2024-09-12T12:28:15.943 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.944 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.945 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.946 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:28:15.948 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.950 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.951 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.952 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.953 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:28:15.954 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:28:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.956 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.957 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.958 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:28:15.959 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.960 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.961 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.962 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.963 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.964 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.965 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.966 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.967 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.968 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.969 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.971 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.972 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.973 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.974 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:28:15.975 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.976 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.978 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.979 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.980 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.981 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.982 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.983 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2024-09-12T12:28:15.984 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.989 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.990 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-12T12:28:15.991 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.992 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2024-09-12T12:28:15.993 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.994 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.996 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:15.997 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:15.998 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:15.999 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.000 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.001 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.002 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:28:16.003 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:28:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.005 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.008 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.009 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.010 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.011 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.012 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.013 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.014 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.015 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.017 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:28:16.018 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:28:16.019 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "5", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:28:16.020 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.021 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.022 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.023 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.024 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.025 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.026 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server port", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "32", 2024-09-12T12:28:16.029 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.030 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.031 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.032 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.033 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.034 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.035 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.036 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.037 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.038 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.039 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.040 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.041 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.042 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "k8sevents", 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_event_retention_days": { 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:28:16.043 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "config_check_secs": { 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_check_secs", 2024-09-12T12:28:16.044 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "10", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.046 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.047 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.048 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.049 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.050 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2024-09-12T12:28:16.051 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.052 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.053 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.054 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.055 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.056 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2024-09-12T12:28:16.057 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2024-09-12T12:28:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2024-09-12T12:28:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.060 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.061 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.062 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.063 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.064 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.065 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.066 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.067 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.068 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.069 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.070 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.071 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.072 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.073 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.074 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.075 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.076 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.077 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.078 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "fail_fs": { 2024-09-12T12:28:16.079 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "fail_fs", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.080 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.081 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.082 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.083 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.086 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_perf_query", 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.087 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.088 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.089 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.090 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.091 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.093 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.094 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.095 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.096 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.097 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.098 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.099 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.100 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.101 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.102 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "threshold": { 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threshold", 2024-09-12T12:28:16.104 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1.0", 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "scaling threshold", 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.105 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_pg_recovery_event": { 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.106 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.107 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.108 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.109 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.110 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.111 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.112 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.113 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.114 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2024-09-12T12:28:16.115 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.116 INFO:teuthology.orchestra.run.smithi038.stdout: "exclude_perf_counters": { 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "exclude_perf_counters", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.117 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.118 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.119 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.120 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.121 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.122 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.123 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.124 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.125 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.126 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.129 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.130 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.134 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.135 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2024-09-12T12:28:16.136 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.137 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.138 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.139 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.140 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.141 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.142 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.143 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.144 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.145 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.146 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.147 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rgw", 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.149 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.150 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.151 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.152 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.153 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.154 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.156 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.158 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.159 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.160 INFO:teuthology.orchestra.run.smithi038.stdout: "storage_class": { 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "storage_class", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "local", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.161 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.162 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.163 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.164 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.165 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.166 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.167 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.168 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.169 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.170 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.171 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.172 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.173 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.174 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.175 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.176 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption7": { 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption7", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.177 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "42", 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.178 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2024-09-12T12:28:16.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2024-09-12T12:28:16.180 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.182 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.183 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.184 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.185 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.186 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.187 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.190 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.191 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.192 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.193 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.195 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.196 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.197 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.197 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.197 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.197 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.197 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.197 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.200 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.200 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.200 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.200 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.200 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.201 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.203 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.204 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.205 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.206 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.207 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.208 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.209 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.210 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.212 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.213 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.214 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.215 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_perf": { 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_perf", 2024-09-12T12:28:16.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.217 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.218 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.219 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.220 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.221 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.222 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.223 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.224 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard_description": { 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard_description", 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.225 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.226 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.227 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.228 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.229 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.230 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.233 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.234 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.236 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.237 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.238 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.239 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.240 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-12T12:28:16.241 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.242 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.243 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.244 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.245 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.246 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.247 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "periodic_async_work": { 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "periodic_async_work", 2024-09-12T12:28:16.248 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Periodically check for async work", 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.249 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.250 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.251 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.252 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2024-09-12T12:28:16.253 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.254 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.255 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.256 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.257 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.258 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.259 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.260 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.261 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.262 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.263 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: "modules": [ 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: "dashboard", 2024-09-12T12:28:16.264 INFO:teuthology.orchestra.run.smithi038.stdout: "iostat", 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "nfs", 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "restful" 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.265 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.266 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.267 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.268 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.269 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.270 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.271 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.272 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.273 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.274 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.276 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.277 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.278 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.279 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2024-09-12T12:28:16.280 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.281 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.282 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2024-09-12T12:28:16.283 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.284 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.285 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:28:16.286 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:28:16.287 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2359", 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:28:16.288 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:28:16.289 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.290 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.291 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.292 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.293 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.294 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.295 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2024-09-12T12:28:16.296 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "read", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap-read" 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.297 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.299 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:28:16.300 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.301 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.302 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_down_multiplier": { 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_down_multiplier", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_refresh_rate": { 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_refresh_rate", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "20", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.304 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_starting_port": { 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_starting_port", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4721", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.305 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:28:16.306 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.307 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm_log_destination": { 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm_log_destination", 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "file", 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "file,syslog", 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "syslog" 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "cgroups_split": { 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cgroups_split", 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.310 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.311 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.312 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.313 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.314 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_elasticsearch": { 2024-09-12T12:28:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "elasticsearch container image", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2024-09-12T12:28:16.316 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2024-09-12T12:28:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_agent": { 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.319 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_collector": { 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.320 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_query": { 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger query container image", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.321 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.322 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_loki": { 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_loki", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Loki container image", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.323 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.324 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nvmeof": { 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nvmeof", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nvme-of container image", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.325 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.326 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_promtail": { 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_promtail", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Promtail container image", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba": { 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:28:16.329 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.330 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:16.331 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.332 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "900", 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.333 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2024-09-12T12:28:16.334 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2024-09-12T12:28:16.335 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2024-09-12T12:28:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.337 INFO:teuthology.orchestra.run.smithi038.stdout: "grafana_dashboards_path": { 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.338 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.339 INFO:teuthology.orchestra.run.smithi038.stdout: "hw_monitoring": { 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hw_monitoring", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "inventory_list_all": { 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "inventory_list_all", 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.341 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.342 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "log_refresh_metadata": { 2024-09-12T12:28:16.343 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_refresh_metadata", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.345 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.346 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.347 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:28:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:28:16.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.349 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.349 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.349 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.349 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.349 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.350 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.350 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:28:16.350 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.350 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.350 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.351 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:28:16.351 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:28:16.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.351 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.351 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.351 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2024-09-12T12:28:16.352 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.352 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.352 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.352 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:28:16.352 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.352 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.353 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.353 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2024-09-12T12:28:16.353 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2024-09-12T12:28:16.353 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.353 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.354 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.354 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.354 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.354 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.354 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.354 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:28:16.355 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.355 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.355 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.355 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2024-09-12T12:28:16.355 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2024-09-12T12:28:16.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.356 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.356 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.356 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.356 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.356 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.357 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.357 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:28:16.357 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.357 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.357 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.358 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2024-09-12T12:28:16.358 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2024-09-12T12:28:16.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.358 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.358 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.359 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.359 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.359 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.359 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.359 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2024-09-12T12:28:16.359 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.360 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.360 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.360 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-12T12:28:16.360 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-12T12:28:16.360 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.361 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.361 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.361 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2024-09-12T12:28:16.361 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.361 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.361 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.361 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2024-09-12T12:28:16.362 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2024-09-12T12:28:16.362 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.362 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:28:16.362 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.362 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.362 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.363 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.363 INFO:teuthology.orchestra.run.smithi038.stdout: "oob_default_addr": { 2024-09-12T12:28:16.363 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "oob_default_addr", 2024-09-12T12:28:16.363 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.363 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.363 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.364 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "169.254.1.1", 2024-09-12T12:28:16.364 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.364 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.364 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:28:16.365 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.365 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.365 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.365 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2024-09-12T12:28:16.365 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:28:16.366 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.366 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.366 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.366 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:28:16.366 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.366 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.367 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.367 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:28:16.367 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.367 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.367 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.367 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.368 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2024-09-12T12:28:16.368 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2024-09-12T12:28:16.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.368 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.368 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.368 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.369 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.369 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.369 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.369 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:28:16.369 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.369 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.370 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.370 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2024-09-12T12:28:16.370 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2024-09-12T12:28:16.370 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.370 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.371 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.371 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.371 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.371 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.371 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.372 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:28:16.372 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.372 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.372 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.372 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.372 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2024-09-12T12:28:16.373 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2024-09-12T12:28:16.373 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.373 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.373 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.373 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.373 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.374 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.374 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.374 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:28:16.374 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.374 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.374 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.375 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2024-09-12T12:28:16.375 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2024-09-12T12:28:16.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.375 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.376 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.376 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.376 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.376 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.376 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.376 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:28:16.377 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.377 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.377 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.377 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.377 INFO:teuthology.orchestra.run.smithi038.stdout: "secure_monitoring_stack": { 2024-09-12T12:28:16.377 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:28:16.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.378 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.378 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.378 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.378 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.379 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.379 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.379 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:28:16.379 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.379 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.379 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.380 INFO:teuthology.orchestra.run.smithi038.stdout: "service_discovery_port": { 2024-09-12T12:28:16.380 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "service_discovery_port", 2024-09-12T12:28:16.380 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.380 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.380 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.381 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8765", 2024-09-12T12:28:16.381 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.381 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.381 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.381 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.382 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "use_agent": { 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_agent", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.383 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.384 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.385 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.386 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.387 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.388 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.389 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.390 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.391 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.392 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.393 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.394 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.395 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.396 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:28:16.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.398 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.399 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.400 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.402 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.402 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:28:16.402 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:28:16.402 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.402 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.402 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.404 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.405 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.406 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.407 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.408 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.409 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.411 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.412 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.413 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.414 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.415 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.416 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.417 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.418 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.419 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.420 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.421 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.422 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.423 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.424 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.425 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.426 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.427 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.428 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.429 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:28:16.430 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:28:16.431 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.432 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.433 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.434 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.435 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.436 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.439 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.440 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.441 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.442 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.443 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.444 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:28:16.445 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.446 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.447 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.448 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.449 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.450 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.451 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.452 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.453 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.454 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-12T12:28:16.455 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.456 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.457 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.458 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.459 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.460 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.461 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.462 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.463 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.464 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.465 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.466 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.467 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.468 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.469 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.470 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.471 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.472 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.473 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.474 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:28:16.475 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:28:16.476 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.477 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.478 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.479 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.480 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.481 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.482 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.483 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.484 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.485 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.486 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.487 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.488 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.489 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "5", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.490 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.491 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.492 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.493 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.494 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2024-09-12T12:28:16.495 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2024-09-12T12:28:16.496 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server port", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.497 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.498 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "32", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.499 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.500 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.502 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.503 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.504 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.505 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.506 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.507 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.508 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.509 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.510 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.511 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.512 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "k8sevents", 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_event_retention_days": { 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.513 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "config_check_secs": { 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_check_secs", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.514 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "10", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.515 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.516 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.517 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.518 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:28:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.526 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.527 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.528 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2024-09-12T12:28:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.530 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.531 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.532 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.533 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.535 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.536 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.537 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.538 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.539 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.540 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.541 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.542 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.543 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.544 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.545 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.546 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.547 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.548 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "fail_fs": { 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "fail_fs", 2024-09-12T12:28:16.549 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.551 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.552 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.553 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.554 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.555 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2024-09-12T12:28:16.556 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_perf_query", 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.557 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.558 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.559 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.560 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.561 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.562 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.563 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.564 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.565 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.566 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.567 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2024-09-12T12:28:16.568 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.569 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.570 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.571 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.572 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.573 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.574 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "threshold": { 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threshold", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1.0", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.575 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "scaling threshold", 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_pg_recovery_event": { 2024-09-12T12:28:16.576 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-12T12:28:16.577 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.578 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.579 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.580 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.581 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.582 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.583 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.584 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.585 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.586 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "exclude_perf_counters": { 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "exclude_perf_counters", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.588 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.589 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.590 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.591 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.592 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.594 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.595 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.596 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.597 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.598 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.599 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.600 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.601 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.602 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.603 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.604 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.605 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.606 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-12T12:28:16.607 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.608 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.609 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.610 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.611 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.612 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.613 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.614 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.615 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.616 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.617 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rgw", 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "storage_class": { 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "storage_class", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "local", 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption7": { 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption7", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "42", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2024-09-12T12:28:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_perf": { 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_perf", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard_description": { 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard_description", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.691 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.692 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.693 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.694 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.695 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.696 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.697 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.698 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.699 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.700 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.701 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.702 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.703 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.704 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.705 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.706 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.707 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.708 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.709 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "periodic_async_work": { 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "periodic_async_work", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Periodically check for async work", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.712 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.713 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2024-09-12T12:28:16.714 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2024-09-12T12:28:16.715 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-12T12:28:16.716 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.717 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.718 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.719 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-12T12:28:16.720 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.721 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.722 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.723 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.724 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-12T12:28:16.725 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "services": { 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "dashboard": "https://172.21.15.38:8443/" 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "always_on_modules": { 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "octopus": [ 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-12T12:28:16.726 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "pacific": [ 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-12T12:28:16.727 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "quincy": [ 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-12T12:28:16.728 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "reef": [ 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-12T12:28:16.729 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "squid": [ 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:16.730 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "last_failure_osd_epoch": 3, 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "active_clients": [ 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 3285851358 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.731 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "libcephsqlite", 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1198574791 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-12T12:28:16.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2864406877 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 4145183514 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:16.733 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:16.734 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-12T12:28:16.734 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:28:16.735 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:15 smithi154 ceph-mon[35578]: pgmap v463: 129 pgs: 129 active+clean; 257 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 18 op/s 2024-09-12T12:28:16.735 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:15 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1381293149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:28:16.735 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:15 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1710966565' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:28:16.735 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:15 smithi071 ceph-mon[34859]: pgmap v463: 129 pgs: 129 active+clean; 257 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 18 op/s 2024-09-12T12:28:16.735 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:15 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1381293149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:28:16.735 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:15 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1710966565' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:28:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fba580a2b90 msgr2=0x7fba580a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fba580a2b90 0x7fba580a5050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fba7419b4f0 tx=0x7fba60005f90 comp rx=0 tx=0).stop 2024-09-12T12:28:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 msgr2=0x7fba74199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 0x7fba74199fe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba6400e9c0 tx=0x7fba6400ee80 comp rx=0 tx=0).stop 2024-09-12T12:28:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 shutdown_connections 2024-09-12T12:28:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fba580a2b90 0x7fba580a5050 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba741058e0 0x7fba741a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:16.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74104f20 0x7fba7419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:16.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 --2- 172.21.15.38:0/1710966565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba74103d30 0x7fba74199fe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:16.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 >> 172.21.15.38:0/1710966565 conn(0x7fba740ff4b0 msgr2=0x7fba741082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:16.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 shutdown_connections 2024-09-12T12:28:16.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:15.319+0000 7fba7ae00640 1 -- 172.21.15.38:0/1710966565 wait complete. 2024-09-12T12:28:16.743 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T12:28:16.743 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T12:28:16.743 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:15 smithi038 ceph-mon[30810]: pgmap v463: 129 pgs: 129 active+clean; 257 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 18 op/s 2024-09-12T12:28:16.744 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:15 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1381293149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:28:16.744 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:15 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1710966565' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:28:17.133 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:17.746 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:28:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 548, 2024-09-12T12:28:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 548, 2024-09-12T12:28:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 166593, 2024-09-12T12:28:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 173441, 2024-09-12T12:28:17.746 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 6, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.056088805, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.018322830, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.016326037, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.013597896, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 547, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.031090259, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000056837 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:17.747 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 303, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 298, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 522938, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 120570, 2024-09-12T12:28:17.748 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 3, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.039655217, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.015351116, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.020713476, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.006401797, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 297, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.016875997, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000056821 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.749 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 473824, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 57856 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 2, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 72, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 428, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 187838, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-12T12:28:17.750 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 3, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.008972338, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.006107776, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.001868400, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000021065, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 70, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.004669983, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000066714 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.751 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 187520 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-12T12:28:17.752 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1220, 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.030881456, 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000025312 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.753 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 0, 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 0, 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 0, 2024-09-12T12:28:17.754 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 0, 2024-09-12T12:28:17.755 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 1, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2024-09-12T12:28:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:17.757 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:17.758 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 0 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_try_discover": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_send_discover": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 0, 2024-09-12T12:28:17.759 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:17.760 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "evlrg": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 4, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2024-09-12T12:28:17.761 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 0, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 2, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "segmjr": 2, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 4194304, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 4195426, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 4195285, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.762 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 4 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 3, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 3, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 0, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 1, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 1, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 0, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 0, 2024-09-12T12:28:17.763 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 46944, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 215328 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 0, 2024-09-12T12:28:17.764 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 0, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.765 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.766 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.767 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2024-09-12T12:28:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 0, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 1, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 1, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 1, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 0, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 0, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 1127, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 190270, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 49, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 168, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 8512, 2024-09-12T12:28:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 13, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 742, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 21, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 3, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 742, 2024-09-12T12:28:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "op_latency": { 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 742, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.449991573, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000606457 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "op_inflight": 0, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 742, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 743 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 742, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 742, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 0, 2024-09-12T12:28:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 464, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 276, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2024-09-12T12:28:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 1, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2024-09-12T12:28:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2024-09-12T12:28:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 93, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 2, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 5, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 5, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 0, 2024-09-12T12:28:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 2, 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 0 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 0, 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "osd-slow-ops": { 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_ops_count": 0 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 0, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-12T12:28:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 849, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 605147, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 849, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 849, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 605147, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 742, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 1127, 2024-09-12T12:28:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 742, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1127, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 742, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 742, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 742, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 742, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x55b3aa6b0be0": { 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:17.797 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:28:17.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:17 smithi038 ceph-mon[30810]: pgmap v464: 129 pgs: 129 active+clean; 221 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 17 op/s 2024-09-12T12:28:18.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:17 smithi071 ceph-mon[34859]: pgmap v464: 129 pgs: 129 active+clean; 221 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 17 op/s 2024-09-12T12:28:18.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:17 smithi154 ceph-mon[35578]: pgmap v464: 129 pgs: 129 active+clean; 221 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 17 op/s 2024-09-12T12:28:18.701 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T12:28:18.702 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T12:28:18.702 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T12:28:18.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T12:28:19.078 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 0, 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 2, 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 0, 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 0, 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.003286126, 2024-09-12T12:28:19.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.000570797, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:19.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 1, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 75, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 160, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 91680, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.010638527, 2024-09-12T12:28:19.668 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.007050801, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.001797502, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 73, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.005024697, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000068831 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 91680 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 106, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 101, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 447312, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 60320, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.024324390, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.009449588, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.019492070, 2024-09-12T12:28:19.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 101, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.014080480, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000139410 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 447312, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 60320 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.671 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:19.672 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:19.673 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:19.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 149854, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 28, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2024-09-12T12:28:19.675 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 928, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:19.676 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 103, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 429936, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 103, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 103, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 429936, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:19.677 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:19.678 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:19.678 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:19.678 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:28:19.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:19 smithi038 ceph-mon[30810]: pgmap v465: 129 pgs: 129 active+clean; 1.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 27 op/s 2024-09-12T12:28:20.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:19 smithi071 ceph-mon[34859]: pgmap v465: 129 pgs: 129 active+clean; 1.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 27 op/s 2024-09-12T12:28:20.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:19 smithi154 ceph-mon[35578]: pgmap v465: 129 pgs: 129 active+clean; 1.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 27 op/s 2024-09-12T12:28:20.579 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T12:28:20.579 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T12:28:20.579 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T12:28:20.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T12:28:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:21.609 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:28:21.609 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:21.609 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 275, 2024-09-12T12:28:21.609 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 277, 2024-09-12T12:28:21.609 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 92345, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 87451, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 6, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.042314179, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.019015973, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.008848250, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.008075002, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 275, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.017903671, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000065104 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 281, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 351, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 76084, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 277761, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 5, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 4, 2024-09-12T12:28:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.036423932, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.015542483, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.011100158, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.006616287, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 350, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.021162475, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000060464 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 189936 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 111, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 106, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 475716, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 60101, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-12T12:28:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 3, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.024854357, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.010103457, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.021323207, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000075214, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 105, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.008822321, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000084022 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 474368, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 59136 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1101, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.028079464, 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000025503 2024-09-12T12:28:21.615 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 0, 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 0, 2024-09-12T12:28:21.616 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 0, 2024-09-12T12:28:21.617 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 1, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:21.618 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:21.619 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:21.620 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 0 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_try_discover": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_send_discover": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:21.621 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2024-09-12T12:28:21.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "evlrg": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 2, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2024-09-12T12:28:21.623 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 2, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "segmjr": 2, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 4194304, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 4194892, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 4194352, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 2 2024-09-12T12:28:21.624 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 3, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 3, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 0, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 1, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 1, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 0, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 0, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 0, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 0, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 0, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 0, 2024-09-12T12:28:21.625 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 0, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 46872, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 215328 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 0, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 0, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 0, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 0, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.628 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.629 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2024-09-12T12:28:21.630 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.631 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.632 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:21.633 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.634 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.636 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:21.637 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 0, 2024-09-12T12:28:21.638 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:21.639 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:21.640 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:21.641 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 197336, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 53, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 168, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:21.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 8512, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 13, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 554, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 21, 2024-09-12T12:28:21.643 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 3, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 554, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "op_latency": { 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 554, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.316994049, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000572191 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "op_inflight": 0, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 554, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 555 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 554, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 554, 2024-09-12T12:28:21.644 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 274, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 278, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2024-09-12T12:28:21.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 1, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2024-09-12T12:28:21.646 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2024-09-12T12:28:21.647 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 93, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 2, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 6, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 6, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 0, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 2, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 0 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 0, 2024-09-12T12:28:21.648 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "osd-slow-ops": { 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_ops_count": 0 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 0, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 663, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 575969, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 663, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 663, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 575969, 2024-09-12T12:28:21.650 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:21.651 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 554, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 593, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 554, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 593, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.652 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 554, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 554, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 554, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 554, 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:21.653 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:21.654 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x55b4c4c50be0": { 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-12T12:28:21.655 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:21.656 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:28:21.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:21 smithi038 ceph-mon[30810]: pgmap v466: 129 pgs: 129 active+clean; 1.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 21 MiB/s wr, 21 op/s 2024-09-12T12:28:22.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:21 smithi071 ceph-mon[34859]: pgmap v466: 129 pgs: 129 active+clean; 1.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 21 MiB/s wr, 21 op/s 2024-09-12T12:28:22.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:21 smithi154 ceph-mon[35578]: pgmap v466: 129 pgs: 129 active+clean; 1.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 21 MiB/s wr, 21 op/s 2024-09-12T12:28:22.508 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-12T12:28:22.508 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-12T12:28:22.508 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T12:28:22.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T12:28:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:23.514 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 106, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 103, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 446032, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 62128, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.025087445, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.009332187, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.019131998, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:28:23.515 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 102, 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.007135235, 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000069953 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 446032, 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 62128 2024-09-12T12:28:23.516 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 5, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 79, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 3152, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 92480, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.013320461, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.007453746, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.004998858, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:23.517 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 78, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.010789805, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000138330 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 92480 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.518 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 0, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 2, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 0, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 0, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.000682576, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.000560720, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:23.519 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-12T12:28:23.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:23.521 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:23.522 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 150885, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 29, 2024-09-12T12:28:23.523 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:23.524 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 928, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 107, 2024-09-12T12:28:23.525 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 431093, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 107, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 107, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 431093, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-12T12:28:23.526 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-12T12:28:24.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:23 smithi071 ceph-mon[34859]: pgmap v467: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 MiB/s wr, 25 op/s 2024-09-12T12:28:24.075 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:23 smithi038 ceph-mon[30810]: pgmap v467: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 MiB/s wr, 25 op/s 2024-09-12T12:28:24.168 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:23 smithi154 ceph-mon[35578]: pgmap v467: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 MiB/s wr, 25 op/s 2024-09-12T12:28:24.283 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T12:28:24.283 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T12:28:24.283 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T12:28:24.284 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T12:28:24.540 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:28:25.053 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 992, 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 740, 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 326897, 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 931509, 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 16, 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-12T12:28:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.102473050, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.032434348, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.045094588, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.024439515, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 739, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.604861227, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000818486 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 628, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000186138, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000296 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 53152, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 30736 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 681, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 596, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 657980, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 218914, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 9, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-12T12:28:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.057545371, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.020928216, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.036938157, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.007248218, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 598, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.197412720, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000330121 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 296, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000062395, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000210 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 515280, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 69280 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 634, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 604, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 175740, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 740902, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 40, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 8, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.072704990, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.021750241, 2024-09-12T12:28:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.043529389, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.005334179, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 599, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.256146272, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000427623 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 721, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000142613, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000197 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:28:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 208304 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 377, 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.094035159, 2024-09-12T12:28:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000249430 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 154, 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.005191709, 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000033712 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-12T12:28:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 67, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 67, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 67, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.071155436, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001062021 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 12, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-12T12:28:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 24, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 24, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 23, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 3, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 3, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 2, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 97, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 90, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-12T12:28:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 180, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 58, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 58, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 34, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 4, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 30, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 24, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 1, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 14, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 32, 2024-09-12T12:28:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 107, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 86, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 2, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 27 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-12T12:28:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 5, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 6, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 6, 2024-09-12T12:28:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 4, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 159, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 159, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 2, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-12T12:28:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4815117, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 132, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.272949105, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002067796 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 23, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 33, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 10, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 18, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 20, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 2, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 24, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 35, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 11, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 3, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 21, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 18, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 55692, 2024-09-12T12:28:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 231712 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 85, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 67, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 14, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.005624196, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000703024 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 28, 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.006686643, 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000238808 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000329440, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000164720 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-12T12:28:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8, 2024-09-12T12:28:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.014546502, 2024-09-12T12:28:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001818312 2024-09-12T12:28:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000258512, 2024-09-12T12:28:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000258512 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002839562, 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001419781 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002031158, 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001015579 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-12T12:28:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.009988560, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.004994280 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001472572, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000736286 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 8, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.022231975, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002778996 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.005146316, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001286579 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 3, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 2, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 1, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 14, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 14, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 157, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T12:28:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 315912, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 133, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 528, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 6, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T12:28:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 168, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 94914, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 610, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T12:28:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 919, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 637942, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 32, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 919, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 919, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 21.077618651, 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.022935384 2024-09-12T12:28:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 919, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 964 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 919, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 69, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 850, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 11, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 7, 2024-09-12T12:28:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 135, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 21, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 650, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 62, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 22, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-12T12:28:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 93, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 10, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 12, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 12, 2024-09-12T12:28:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 46, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 10 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-12T12:28:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 130, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 3, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 138, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 6, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2303, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 941236, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2303, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2303, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 941236, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 919, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 638580, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 919, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 638580, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 919, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 919, 2024-09-12T12:28:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 919, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 919, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 6, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 638, 2024-09-12T12:28:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 6, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 3, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 638, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x557d3795c960": { 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 159, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 620813, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 159, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 132, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 620813, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:25.103 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T12:28:25.935 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-12T12:28:25.935 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-12T12:28:25.935 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T12:28:25.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T12:28:25.958 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:25 smithi071 ceph-mon[34859]: pgmap v468: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 MiB/s wr, 19 op/s 2024-09-12T12:28:26.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:25 smithi154 ceph-mon[35578]: pgmap v468: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 MiB/s wr, 19 op/s 2024-09-12T12:28:26.186 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:28:26.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:25 smithi038 ceph-mon[30810]: pgmap v468: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 MiB/s wr, 19 op/s 2024-09-12T12:28:26.664 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 638, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 640, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 807956, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 202894, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 6, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.057603461, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.021550160, 2024-09-12T12:28:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.014476474, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.015925261, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 638, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.023102900, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000036211 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 9, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 82, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 4808, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 191802, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.007453479, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.003356802, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.003159655, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000103098, 2024-09-12T12:28:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 81, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.012517975, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000154542 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 190464 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 395, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 390, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 545735, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 151873, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 3, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.042069018, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.014553658, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.021432190, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.008978012, 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 389, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.015585288, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000040065 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 476784, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 62832 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T12:28:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1552, 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.037887024, 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000024411 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 20, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 20, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 20, 2024-09-12T12:28:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 2, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-12T12:28:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:26.676 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-12T12:28:26.677 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:26.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 159, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-12T12:28:26.679 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4815117, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 4810480, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 159 2024-09-12T12:28:26.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 14, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 20, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 6, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 9, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 11, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 2, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 20, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 25, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 5, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-12T12:28:26.681 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 47900, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 215328 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.683 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.684 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.685 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-12T12:28:26.686 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.687 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.687 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.687 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.688 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.689 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.690 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-12T12:28:26.691 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.693 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.694 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 3, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 2, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 1, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 1573, 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:26.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:26.696 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 189319, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 50, 2024-09-12T12:28:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 168, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:26.699 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 57082, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 272, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 922, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 26, 2024-09-12T12:28:26.700 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 4, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 922, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 922, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.375993214, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000407801 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 922, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 923 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 922, 2024-09-12T12:28:26.701 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 922, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 558, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 361, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-12T12:28:26.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 2, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-12T12:28:26.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-12T12:28:26.704 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 93, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 2, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 5, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 5, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-12T12:28:26.705 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-12T12:28:26.706 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 1038, 2024-09-12T12:28:26.707 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1256228, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 1038, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1038, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1256228, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.708 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 922, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 620823, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 922, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 620823, 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 922, 2024-09-12T12:28:26.710 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 922, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 922, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 922, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:26.711 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x5639e9e66b40": { 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:26.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:26.714 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:26.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:26.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:26.714 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T12:28:27.425 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T12:28:27.425 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T12:28:27.425 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T12:28:27.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T12:28:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:28:28.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:27 smithi071 ceph-mon[34859]: pgmap v469: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-12T12:28:28.150 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 155, 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 220, 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 52120, 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 88182, 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 9, 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:28.151 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.026435934, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.010690802, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.011011251, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.001715253, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 222, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.033420840, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000150544 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 335, 2024-09-12T12:28:28.152 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000089203, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000266 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 182, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 169, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 516873, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 185527, 2024-09-12T12:28:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 15, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 8, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.026670471, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.008261996, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.022279209, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000403316, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 169, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.024141438, 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000142848 2024-09-12T12:28:28.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 33, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000006017, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000182 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 501488, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 65504 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 28, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 106, 2024-09-12T12:28:28.155 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 13737, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 255869, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 14, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 7, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.011504711, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.004483993, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.005837214, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000113056, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 100, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.012782908, 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000127829 2024-09-12T12:28:28.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 32, 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000008282, 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000258 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 193072 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-12T12:28:28.157 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 44, 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001257249, 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000028573 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000014881, 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000007440 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 1, 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 1, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 11, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 10, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-12T12:28:28.160 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 10, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 10, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 1, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:28.161 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 1, 2024-09-12T12:28:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-12T12:28:28.164 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 1, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-12T12:28:28.165 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:28.166 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 3, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 3, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 2, 2024-09-12T12:28:28.167 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4195203, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-12T12:28:28.168 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.003176194, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001588097 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 13, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 13, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 0, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 11, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 12, 2024-09-12T12:28:28.169 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 1, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 10, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 10, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 0, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 49924, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 223520 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-12T12:28:28.170 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 1, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 1, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 3, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-12T12:28:28.171 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.173 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.174 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.176 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-12T12:28:28.176 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.176 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:27 smithi154 ceph-mon[35578]: pgmap v469: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.177 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.181 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.182 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.184 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 1, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 0, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 1, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 148, 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:28.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:28.187 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:28.188 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T12:28:28.189 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 222469, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 74, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:28.190 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 168, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 50872, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 198, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:28.191 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 37, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 11111, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 28, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 37, 2024-09-12T12:28:28.192 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 37, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.236995733, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.006405290 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 37, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 59 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 37, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 0, 2024-09-12T12:28:28.193 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 37, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 10, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 2, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 6, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-12T12:28:28.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 6, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 20, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-12T12:28:28.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-12T12:28:28.196 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 93, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 2, 2024-09-12T12:28:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 8, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 8, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 14, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 1 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-12T12:28:28.198 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 361, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 540218, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 361, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:28.200 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 361, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 540218, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:28.201 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 37, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 11111, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 37, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 11111, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.202 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 37, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 37, 2024-09-12T12:28:28.203 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 37, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 37, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x557be1f2c960": { 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 3, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 899, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 3, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:28.206 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2, 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 899, 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:28.207 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T12:28:28.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:27 smithi038 ceph-mon[30810]: pgmap v469: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-12T12:28:29.036 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T12:28:29.036 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T12:28:29.037 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T12:28:29.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T12:28:29.280 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:28:29.760 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-12T12:28:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 118, 2024-09-12T12:28:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 113, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 478274, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 64916, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 1, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.019212126, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.007490550, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.014615279, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000022111, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 112, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.007286862, 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000065061 2024-09-12T12:28:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 477440, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 64592 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 156, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 234, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 38312, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 241455, 2024-09-12T12:28:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.020763884, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.008105597, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.004725778, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.005482148, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 232, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.012307294, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000053048 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 192160 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 572, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 572, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 173610, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 181130, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 4, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.060891994, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.020796023, 2024-09-12T12:28:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.017159423, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.017707241, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 571, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.029123636, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000051004 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:28:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1270, 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.037796983, 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000029761 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 0, 2024-09-12T12:28:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 1, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-12T12:28:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-12T12:28:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 3, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-12T12:28:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4195203, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 4194892, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 3 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 3, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 3, 2024-09-12T12:28:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 1, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 1, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 47656, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 215328 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-12T12:28:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-12T12:28:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-12T12:28:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-12T12:28:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 1, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 0, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 1, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 1577, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 190040, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 51, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-12T12:28:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 168, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 8512, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 13, 2024-09-12T12:28:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 724, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 21, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 3, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 724, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 724, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.369993326, 2024-09-12T12:28:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000511040 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 724, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 725 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 724, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 724, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 435, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 287, 2024-09-12T12:28:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 1, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-12T12:28:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 93, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 2, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 5, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 5, 2024-09-12T12:28:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-12T12:28:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 842, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 605455, 2024-09-12T12:28:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 842, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 842, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 605455, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-12T12:28:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 724, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 904, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 724, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 904, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 724, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 724, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 724, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 724, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55b3ad884b40": { 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-12T12:28:29.806 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-12T12:28:30.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:29 smithi071 ceph-mon[34859]: pgmap v470: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-09-12T12:28:30.022 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:29 smithi038 ceph-mon[30810]: pgmap v470: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-09-12T12:28:30.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:29 smithi154 ceph-mon[35578]: pgmap v470: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-09-12T12:28:30.559 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T12:28:30.560 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T12:28:30.560 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T12:28:30.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T12:28:30.820 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:28:31.421 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-12T12:28:31.421 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 59, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 60, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 30421, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 81501, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 15, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.012158080, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.001811940, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.007871379, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000477659, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 59, 2024-09-12T12:28:31.422 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.031544645, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000534655 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 57, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000018865, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000330 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3584, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 1184 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 21, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 96, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 4607, 2024-09-12T12:28:31.423 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 296399, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 16, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.010806045, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.003550601, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.005565900, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000363644, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 94, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.018655106, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000198458 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 8, 2024-09-12T12:28:31.424 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000593, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000074 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 193248 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 289, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 347, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 544668, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 143756, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.040507813, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.015725571, 2024-09-12T12:28:31.425 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.028378766, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.001955925, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 346, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.031665780, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000091519 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 332, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000090498, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000272 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 495520, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 67472 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.426 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 40, 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001465209, 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000036630 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:31.427 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000015437, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000007718 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-12T12:28:31.428 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 10, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 10, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 10, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-12T12:28:31.429 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-12T12:28:31.430 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:31.431 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:31.432 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 1, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-12T12:28:31.433 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 4, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-12T12:28:31.434 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 4, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195426, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-12T12:28:31.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.005241231, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001747077 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 13, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 13, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 11, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 12, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 1, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 10, 2024-09-12T12:28:31.436 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 10, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 51776, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223520 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 4, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-12T12:28:31.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-12T12:28:31.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.439 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:31.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-12T12:28:31.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-12T12:28:31.442 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.443 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-12T12:28:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-12T12:28:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-12T12:28:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 71, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 254199, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 83, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 168, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 50872, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 198, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-12T12:28:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 38, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 11334, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 38, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 38, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.222994006, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005868263 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 38, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 60 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 38, 2024-09-12T12:28:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 38, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 3, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 6, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-12T12:28:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-12T12:28:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 8, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 8, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.458 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:31.459 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 366, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 536559, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 366, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 366, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 536559, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:31.460 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 38, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 11334, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 38, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 11334, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.461 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 38, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 38, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 38, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 38, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x5598bf992960": { 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 4, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1122, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 4, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1122, 2024-09-12T12:28:31.464 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:31.465 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:31.465 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:31.465 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:31.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-12T12:28:32.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:31 smithi071 ceph-mon[34859]: pgmap v471: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-12T12:28:32.063 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:31 smithi154 ceph-mon[35578]: pgmap v471: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-12T12:28:32.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:31 smithi038 ceph-mon[30810]: pgmap v471: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-12T12:28:32.256 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T12:28:32.256 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T12:28:32.257 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T12:28:32.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T12:28:32.513 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 144, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 211, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 50831, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 60294, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 10, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.024704928, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.008572280, 2024-09-12T12:28:33.052 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.011468677, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.001831683, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 211, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.023452518, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000111149 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 323, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000087879, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000272 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:33.053 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 40, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 114, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 17828, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 360971, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 20, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.015026287, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.004316390, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.009483308, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000160200, 2024-09-12T12:28:33.054 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 113, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.024269253, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000214772 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 37, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000007337, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000198 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 193872 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:33.055 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 176, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 171, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 503880, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 85916, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.023520140, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.008654343, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.020818676, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000481947, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 168, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.028581910, 2024-09-12T12:28:33.056 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000170130 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 27, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000007285, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000269 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 489360, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 68112 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.057 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 25, 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001172920, 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000046916 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000011067, 2024-09-12T12:28:33.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000005533 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-12T12:28:33.059 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 10, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 10, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 10, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-12T12:28:33.060 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-12T12:28:33.061 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:33.062 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:33.063 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 1, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:33.064 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 2, 2024-09-12T12:28:33.065 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 2, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4194892, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-12T12:28:33.066 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001409310, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001409310 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 13, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 13, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 11, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 12, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 1, 2024-09-12T12:28:33.067 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 10, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 10, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 52428, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223520 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-12T12:28:33.068 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.070 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:33.071 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.073 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-12T12:28:33.073 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.073 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.073 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.073 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-12T12:28:33.073 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.074 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 0, 2024-09-12T12:28:33.080 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 238887, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 79, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 168, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 50872, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 198, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-12T12:28:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 35, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 10710, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 35, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 35, 2024-09-12T12:28:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.210994318, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.006028409 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 35, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 57 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 35, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 35, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-09-12T12:28:33.087 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 1, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 5, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-09-12T12:28:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-12T12:28:33.089 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-12T12:28:33.090 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 9, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 9, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-12T12:28:33.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.092 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 356, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 530170, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 356, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 356, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 530170, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.093 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 35, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 10710, 2024-09-12T12:28:33.094 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 35, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 10710, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:33.095 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 35, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 35, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 35, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 35, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:33.096 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x555b10772960": { 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 588, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 588, 2024-09-12T12:28:33.098 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:33.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:33.099 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:33.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:33.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:33.099 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-12T12:28:33.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:33 smithi154 ceph-mon[35578]: pgmap v472: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T12:28:33.931 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T12:28:33.931 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T12:28:33.932 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T12:28:33.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T12:28:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:28:34.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:33 smithi038 ceph-mon[30810]: pgmap v472: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T12:28:34.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:33 smithi071 ceph-mon[34859]: pgmap v472: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 216, 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 253, 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 69136, 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 190345, 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 18, 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-12T12:28:34.670 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.032165558, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.009494476, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.017939274, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.002109101, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 253, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.038199008, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000150984 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 416, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000100249, 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000240 2024-09-12T12:28:34.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 40, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 116, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 19103, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 262125, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 14, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.014280686, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.004727150, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.008661366, 2024-09-12T12:28:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000192664, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 113, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.021438191, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000189718 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 40, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000011779, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000294 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T12:28:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 195312 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 170, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 157, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 517026, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 86783, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 8, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.021999299, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.008168675, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.018775065, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000294453, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 156, 2024-09-12T12:28:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.018905689, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000121190 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 27, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000015400, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000570 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 503488, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 65872 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 34, 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002088352, 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000061422 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-12T12:28:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000009575, 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000004787 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 2, 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 1, 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000885823, 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000885823 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 1, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 14, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 14, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 14, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 1, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 1, 2024-09-12T12:28:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 3, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 1, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 1, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 1, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 1, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 1, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 1 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 2, 2024-09-12T12:28:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 3, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 3, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-12T12:28:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195203, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002919721, 2024-09-12T12:28:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001459860 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 17, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 17, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 15, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 16, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 1, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 14, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 14, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 1, 2024-09-12T12:28:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 1, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 50752, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223520 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 3, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 2, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 3, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000885823, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000885823 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-12T12:28:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 1, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 1, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 167, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 271045, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 94, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 168, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 68037, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 288, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 39, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 11516, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 27, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 39, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 39, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.222993983, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005717794 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-12T12:28:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 39, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 63 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 39, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 39, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 2, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 6, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-12T12:28:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-12T12:28:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 10, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 10, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 18, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 422, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 557160, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 422, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 422, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 557160, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 39, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 11516, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 39, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 11516, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 39, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 39, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 39, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 39, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-12T12:28:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x564990588960": { 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 3, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 899, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 3, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2, 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 899, 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:34.715 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-12T12:28:35.527 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-12T12:28:35.527 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-12T12:28:35.527 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T12:28:35.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T12:28:35.786 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:28:36.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:35 smithi071 ceph-mon[34859]: pgmap v473: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:28:36.035 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:35 smithi154 ceph-mon[35578]: pgmap v473: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:28:36.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:35 smithi038 ceph-mon[30810]: pgmap v473: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T12:28:36.279 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-12T12:28:36.279 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:28:36.279 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 750, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 752, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 216550, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 238507, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.071310298, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.024124766, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.017731208, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.023165919, 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:36.280 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 750, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.035883263, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000047844 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 125, 2024-09-12T12:28:36.281 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 118, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 481532, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 67018, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 3, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.021076031, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.007468275, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.017694064, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000082397, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 118, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.012058346, 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000102189 2024-09-12T12:28:36.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 480976, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 66320 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 2, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 82, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 428, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 196062, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-12T12:28:36.283 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.005262236, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.003329815, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.001086691, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000017974, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 80, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.005236249, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000065453 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 195744 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1329, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.038075838, 2024-09-12T12:28:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000028649 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-12T12:28:36.286 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-12T12:28:36.287 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:28:36.288 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-12T12:28:36.289 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:28:36.290 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-12T12:28:36.291 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:28:36.292 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 3, 2024-09-12T12:28:36.293 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195203, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4194892, 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-12T12:28:36.294 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 3 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-12T12:28:36.295 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48172, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-12T12:28:36.296 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.297 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-12T12:28:36.298 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.299 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-12T12:28:36.301 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-12T12:28:36.304 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.306 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.308 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:28:36.309 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-12T12:28:36.310 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1567, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:28:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:28:36.312 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-12T12:28:36.313 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 181239, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 46, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:28:36.314 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8952, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 168, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8512, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.315 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 753, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 753, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 753, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.355990347, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000472762 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-12T12:28:36.316 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 753, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 754 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 753, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 753, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 458, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 293, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-12T12:28:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-12T12:28:36.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-12T12:28:36.319 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 4, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 4, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-12T12:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 873, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 610875, 2024-09-12T12:28:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 873, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 873, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 610875, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:36.323 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 753, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 904, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 753, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 904, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 753, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 753, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 753, 2024-09-12T12:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 753, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:36.326 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55fee5210b40": { 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-12T12:28:36.327 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-12T12:28:36.328 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-12T12:28:37.056 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T12:28:37.057 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T12:28:37.057 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T12:28:37.067 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T12:28:37.067 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:28:37.067 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:28:37.109 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-12T12:28:37.109 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:28:37.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:28:37.617 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:38.098 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:37 smithi038 ceph-mon[30810]: pgmap v474: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:28:38.166 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:37 smithi154 ceph-mon[35578]: pgmap v474: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:28:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 -- 172.21.15.38:0/3156619578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c076720 msgr2=0x7fc73c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 --2- 172.21.15.38:0/3156619578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c076720 0x7fc73c076b00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc730009900 tx=0x7fc73002a410 comp rx=0 tx=0).stop 2024-09-12T12:28:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 -- 172.21.15.38:0/3156619578 shutdown_connections 2024-09-12T12:28:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 --2- 172.21.15.38:0/3156619578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73c112a30 0x7fc73c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 --2- 172.21.15.38:0/3156619578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc73c077040 0x7fc73c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 --2- 172.21.15.38:0/3156619578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c076720 0x7fc73c076b00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 -- 172.21.15.38:0/3156619578 >> 172.21.15.38:0/3156619578 conn(0x7fc73c0ffa90 msgr2=0x7fc73c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 -- 172.21.15.38:0/3156619578 shutdown_connections 2024-09-12T12:28:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.214+0000 7fc744400640 1 -- 172.21.15.38:0/3156619578 wait complete. 2024-09-12T12:28:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 Processor -- start 2024-09-12T12:28:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 -- start start 2024-09-12T12:28:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc73c076720 0x7fc73c1a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c077040 0x7fc73c1a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73c112a30 0x7fc73c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c1185a0 con 0x7fc73c077040 2024-09-12T12:28:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c118420 con 0x7fc73c076720 2024-09-12T12:28:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.215+0000 7fc744400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c118720 con 0x7fc73c112a30 2024-09-12T12:28:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c077040 0x7fc73c1a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c077040 0x7fc73c1a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53268/0 (socket says 172.21.15.38:53268) 2024-09-12T12:28:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 -- 172.21.15.38:0/865128299 learned_addr learned my addr 172.21.15.38:0/865128299 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741a00640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc73c076720 0x7fc73c1a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc742400640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73c112a30 0x7fc73c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 -- 172.21.15.38:0/865128299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73c112a30 msgr2=0x7fc73c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73c112a30 0x7fc73c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 -- 172.21.15.38:0/865128299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc73c076720 msgr2=0x7fc73c1a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc73c076720 0x7fc73c1a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.216+0000 7fc741000640 1 -- 172.21.15.38:0/865128299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c19efe0 con 0x7fc73c077040 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.217+0000 7fc741000640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c077040 0x7fc73c1a4c30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc72800e9f0 tx=0x7fc72800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.217+0000 7fc73a000640 1 -- 172.21.15.38:0/865128299 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72800cd80 con 0x7fc73c077040 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.217+0000 7fc73a000640 1 -- 172.21.15.38:0/865128299 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc728010910 con 0x7fc73c077040 2024-09-12T12:28:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.217+0000 7fc73a000640 1 -- 172.21.15.38:0/865128299 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc728018990 con 0x7fc73c077040 2024-09-12T12:28:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.217+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73c19f2d0 con 0x7fc73c077040 2024-09-12T12:28:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.217+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73c1ab5c0 con 0x7fc73c077040 2024-09-12T12:28:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.218+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73c076b00 con 0x7fc73c077040 2024-09-12T12:28:38.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.220+0000 7fc73a000640 1 -- 172.21.15.38:0/865128299 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc728010ac0 con 0x7fc73c077040 2024-09-12T12:28:38.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.222+0000 7fc73a000640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc7240a2c00 0x7fc7240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:38.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.222+0000 7fc73a000640 1 -- 172.21.15.38:0/865128299 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fc7280cf6b0 con 0x7fc73c077040 2024-09-12T12:28:38.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.222+0000 7fc741a00640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc7240a2c00 0x7fc7240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:38.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.223+0000 7fc741a00640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc7240a2c00 0x7fc7240a50c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc73c19f9f0 tx=0x7fc7300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:38.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.225+0000 7fc73a000640 1 -- 172.21.15.38:0/865128299 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc72809bbb0 con 0x7fc73c077040 2024-09-12T12:28:38.263 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:37 smithi071 ceph-mon[34859]: pgmap v474: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:28:38.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.428+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc73c10dbc0 con 0x7fc73c077040 2024-09-12T12:28:38.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.428+0000 7fc73a000640 1 -- 172.21.15.38:0/865128299 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v93) ==== 81+0+589 (secure 0 0 0) 0x7fc72809feb0 con 0x7fc73c077040 2024-09-12T12:28:38.429 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/2462218902 2024-09-13T12:15:33.976954+0000 2024-09-12T12:28:38.429 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/2462218902 2024-09-13T12:15:33.976954+0000 2024-09-12T12:28:38.429 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/780591637 2024-09-13T12:15:33.976954+0000 2024-09-12T12:28:38.429 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2321943199 2024-09-13T12:15:33.976954+0000 2024-09-12T12:28:38.430 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/271793937 2024-09-13T12:15:33.976954+0000 2024-09-12T12:28:38.430 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2979922122 2024-09-13T12:15:04.820922+0000 2024-09-12T12:28:38.430 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/746177485 2024-09-13T12:15:04.820922+0000 2024-09-12T12:28:38.430 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3674823086 2024-09-13T12:15:04.820922+0000 2024-09-12T12:28:38.430 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3803178885 2024-09-13T12:15:04.820922+0000 2024-09-12T12:28:38.430 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3803178885 2024-09-13T12:15:04.820922+0000 2024-09-12T12:28:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:listed 10 entries 2024-09-12T12:28:38.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc7240a2c00 msgr2=0x7fc7240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc7240a2c00 0x7fc7240a50c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc73c19f9f0 tx=0x7fc7300058d0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c077040 msgr2=0x7fc73c1a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c077040 0x7fc73c1a4c30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc72800e9f0 tx=0x7fc72800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 shutdown_connections 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc7240a2c00 0x7fc7240a50c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73c112a30 0x7fc73c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc73c077040 0x7fc73c1a4c30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 --2- 172.21.15.38:0/865128299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc73c076720 0x7fc73c1a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 >> 172.21.15.38:0/865128299 conn(0x7fc73c0ffa90 msgr2=0x7fc73c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 shutdown_connections 2024-09-12T12:28:38.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:38.431+0000 7fc744400640 1 -- 172.21.15.38:0/865128299 wait complete. 2024-09-12T12:28:39.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:38 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/865128299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:28:39.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:38 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/865128299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:28:39.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:38 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/865128299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:28:39.300 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:28:39.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:28:39.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:28:39.381 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2024-09-12T12:28:39.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:28:39.382 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:28:39.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:28:39.435 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-12T12:28:39.470 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:28:39.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:28:39.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:28:39.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:28:39.569 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-09-12T12:28:39.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:39 smithi038 ceph-mon[30810]: pgmap v475: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:28:39.880 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T12:28:39.890 INFO:tasks.cephadm:Teardown begin 2024-09-12T12:28:39.890 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:28:39.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:28:40.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:39 smithi154 ceph-mon[35578]: pgmap v475: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:28:40.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:39 smithi071 ceph-mon[34859]: pgmap v475: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:28:40.274 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 -- 172.21.15.38:0/3079451714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 msgr2=0x7fc62c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 --2- 172.21.15.38:0/3079451714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c1021c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc620009900 tx=0x7fc62002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 -- 172.21.15.38:0/3079451714 shutdown_connections 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 --2- 172.21.15.38:0/3079451714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c106f10 0x7fc62c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 --2- 172.21.15.38:0/3079451714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c102790 0x7fc62c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 --2- 172.21.15.38:0/3079451714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c1021c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 -- 172.21.15.38:0/3079451714 >> 172.21.15.38:0/3079451714 conn(0x7fc62c0fd8c0 msgr2=0x7fc62c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:40.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 -- 172.21.15.38:0/3079451714 shutdown_connections 2024-09-12T12:28:40.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.908+0000 7fc634000640 1 -- 172.21.15.38:0/3079451714 wait complete. 2024-09-12T12:28:40.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 Processor -- start 2024-09-12T12:28:40.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 -- start start 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c102790 0x7fc62c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c106f10 0x7fc62c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c111f70 con 0x7fc62c101de0 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c111df0 con 0x7fc62c102790 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc634000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c1120f0 con 0x7fc62c106f10 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc631600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:40.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc631600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53292/0 (socket says 172.21.15.38:53292) 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.909+0000 7fc631600640 1 -- 172.21.15.38:0/540693568 learned_addr learned my addr 172.21.15.38:0/540693568 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc630c00640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c102790 0x7fc62c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc632000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c106f10 0x7fc62c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc630c00640 1 -- 172.21.15.38:0/540693568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c106f10 msgr2=0x7fc62c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc630c00640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c106f10 0x7fc62c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc630c00640 1 -- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 msgr2=0x7fc62c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc630c00640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc630c00640 1 -- 172.21.15.38:0/540693568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c19f600 con 0x7fc62c102790 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc631600640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.910+0000 7fc630c00640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c102790 0x7fc62c19ab90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc61800e9f0 tx=0x7fc61800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.911+0000 7fc62a000640 1 -- 172.21.15.38:0/540693568 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61800ccc0 con 0x7fc62c102790 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.911+0000 7fc62a000640 1 -- 172.21.15.38:0/540693568 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc618005020 con 0x7fc62c102790 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.911+0000 7fc62a000640 1 -- 172.21.15.38:0/540693568 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618004a00 con 0x7fc62c102790 2024-09-12T12:28:40.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.911+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c19f8f0 con 0x7fc62c102790 2024-09-12T12:28:40.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.911+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c1a71d0 con 0x7fc62c102790 2024-09-12T12:28:40.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.912+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62c1021c0 con 0x7fc62c102790 2024-09-12T12:28:40.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.914+0000 7fc62a000640 1 -- 172.21.15.38:0/540693568 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc6180051d0 con 0x7fc62c102790 2024-09-12T12:28:40.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.915+0000 7fc62a000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6140a2c00 0x7fc6140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:40.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.915+0000 7fc62a000640 1 -- 172.21.15.38:0/540693568 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fc6180cf310 con 0x7fc62c102790 2024-09-12T12:28:40.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.915+0000 7fc631600640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6140a2c00 0x7fc6140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:40.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.916+0000 7fc631600640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6140a2c00 0x7fc6140a50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc6200096c0 tx=0x7fc620005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:40.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:40.919+0000 7fc62a000640 1 -- 172.21.15.38:0/540693568 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc61809be60 con 0x7fc62c102790 2024-09-12T12:28:41.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.141+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc62c1a7500 con 0x7fc62c102790 2024-09-12T12:28:41.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.142+0000 7fc62a000640 1 -- 172.21.15.38:0/540693568 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7fc61809b760 con 0x7fc62c102790 2024-09-12T12:28:41.143 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:28:41.143 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:28:41.143 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6140a2c00 msgr2=0x7fc6140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6140a2c00 0x7fc6140a50c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc6200096c0 tx=0x7fc620005a20 comp rx=0 tx=0).stop 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c102790 msgr2=0x7fc62c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c102790 0x7fc62c19ab90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc61800e9f0 tx=0x7fc61800edf0 comp rx=0 tx=0).stop 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 shutdown_connections 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fc6140a2c00 0x7fc6140a50c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc62c106f10 0x7fc62c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc62c102790 0x7fc62c19ab90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 --2- 172.21.15.38:0/540693568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c101de0 0x7fc62c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:41.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.145+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 >> 172.21.15.38:0/540693568 conn(0x7fc62c0fd8c0 msgr2=0x7fc62c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:41.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.146+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 shutdown_connections 2024-09-12T12:28:41.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:41.146+0000 7fc634000640 1 -- 172.21.15.38:0/540693568 wait complete. 2024-09-12T12:28:42.092 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:41 smithi038 ceph-mon[30810]: pgmap v476: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:28:42.092 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:41 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/540693568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:42.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:28:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:41 smithi154 ceph-mon[35578]: pgmap v476: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:28:42.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:41 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/540693568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:42.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:41 smithi071 ceph-mon[34859]: pgmap v476: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:28:42.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:41 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/540693568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:42.510 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 -- 172.21.15.38:0/4232481582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0102790 msgr2=0x7efeb01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 --2- 172.21.15.38:0/4232481582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0102790 0x7efeb01067e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009900 tx=0x7efe9c02a410 comp rx=0 tx=0).stop 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 -- 172.21.15.38:0/4232481582 shutdown_connections 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 --2- 172.21.15.38:0/4232481582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb0106f10 0x7efeb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 --2- 172.21.15.38:0/4232481582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0102790 0x7efeb01067e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 --2- 172.21.15.38:0/4232481582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeb0101de0 0x7efeb01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 -- 172.21.15.38:0/4232481582 >> 172.21.15.38:0/4232481582 conn(0x7efeb00fd8c0 msgr2=0x7efeb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 -- 172.21.15.38:0/4232481582 shutdown_connections 2024-09-12T12:28:43.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.096+0000 7efeb8000640 1 -- 172.21.15.38:0/4232481582 wait complete. 2024-09-12T12:28:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 Processor -- start 2024-09-12T12:28:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 -- start start 2024-09-12T12:28:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0101de0 0x7efeb019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeb0102790 0x7efeb019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb0106f10 0x7efeb019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0111f70 con 0x7efeb0101de0 2024-09-12T12:28:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0111df0 con 0x7efeb0102790 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.097+0000 7efeb8000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01120f0 con 0x7efeb0106f10 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0101de0 0x7efeb019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0101de0 0x7efeb019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53314/0 (socket says 172.21.15.38:53314) 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 -- 172.21.15.38:0/2544420200 learned_addr learned my addr 172.21.15.38:0/2544420200 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb4c00640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeb0102790 0x7efeb019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb6000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb0106f10 0x7efeb019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 -- 172.21.15.38:0/2544420200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb0106f10 msgr2=0x7efeb019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb0106f10 0x7efeb019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 -- 172.21.15.38:0/2544420200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeb0102790 msgr2=0x7efeb019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeb0102790 0x7efeb019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.098+0000 7efeb5600640 1 -- 172.21.15.38:0/2544420200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb019f5f0 con 0x7efeb0101de0 2024-09-12T12:28:43.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.099+0000 7efeb5600640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0101de0 0x7efeb019a640 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efea400d950 tx=0x7efea400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.099+0000 7efeae000640 1 -- 172.21.15.38:0/2544420200 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4017030 con 0x7efeb0101de0 2024-09-12T12:28:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.099+0000 7efeae000640 1 -- 172.21.15.38:0/2544420200 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea4004020 con 0x7efeb0101de0 2024-09-12T12:28:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.099+0000 7efeae000640 1 -- 172.21.15.38:0/2544420200 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea40047a0 con 0x7efeb0101de0 2024-09-12T12:28:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.099+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb019f8e0 con 0x7efeb0101de0 2024-09-12T12:28:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.099+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01a71c0 con 0x7efeb0101de0 2024-09-12T12:28:43.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.100+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb01021c0 con 0x7efeb0101de0 2024-09-12T12:28:43.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.102+0000 7efeae000640 1 -- 172.21.15.38:0/2544420200 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efea40041d0 con 0x7efeb0101de0 2024-09-12T12:28:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.103+0000 7efeae000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe980a2c00 0x7efe980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.104+0000 7efeae000640 1 -- 172.21.15.38:0/2544420200 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7efea40ced10 con 0x7efeb0101de0 2024-09-12T12:28:43.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.104+0000 7efeb4c00640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe980a2c00 0x7efe980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.104+0000 7efeb4c00640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe980a2c00 0x7efe980a50c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009230 tx=0x7efe9c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.108+0000 7efeae000640 1 -- 172.21.15.38:0/2544420200 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efea40d4020 con 0x7efeb0101de0 2024-09-12T12:28:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.329+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb01a7450 con 0x7efeb0101de0 2024-09-12T12:28:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.330+0000 7efeae000640 1 -- 172.21.15.38:0/2544420200 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11968 (secure 0 0 0) 0x7efea409b860 con 0x7efeb0101de0 2024-09-12T12:28:43.331 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:28:43.331 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-12T12:25:47:206849+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/675820097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":675820097},{"type":"v1","addr":"172.21.15.38:6835","nonce":675820097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/3190889999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":3190889999},{"type":"v1","addr":"172.21.15.38:6837","nonce":3190889999}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:22:55.298669+0000","modified":"2024-09-12T12:25:46.844569+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24529,"mds_2":24515,"mds_3":24508,"mds_4":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14526":{"gid":14526,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/4044590502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":4044590502},{"type":"v1","addr":"172.21.15.38:6839","nonce":4044590502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14538":{"gid":14538,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6841/1563078137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":1563078137},{"type":"v1","addr":"172.21.15.38:6841","nonce":1563078137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/3768607144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3768607144},{"type":"v1","addr":"172.21.15.71:6833","nonce":3768607144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/632951998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":632951998},{"type":"v1","addr":"172.21.15.154:6833","nonce":632951998}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/2977480232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2977480232},{"type":"v1","addr":"172.21.15.71:6835","nonce":2977480232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.154:6835/3632627850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3632627850},{"type":"v1","addr":"172.21.15.154:6835","nonce":3632627850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.154:6837/973401105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":973401105},{"type":"v1","addr":"172.21.15.154:6837","nonce":973401105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.71:6837/293615032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":293615032},{"type":"v1","addr":"172.21.15.71:6837","nonce":293615032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.154:6839/2253548650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2253548650},{"type":"v1","addr":"172.21.15.154:6839","nonce":2253548650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.71:6839/3960727102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3960727102},{"type":"v1","addr":"172.21.15.71:6839","nonce":3960727102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24529,24508,24515,24502]},"id":1}]} 2024-09-12T12:28:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-12T12:28:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe980a2c00 msgr2=0x7efe980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe980a2c00 0x7efe980a50c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009230 tx=0x7efe9c0058d0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0101de0 msgr2=0x7efeb019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0101de0 0x7efeb019a640 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efea400d950 tx=0x7efea400de10 comp rx=0 tx=0).stop 2024-09-12T12:28:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 shutdown_connections 2024-09-12T12:28:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7efe980a2c00 0x7efe980a50c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeb0106f10 0x7efeb019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeb0102790 0x7efeb019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 --2- 172.21.15.38:0/2544420200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efeb0101de0 0x7efeb019a640 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 >> 172.21.15.38:0/2544420200 conn(0x7efeb00fd8c0 msgr2=0x7efeb00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 shutdown_connections 2024-09-12T12:28:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:43.333+0000 7efeb8000640 1 -- 172.21.15.38:0/2544420200 wait complete. 2024-09-12T12:28:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:43 smithi154 ceph-mon[35578]: pgmap v477: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T12:28:44.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:43 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2544420200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:43 smithi038 ceph-mon[30810]: pgmap v477: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T12:28:44.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:43 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2544420200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:43 smithi071 ceph-mon[34859]: pgmap v477: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T12:28:44.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:43 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2544420200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:44.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:28:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 -- 172.21.15.38:0/635880278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 msgr2=0x7fe9541124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 --2- 172.21.15.38:0/635880278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541124f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe940009900 tx=0x7fe94002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 -- 172.21.15.38:0/635880278 shutdown_connections 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 --2- 172.21.15.38:0/635880278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe954112a30 0x7fe954114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 --2- 172.21.15.38:0/635880278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541124f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 --2- 172.21.15.38:0/635880278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe954076720 0x7fe954076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 -- 172.21.15.38:0/635880278 >> 172.21.15.38:0/635880278 conn(0x7fe9540ffa90 msgr2=0x7fe954101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:45.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 -- 172.21.15.38:0/635880278 shutdown_connections 2024-09-12T12:28:45.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.202+0000 7fe95b800640 1 -- 172.21.15.38:0/635880278 wait complete. 2024-09-12T12:28:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.203+0000 7fe95b800640 1 Processor -- start 2024-09-12T12:28:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.203+0000 7fe95b800640 1 -- start start 2024-09-12T12:28:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe95b800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe954076720 0x7fe9541a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe95b800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe95b800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe954112a30 0x7fe95419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe95b800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe9541185a0 con 0x7fe954077040 2024-09-12T12:28:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe95b800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe954118420 con 0x7fe954112a30 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe95b800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe954118720 con 0x7fe954076720 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe953e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe953e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53336/0 (socket says 172.21.15.38:53336) 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe953e00640 1 -- 172.21.15.38:0/3917969371 learned_addr learned my addr 172.21.15.38:0/3917969371 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe959800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe954112a30 0x7fe95419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.204+0000 7fe958e00640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe954076720 0x7fe9541a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe953e00640 1 -- 172.21.15.38:0/3917969371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe954076720 msgr2=0x7fe9541a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe953e00640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe954076720 0x7fe9541a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe953e00640 1 -- 172.21.15.38:0/3917969371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe954112a30 msgr2=0x7fe95419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe953e00640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe954112a30 0x7fe95419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe953e00640 1 -- 172.21.15.38:0/3917969371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95419efc0 con 0x7fe954077040 2024-09-12T12:28:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe959800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe954112a30 0x7fe95419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:45.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe953e00640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541a4c10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe940006010 tx=0x7fe9400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:45.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe951600640 1 -- 172.21.15.38:0/3917969371 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94003f030 con 0x7fe954077040 2024-09-12T12:28:45.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe951600640 1 -- 172.21.15.38:0/3917969371 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe940003ce0 con 0x7fe954077040 2024-09-12T12:28:45.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe951600640 1 -- 172.21.15.38:0/3917969371 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940035070 con 0x7fe954077040 2024-09-12T12:28:45.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95419f250 con 0x7fe954077040 2024-09-12T12:28:45.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.205+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9541ab5a0 con 0x7fe954077040 2024-09-12T12:28:45.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.207+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe954077e60 con 0x7fe954077040 2024-09-12T12:28:45.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.209+0000 7fe951600640 1 -- 172.21.15.38:0/3917969371 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe940042030 con 0x7fe954077040 2024-09-12T12:28:45.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.210+0000 7fe951600640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe93c0a2c00 0x7fe93c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:45.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.210+0000 7fe951600640 1 -- 172.21.15.38:0/3917969371 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7fe9400ef900 con 0x7fe954077040 2024-09-12T12:28:45.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.210+0000 7fe958e00640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe93c0a2c00 0x7fe93c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:45.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.211+0000 7fe958e00640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe93c0a2c00 0x7fe93c0a50c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe95419f9d0 tx=0x7fe948005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:45.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.214+0000 7fe951600640 1 -- 172.21.15.38:0/3917969371 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9400bbec0 con 0x7fe954077040 2024-09-12T12:28:45.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.401+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9541ab770 con 0x7fe954077040 2024-09-12T12:28:45.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.403+0000 7fe951600640 1 -- 172.21.15.38:0/3917969371 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24865 (secure 0 0 0) 0x7fe9400c01c0 con 0x7fe954077040 2024-09-12T12:28:45.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-12T12:28:45.404 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"726420ce-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:14:39.915105+0000","modified":"2024-09-12T12:24:35.829591+0000","last_up_change":"2024-09-12T12:21:57.465924+0000","last_in_change":"2024-09-12T12:21:33.301011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:17:58.604590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:50.782584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:53.282254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:01.880311+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9e11e86-b488-441c-a706-882110e30bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6803","nonce":4152176718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6805","nonce":4152176718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6809","nonce":4152176718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":4152176718},{"type":"v1","addr":"172.21.15.38:6807","nonce":4152176718}]},"public_addr":"172.21.15.38:6803/4152176718","cluster_addr":"172.21.15.38:6805/4152176718","heartbeat_back_addr":"172.21.15.38:6809/4152176718","heartbeat_front_addr":"172.21.15.38:6807/4152176718","state":["exists","up"]},{"osd":1,"uuid":"6df2c3be-ea85-414e-b78a-93ea2e8a6594","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6801","nonce":1674049999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6803","nonce":1674049999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6807","nonce":1674049999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1674049999},{"type":"v1","addr":"172.21.15.71:6805","nonce":1674049999}]},"public_addr":"172.21.15.71:6801/1674049999","cluster_addr":"172.21.15.71:6803/1674049999","heartbeat_back_addr":"172.21.15.71:6807/1674049999","heartbeat_front_addr":"172.21.15.71:6805/1674049999","state":["exists","up"]},{"osd":2,"uuid":"4b506f93-8b23-4b61-91ef-853f291ff271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6801","nonce":1873540027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6803","nonce":1873540027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6807","nonce":1873540027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1873540027},{"type":"v1","addr":"172.21.15.154:6805","nonce":1873540027}]},"public_addr":"172.21.15.154:6801/1873540027","cluster_addr":"172.21.15.154:6803/1873540027","heartbeat_back_addr":"172.21.15.154:6807/1873540027","heartbeat_front_addr":"172.21.15.154:6805/1873540027","state":["exists","up"]},{"osd":3,"uuid":"cff00379-25cc-49a9-affe-2a92479e3a6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6811","nonce":1122631258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6813","nonce":1122631258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6817","nonce":1122631258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1122631258},{"type":"v1","addr":"172.21.15.38:6815","nonce":1122631258}]},"public_addr":"172.21.15.38:6811/1122631258","cluster_addr":"172.21.15.38:6813/1122631258","heartbeat_back_addr":"172.21.15.38:6817/1122631258","heartbeat_front_addr":"172.21.15.38:6815/1122631258","state":["exists","up"]},{"osd":4,"uuid":"908f5ae0-5cbc-4be6-9125-5c75c7d5c1f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6809","nonce":1646041821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6811","nonce":1646041821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6815","nonce":1646041821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1646041821},{"type":"v1","addr":"172.21.15.71:6813","nonce":1646041821}]},"public_addr":"172.21.15.71:6809/1646041821","cluster_addr":"172.21.15.71:6811/1646041821","heartbeat_back_addr":"172.21.15.71:6815/1646041821","heartbeat_front_addr":"172.21.15.71:6813/1646041821","state":["exists","up"]},{"osd":5,"uuid":"edb2a0d3-b0e6-4f70-b9f8-5af3e452e6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6809","nonce":908205841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6811","nonce":908205841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6815","nonce":908205841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":908205841},{"type":"v1","addr":"172.21.15.154:6813","nonce":908205841}]},"public_addr":"172.21.15.154:6809/908205841","cluster_addr":"172.21.15.154:6811/908205841","heartbeat_back_addr":"172.21.15.154:6815/908205841","heartbeat_front_addr":"172.21.15.154:6813/908205841","state":["exists","up"]},{"osd":6,"uuid":"61f54b73-d6fd-452a-b38f-0968bd646803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6819","nonce":3228938954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6821","nonce":3228938954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6825","nonce":3228938954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":3228938954},{"type":"v1","addr":"172.21.15.38:6823","nonce":3228938954}]},"public_addr":"172.21.15.38:6819/3228938954","cluster_addr":"172.21.15.38:6821/3228938954","heartbeat_back_addr":"172.21.15.38:6825/3228938954","heartbeat_front_addr":"172.21.15.38:6823/3228938954","state":["exists","up"]},{"osd":7,"uuid":"3b272e86-3a25-40df-b8f4-1f41cb6a4bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6817","nonce":3734483310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6819","nonce":3734483310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6823","nonce":3734483310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3734483310},{"type":"v1","addr":"172.21.15.71:6821","nonce":3734483310}]},"public_addr":"172.21.15.71:6817/3734483310","cluster_addr":"172.21.15.71:6819/3734483310","heartbeat_back_addr":"172.21.15.71:6823/3734483310","heartbeat_front_addr":"172.21.15.71:6821/3734483310","state":["exists","up"]},{"osd":8,"uuid":"7556a43c-35d1-4404-8ff1-3e12d177d45b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6817","nonce":1762082405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6819","nonce":1762082405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6823","nonce":1762082405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1762082405},{"type":"v1","addr":"172.21.15.154:6821","nonce":1762082405}]},"public_addr":"172.21.15.154:6817/1762082405","cluster_addr":"172.21.15.154:6819/1762082405","heartbeat_back_addr":"172.21.15.154:6823/1762082405","heartbeat_front_addr":"172.21.15.154:6821/1762082405","state":["exists","up"]},{"osd":9,"uuid":"193a9b75-c4f8-4a7f-b8a3-9b1566e43f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6827","nonce":3838798942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6829","nonce":3838798942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6833","nonce":3838798942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":3838798942},{"type":"v1","addr":"172.21.15.38:6831","nonce":3838798942}]},"public_addr":"172.21.15.38:6827/3838798942","cluster_addr":"172.21.15.38:6829/3838798942","heartbeat_back_addr":"172.21.15.38:6833/3838798942","heartbeat_front_addr":"172.21.15.38:6831/3838798942","state":["exists","up"]},{"osd":10,"uuid":"62aedf15-9d2c-46b9-bf26-83fe7c52ded1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6825","nonce":1853359859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6827","nonce":1853359859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6831","nonce":1853359859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1853359859},{"type":"v1","addr":"172.21.15.71:6829","nonce":1853359859}]},"public_addr":"172.21.15.71:6825/1853359859","cluster_addr":"172.21.15.71:6827/1853359859","heartbeat_back_addr":"172.21.15.71:6831/1853359859","heartbeat_front_addr":"172.21.15.71:6829/1853359859","state":["exists","up"]},{"osd":11,"uuid":"dee8442e-7be2-4078-869a-33a7f6b13a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6825","nonce":1742402788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6827","nonce":1742402788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6831","nonce":1742402788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1742402788},{"type":"v1","addr":"172.21.15.154:6829","nonce":1742402788}]},"public_addr":"172.21.15.154:6825/1742402788","cluster_addr":"172.21.15.154:6827/1742402788","heartbeat_back_addr":"172.21.15.154:6831/1742402788","heartbeat_front_addr":"172.21.15.154:6829/1742402788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:05.340661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:29.575275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:17:54.524939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:24.264380+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:50.060938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:15.547212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:44.504684+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:10.231672+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:34.742953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:04.619403+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:30.212717+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:54.916835+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:6800/2462218902":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/780591637":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2321943199":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/271793937":"2024-09-13T12:15:33.976954+0000","172.21.15.38:0/2979922122":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/746177485":"2024-09-13T12:15:04.820922+0000","172.21.15.38:0/3674823086":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6801/3803178885":"2024-09-13T12:15:04.820922+0000","172.21.15.38:6800/3803178885":"2024-09-13T12:15:04.820922+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:28:45.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe93c0a2c00 msgr2=0x7fe93c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe93c0a2c00 0x7fe93c0a50c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe95419f9d0 tx=0x7fe948005f90 comp rx=0 tx=0).stop 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 msgr2=0x7fe9541a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541a4c10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe940006010 tx=0x7fe9400042f0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 shutdown_connections 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe93c0a2c00 0x7fe93c0a50c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe954112a30 0x7fe95419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe954077040 0x7fe9541a4c10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 --2- 172.21.15.38:0/3917969371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe954076720 0x7fe9541a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 >> 172.21.15.38:0/3917969371 conn(0x7fe9540ffa90 msgr2=0x7fe954101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 shutdown_connections 2024-09-12T12:28:45.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:45.405+0000 7fe95b800640 1 -- 172.21.15.38:0/3917969371 wait complete. 2024-09-12T12:28:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:45 smithi154 ceph-mon[35578]: pgmap v478: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:28:46.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:45 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3917969371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:28:46.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:45 smithi038 ceph-mon[30810]: pgmap v478: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:28:46.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:45 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3917969371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:28:46.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:45 smithi071 ceph-mon[34859]: pgmap v478: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:28:46.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:45 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3917969371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:28:46.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T12:28:46.703 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 -- 172.21.15.38:0/3593770573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b01047e0 msgr2=0x7f46b0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 --2- 172.21.15.38:0/3593770573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b01047e0 0x7f46b0108830 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4698009900 tx=0x7f469802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 -- 172.21.15.38:0/3593770573 shutdown_connections 2024-09-12T12:28:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 --2- 172.21.15.38:0/3593770573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b0108f60 0x7f46b0110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 --2- 172.21.15.38:0/3593770573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b01047e0 0x7f46b0108830 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 --2- 172.21.15.38:0/3593770573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46b0103e30 0x7f46b0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 -- 172.21.15.38:0/3593770573 >> 172.21.15.38:0/3593770573 conn(0x7f46b00ff8d0 msgr2=0x7f46b0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 -- 172.21.15.38:0/3593770573 shutdown_connections 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.254+0000 7f46b4a00640 1 -- 172.21.15.38:0/3593770573 wait complete. 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.255+0000 7f46b4a00640 1 Processor -- start 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.255+0000 7f46b4a00640 1 -- start start 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46b4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46b0103e30 0x7f46b019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46b4a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b01047e0 0x7f46b019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46b4a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b0108f60 0x7f46b019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46b4a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0114010 con 0x7f46b0108f60 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46b4a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0113e90 con 0x7f46b0103e30 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46b4a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0114190 con 0x7f46b01047e0 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46af200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b0108f60 0x7f46b019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46af200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b0108f60 0x7f46b019ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39436/0 (socket says 172.21.15.38:39436) 2024-09-12T12:28:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46af200640 1 -- 172.21.15.38:0/848332576 learned_addr learned my addr 172.21.15.38:0/848332576 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46ae800640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46b0103e30 0x7f46b019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.256+0000 7f46a7e00640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b01047e0 0x7f46b019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46af200640 1 -- 172.21.15.38:0/848332576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b01047e0 msgr2=0x7f46b019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46af200640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b01047e0 0x7f46b019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46af200640 1 -- 172.21.15.38:0/848332576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46b0103e30 msgr2=0x7f46b019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46af200640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46b0103e30 0x7f46b019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46af200640 1 -- 172.21.15.38:0/848332576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b019f440 con 0x7f46b0108f60 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46ae800640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46b0103e30 0x7f46b019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46af200640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b0108f60 0x7f46b019ed60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f46a800eaa0 tx=0x7f46a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46a7400640 1 -- 172.21.15.38:0/848332576 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a800cdb0 con 0x7f46b0108f60 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46a7400640 1 -- 172.21.15.38:0/848332576 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46a8005020 con 0x7f46b0108f60 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46b4a00640 1 -- 172.21.15.38:0/848332576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b019f730 con 0x7f46b0108f60 2024-09-12T12:28:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46a7400640 1 -- 172.21.15.38:0/848332576 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a80116b0 con 0x7f46b0108f60 2024-09-12T12:28:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.257+0000 7f46b4a00640 1 -- 172.21.15.38:0/848332576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b01a7010 con 0x7f46b0108f60 2024-09-12T12:28:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.259+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b0104210 con 0x7f46b0108f60 2024-09-12T12:28:47.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.260+0000 7f46a7400640 1 -- 172.21.15.38:0/848332576 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f46a8005560 con 0x7f46b0108f60 2024-09-12T12:28:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.262+0000 7f46a7400640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46940a2c00 0x7f46940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.262+0000 7f46a7400640 1 -- 172.21.15.38:0/848332576 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9179+0+0 (secure 0 0 0) 0x7f46a80cf1d0 con 0x7f46b0108f60 2024-09-12T12:28:47.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.262+0000 7f46ae800640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46940a2c00 0x7f46940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.263+0000 7f46ae800640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46940a2c00 0x7f46940a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f46a000bfd0 tx=0x7f46a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.266+0000 7f46a7400640 1 -- 172.21.15.38:0/848332576 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46a8016030 con 0x7f46b0108f60 2024-09-12T12:28:47.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.492+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f46b0062df0 con 0x7f46b0108f60 2024-09-12T12:28:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.496+0000 7f46a7400640 1 -- 172.21.15.38:0/848332576 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f46a809b6d0 con 0x7f46b0108f60 2024-09-12T12:28:47.497 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:28:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46940a2c00 msgr2=0x7f46940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46940a2c00 0x7f46940a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f46a000bfd0 tx=0x7f46a000b390 comp rx=0 tx=0).stop 2024-09-12T12:28:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b0108f60 msgr2=0x7f46b019ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b0108f60 0x7f46b019ed60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f46a800eaa0 tx=0x7f46a800ef60 comp rx=0 tx=0).stop 2024-09-12T12:28:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 shutdown_connections 2024-09-12T12:28:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f46940a2c00 0x7f46940a50c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46b0108f60 0x7f46b019ed60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46b01047e0 0x7f46b019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 --2- 172.21.15.38:0/848332576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46b0103e30 0x7f46b019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.500+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 >> 172.21.15.38:0/848332576 conn(0x7f46b00ff8d0 msgr2=0x7f46b0100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.502+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 shutdown_connections 2024-09-12T12:28:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:47.502+0000 7f46a4c00640 1 -- 172.21.15.38:0/848332576 wait complete. 2024-09-12T12:28:47.809 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a[30806]: 2024-09-12T12:28:47.493+0000 7f08ce200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:28:47.809 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g[71041]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.809 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g[71041]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.809 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mds[71045]: -- 172.21.15.38:0/424607355 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558e13a17860 con 0x558e139f5000 2024-09-12T12:28:47.810 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g[71041]: starting mds.g at 2024-09-12T12:28:47.810 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a[71409]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.810 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a[71409]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.810 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mds[71413]: -- 172.21.15.38:0/3025733626 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56397c8d3860 con 0x56397c8b1400 2024-09-12T12:28:47.810 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a[71409]: starting mds.a at 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c[66029]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c[66029]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mds[66033]: -- 172.21.15.154:0/1334510635 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643e1a75860 con 0x5643e1a53400 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c[66029]: starting mds.c at 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e[64649]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e[64649]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mds[64653]: -- 172.21.15.71:0/2814024174 <== mon.2 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eae5cfb860 con 0x55eae5cd8800 2024-09-12T12:28:47.811 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e[64649]: starting mds.e at 2024-09-12T12:28:47.812 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f[65726]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.812 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f[65726]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.812 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mds[65730]: -- 172.21.15.154:0/832133829 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578bef27c20 con 0x5578bef05000 2024-09-12T12:28:47.812 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f[65726]: starting mds.f at 2024-09-12T12:28:47.812 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h[64949]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.812 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h[64949]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.812 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mds[64953]: -- 172.21.15.71:0/1049939666 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563cfdf1d860 con 0x563cfdefa800 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h[64949]: starting mds.h at 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l[65421]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l[65421]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mds[65425]: -- 172.21.15.154:0/822810759 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55baab421c20 con 0x55baab3ff000 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l[65421]: starting mds.l at 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.813 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mds[65257]: -- 172.21.15.71:0/1527673212 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c67d43860 con 0x557c67d20800 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: starting mds.b at 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i[66332]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i[66332]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mds[66336]: -- 172.21.15.154:0/4179047409 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562291c3f860 con 0x562291c1d000 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i[66332]: starting mds.i at 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k[64337]: ignoring --setuser ceph since I am not root 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k[64337]: ignoring --setgroup ceph since I am not root 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mds[64341]: -- 172.21.15.71:0/3283245024 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b05ba1860 con 0x564b05b7f000 2024-09-12T12:28:47.814 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k[64337]: starting mds.k at 2024-09-12T12:28:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mon[35578]: pgmap v479: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T12:28:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/848332576' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:28:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mon[35578]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:28:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mon[35578]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:28:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/848332576' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:28:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mon[35578]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T12:28:48.167 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:47 smithi154 ceph-mon[35578]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T12:28:48.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mon[30810]: pgmap v479: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T12:28:48.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/848332576' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:28:48.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mon[30810]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:28:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mon[30810]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:28:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/848332576' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:28:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mon[30810]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T12:28:48.220 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:47 smithi038 ceph-mon[30810]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T12:28:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mon[34859]: pgmap v479: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-12T12:28:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/848332576' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:28:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mon[34859]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:28:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mon[34859]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:28:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/848332576' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:28:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mon[34859]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T12:28:48.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:47 smithi071 ceph-mon[34859]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T12:28:48.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:28:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 -- 172.21.15.38:0/604476956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074e30 msgr2=0x7f193410df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 --2- 172.21.15.38:0/604476956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074e30 0x7f193410df00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1920009900 tx=0x7f192002a480 comp rx=0 tx=0).stop 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 -- 172.21.15.38:0/604476956 shutdown_connections 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 --2- 172.21.15.38:0/604476956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193410e440 0x7f1934110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 --2- 172.21.15.38:0/604476956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074e30 0x7f193410df00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 --2- 172.21.15.38:0/604476956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934074510 0x7f19340748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 -- 172.21.15.38:0/604476956 >> 172.21.15.38:0/604476956 conn(0x7f19340fd8c0 msgr2=0x7f19340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 -- 172.21.15.38:0/604476956 shutdown_connections 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.434+0000 7f1939200640 1 -- 172.21.15.38:0/604476956 wait complete. 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.435+0000 7f1939200640 1 Processor -- start 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.435+0000 7f1939200640 1 -- start start 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1939200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074510 0x7f193419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1939200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1934074e30 0x7f193419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1939200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193410e440 0x7f193419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1939200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f19341141b0 con 0x7f1934074510 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1939200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1934114030 con 0x7f1934074e30 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1939200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1934114330 con 0x7f193410e440 2024-09-12T12:28:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074510 0x7f193419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074510 0x7f193419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39464/0 (socket says 172.21.15.38:39464) 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931e00640 1 -- 172.21.15.38:0/1163506014 learned_addr learned my addr 172.21.15.38:0/1163506014 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931400640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1934074e30 0x7f193419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1932800640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193410e440 0x7f193419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931e00640 1 -- 172.21.15.38:0/1163506014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193410e440 msgr2=0x7f193419e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931e00640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193410e440 0x7f193419e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931e00640 1 -- 172.21.15.38:0/1163506014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1934074e30 msgr2=0x7f193419ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.436+0000 7f1931e00640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1934074e30 0x7f193419ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.437+0000 7f1931e00640 1 -- 172.21.15.38:0/1163506014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193419e740 con 0x7f1934074510 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.437+0000 7f1931e00640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074510 0x7f193419a7f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f192400e9f0 tx=0x7f192400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.437+0000 7f192aa00640 1 -- 172.21.15.38:0/1163506014 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192400cd80 con 0x7f1934074510 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.437+0000 7f192aa00640 1 -- 172.21.15.38:0/1163506014 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1924005500 con 0x7f1934074510 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.437+0000 7f192aa00640 1 -- 172.21.15.38:0/1163506014 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924010690 con 0x7f1934074510 2024-09-12T12:28:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.437+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193419ea30 con 0x7f1934074510 2024-09-12T12:28:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.437+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341a73a0 con 0x7f1934074510 2024-09-12T12:28:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.438+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19340748f0 con 0x7f1934074510 2024-09-12T12:28:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.440+0000 7f192aa00640 1 -- 172.21.15.38:0/1163506014 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f19240046c0 con 0x7f1934074510 2024-09-12T12:28:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.442+0000 7f192aa00640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19180a2c00 0x7f19180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.442+0000 7f192aa00640 1 -- 172.21.15.38:0/1163506014 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9609+0+0 (secure 0 0 0) 0x7f19240cf980 con 0x7f1934074510 2024-09-12T12:28:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.442+0000 7f1931400640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19180a2c00 0x7f19180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.443+0000 7f1931400640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19180a2c00 0x7f19180a50c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1920000c00 tx=0x7f1920005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.450+0000 7f192aa00640 1 -- 172.21.15.38:0/1163506014 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f192409c320 con 0x7f1934074510 2024-09-12T12:28:49.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: pgmap v481: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T12:28:49.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6832/318953282,v1:172.21.15.154:6833/318953282] up:boot 2024-09-12T12:28:49.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6832/744016353,v1:172.21.15.71:6834/744016353] up:boot 2024-09-12T12:28:49.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6833/1393086351,v1:172.21.15.71:6835/1393086351] up:boot 2024-09-12T12:28:49.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6834/3813544769,v1:172.21.15.154:6835/3813544769] up:boot 2024-09-12T12:28:49.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6836/366111145,v1:172.21.15.154:6837/366111145] up:boot 2024-09-12T12:28:49.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:49.674+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f19341095c0 con 0x7f1934074510 2024-09-12T12:28:49.675 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: pgmap v481: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T12:28:49.675 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6832/318953282,v1:172.21.15.154:6833/318953282] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6832/744016353,v1:172.21.15.71:6834/744016353] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6833/1393086351,v1:172.21.15.71:6835/1393086351] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6834/3813544769,v1:172.21.15.154:6835/3813544769] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6836/366111145,v1:172.21.15.154:6837/366111145] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.154:6838/3399762651,v1:172.21.15.154:6839/3399762651] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6836/12730465,v1:172.21.15.71:6838/12730465] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.71:6837/319269836,v1:172.21.15.71:6839/319269836] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.38:6838/2181835516,v1:172.21.15.38:6840/2181835516] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: mds.? [v2:172.21.15.38:6839/1128611179,v1:172.21.15.38:6841/1128611179] up:boot 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:28:49.676 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:28:49.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:28:49.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:28:49.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:28:49.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:28:49.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:28:49.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:28:49.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:49 smithi038 ceph-mon[30810]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:28:49.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: pgmap v481: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T12:28:49.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6832/318953282,v1:172.21.15.154:6833/318953282] up:boot 2024-09-12T12:28:49.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6832/744016353,v1:172.21.15.71:6834/744016353] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6833/1393086351,v1:172.21.15.71:6835/1393086351] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6834/3813544769,v1:172.21.15.154:6835/3813544769] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6836/366111145,v1:172.21.15.154:6837/366111145] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.154:6838/3399762651,v1:172.21.15.154:6839/3399762651] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6836/12730465,v1:172.21.15.71:6838/12730465] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.71:6837/319269836,v1:172.21.15.71:6839/319269836] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.38:6838/2181835516,v1:172.21.15.38:6840/2181835516] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: mds.? [v2:172.21.15.38:6839/1128611179,v1:172.21.15.38:6841/1128611179] up:boot 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T12:28:49.765 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:28:49.766 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:49 smithi071 ceph-mon[34859]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.154:6838/3399762651,v1:172.21.15.154:6839/3399762651] up:boot 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6836/12730465,v1:172.21.15.71:6838/12730465] up:boot 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.71:6837/319269836,v1:172.21.15.71:6839/319269836] up:boot 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.38:6838/2181835516,v1:172.21.15.38:6840/2181835516] up:boot 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: mds.? [v2:172.21.15.38:6839/1128611179,v1:172.21.15.38:6841/1128611179] up:boot 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:28:49.785 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:28:49.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:28:49.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:28:49.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:28:49.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:28:49.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:49 smithi154 ceph-mon[35578]: from='mgr.14150 172.21.15.38:0/3173552053' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:28:50.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.507+0000 7f192aa00640 1 -- 172.21.15.38:0/1163506014 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f1924086020 con 0x7f1934074510 2024-09-12T12:28:50.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19180a2c00 msgr2=0x7f19180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:50.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19180a2c00 0x7f19180a50c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1920000c00 tx=0x7f1920005b50 comp rx=0 tx=0).stop 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074510 msgr2=0x7f193419a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074510 0x7f193419a7f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f192400e9f0 tx=0x7f192400edf0 comp rx=0 tx=0).stop 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 shutdown_connections 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f19180a2c00 0x7f19180a50c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193410e440 0x7f193419e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1934074e30 0x7f193419ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 --2- 172.21.15.38:0/1163506014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934074510 0x7f193419a7f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 >> 172.21.15.38:0/1163506014 conn(0x7f19340fd8c0 msgr2=0x7f19340fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 shutdown_connections 2024-09-12T12:28:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:50.510+0000 7f1939200640 1 -- 172.21.15.38:0/1163506014 wait complete. 2024-09-12T12:28:50.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:50 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1163506014' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:28:50.915 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:50 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1163506014' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:28:50.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:50 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1163506014' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:28:51.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:28:51.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:51 smithi038 ceph-mon[30810]: pgmap v482: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T12:28:51.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:51 smithi038 ceph-mon[30810]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:28:51.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:51 smithi038 ceph-mon[30810]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:28:51.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:51 smithi038 ceph-mon[30810]: Cluster is now healthy 2024-09-12T12:28:51.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:51 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/1163506014' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:28:51.720 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:51 smithi038 ceph-mon[30810]: fsmap 12 up:standby 2024-09-12T12:28:51.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:51 smithi071 ceph-mon[34859]: pgmap v482: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T12:28:51.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:51 smithi071 ceph-mon[34859]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:28:51.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:51 smithi071 ceph-mon[34859]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:28:51.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:51 smithi071 ceph-mon[34859]: Cluster is now healthy 2024-09-12T12:28:51.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:51 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/1163506014' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:28:51.764 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:51 smithi071 ceph-mon[34859]: fsmap 12 up:standby 2024-09-12T12:28:51.831 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:51.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:51 smithi154 ceph-mon[35578]: pgmap v482: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T12:28:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:51 smithi154 ceph-mon[35578]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:28:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:51 smithi154 ceph-mon[35578]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:28:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:51 smithi154 ceph-mon[35578]: Cluster is now healthy 2024-09-12T12:28:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:51 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/1163506014' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:28:51.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:51 smithi154 ceph-mon[35578]: fsmap 12 up:standby 2024-09-12T12:28:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 -- 172.21.15.38:0/3319880199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf8103ff0 msgr2=0x7fcaf81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3319880199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf8103ff0 0x7fcaf81043d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009900 tx=0x7fcae802a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 -- 172.21.15.38:0/3319880199 shutdown_connections 2024-09-12T12:28:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3319880199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 0x7fcaf8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3319880199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf81049a0 0x7fcaf81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3319880199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf8103ff0 0x7fcaf81043d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 -- 172.21.15.38:0/3319880199 >> 172.21.15.38:0/3319880199 conn(0x7fcaf80ffa90 msgr2=0x7fcaf8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 -- 172.21.15.38:0/3319880199 shutdown_connections 2024-09-12T12:28:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.405+0000 7fcafcc00640 1 -- 172.21.15.38:0/3319880199 wait complete. 2024-09-12T12:28:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 Processor -- start 2024-09-12T12:28:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 -- start start 2024-09-12T12:28:52.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf8103ff0 0x7fcaf819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:52.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf81049a0 0x7fcaf819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 0x7fcaf819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8114120 con 0x7fcaf81049a0 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8113fa0 con 0x7fcaf8109120 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.406+0000 7fcafcc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81142a0 con 0x7fcaf8103ff0 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 0x7fcaf819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 0x7fcaf819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.38:57716/0 (socket says 172.21.15.38:57716) 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 -- 172.21.15.38:0/3942418166 learned_addr learned my addr 172.21.15.38:0/3942418166 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaed400640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf81049a0 0x7fcaf819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf5e00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf8103ff0 0x7fcaf819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 -- 172.21.15.38:0/3942418166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf8103ff0 msgr2=0x7fcaf819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf8103ff0 0x7fcaf819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 -- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf81049a0 msgr2=0x7fcaf819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf81049a0 0x7fcaf819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 -- 172.21.15.38:0/3942418166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf819f5d0 con 0x7fcaf8109120 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaed400640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf81049a0 0x7fcaf819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaf6800640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 0x7fcaf819eef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efd0 tx=0x7fcaf000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaef400640 1 -- 172.21.15.38:0/3942418166 <== mon.2 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0003b70 con 0x7fcaf8109120 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcaef400640 1 -- 172.21.15.38:0/3942418166 <== mon.2 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0003d10 con 0x7fcaf8109120 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.407+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf819f8c0 con 0x7fcaf8109120 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.408+0000 7fcaef400640 1 -- 172.21.15.38:0/3942418166 <== mon.2 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00109f0 con 0x7fcaf8109120 2024-09-12T12:28:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.408+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf81a71a0 con 0x7fcaf8109120 2024-09-12T12:28:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.409+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf81043d0 con 0x7fcaf8109120 2024-09-12T12:28:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.411+0000 7fcaef400640 1 -- 172.21.15.38:0/3942418166 <== mon.2 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcaf0004020 con 0x7fcaf8109120 2024-09-12T12:28:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.412+0000 7fcaef400640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcadc0a2c00 0x7fcadc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.412+0000 7fcaef400640 1 -- 172.21.15.38:0/3942418166 <== mon.2 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9609+0+0 (secure 0 0 0) 0x7fcaf00cf9f0 con 0x7fcaf8109120 2024-09-12T12:28:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.412+0000 7fcaf5e00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcadc0a2c00 0x7fcadc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.413+0000 7fcaf5e00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcadc0a2c00 0x7fcadc0a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009230 tx=0x7fcae80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:52.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.416+0000 7fcaef400640 1 -- 172.21.15.38:0/3942418166 <== mon.2 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcaf009c390 con 0x7fcaf8109120 2024-09-12T12:28:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:52.607+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcaf802d7c0 con 0x7fcaf8109120 2024-09-12T12:28:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.524+0000 7fcaef400640 1 -- 172.21.15.38:0/3942418166 <== mon.2 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7fcaf009bc90 con 0x7fcaf8109120 2024-09-12T12:28:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcadc0a2c00 msgr2=0x7fcadc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcadc0a2c00 0x7fcadc0a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009230 tx=0x7fcae80058d0 comp rx=0 tx=0).stop 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 msgr2=0x7fcaf819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 0x7fcaf819eef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efd0 tx=0x7fcaf000c6a0 comp rx=0 tx=0).stop 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 shutdown_connections 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fcadc0a2c00 0x7fcadc0a50c0 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009230 tx=0x7fcae80058d0 comp rx=0 tx=0).stop 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaf8109120 0x7fcaf819eef0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf81049a0 0x7fcaf819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 --2- 172.21.15.38:0/3942418166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf8103ff0 0x7fcaf819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:53.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.528+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 >> 172.21.15.38:0/3942418166 conn(0x7fcaf80ffa90 msgr2=0x7fcaf8100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:53.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.529+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 shutdown_connections 2024-09-12T12:28:53.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:53.529+0000 7fcafcc00640 1 -- 172.21.15.38:0/3942418166 wait complete. 2024-09-12T12:28:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:53 smithi154 ceph-mon[35578]: pgmap v483: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-12T12:28:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:53 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/3942418166' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:53.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:53 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:53.950 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:53 smithi038 ceph-mon[30810]: pgmap v483: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-12T12:28:53.950 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:53 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/3942418166' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:53.950 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:53 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:53 smithi071 ceph-mon[34859]: pgmap v483: 129 pgs: 129 active+clean; 1.2 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-12T12:28:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:53 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/3942418166' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:54.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:53 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:54.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:28:54.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:54 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:28:54.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:54 smithi038 ceph-mon[30810]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T12:28:54.875 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:54.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:54 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:28:54.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:54 smithi154 ceph-mon[35578]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T12:28:55.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:54 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:28:55.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:54 smithi071 ceph-mon[34859]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 -- 172.21.15.38:0/3638400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe980100720 msgr2=0x7fe980100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 --2- 172.21.15.38:0/3638400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe980100720 0x7fe980100b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe974009900 tx=0x7fe97402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 -- 172.21.15.38:0/3638400782 shutdown_connections 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 --2- 172.21.15.38:0/3638400782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98010e2d0 0x7fe9801106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 --2- 172.21.15.38:0/3638400782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9801010d0 0x7fe98010dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 --2- 172.21.15.38:0/3638400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe980100720 0x7fe980100b00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 -- 172.21.15.38:0/3638400782 >> 172.21.15.38:0/3638400782 conn(0x7fe9800fc610 msgr2=0x7fe9800fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 -- 172.21.15.38:0/3638400782 shutdown_connections 2024-09-12T12:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.457+0000 7fe987000640 1 -- 172.21.15.38:0/3638400782 wait complete. 2024-09-12T12:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.458+0000 7fe987000640 1 Processor -- start 2024-09-12T12:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe987000640 1 -- start start 2024-09-12T12:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe987000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe980100720 0x7fe98019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe987000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9801010d0 0x7fe98019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe987000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe98010e2d0 0x7fe98019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe987000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe980114020 con 0x7fe98010e2d0 2024-09-12T12:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe987000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe980113ea0 con 0x7fe980100720 2024-09-12T12:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe987000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9801141a0 con 0x7fe9801010d0 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe985200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9801010d0 0x7fe98019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe986600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe98010e2d0 0x7fe98019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe985200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9801010d0 0x7fe98019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.38:51788/0 (socket says 172.21.15.38:51788) 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe985c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe980100720 0x7fe98019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.459+0000 7fe985200640 1 -- 172.21.15.38:0/2647648888 learned_addr learned my addr 172.21.15.38:0/2647648888 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.460+0000 7fe985200640 1 -- 172.21.15.38:0/2647648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe980100720 msgr2=0x7fe98019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.460+0000 7fe985200640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe980100720 0x7fe98019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.460+0000 7fe985200640 1 -- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe98010e2d0 msgr2=0x7fe98019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.460+0000 7fe985200640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe98010e2d0 0x7fe98019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.460+0000 7fe985200640 1 -- 172.21.15.38:0/2647648888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98019f460 con 0x7fe9801010d0 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.460+0000 7fe985200640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9801010d0 0x7fe98019a9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00d950 tx=0x7fe96c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.460+0000 7fe97e000640 1 -- 172.21.15.38:0/2647648888 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c017070 con 0x7fe9801010d0 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.461+0000 7fe97e000640 1 -- 172.21.15.38:0/2647648888 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96c009c30 con 0x7fe9801010d0 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.461+0000 7fe97e000640 1 -- 172.21.15.38:0/2647648888 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00f6b0 con 0x7fe9801010d0 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.461+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98019f750 con 0x7fe9801010d0 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.461+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9801a7030 con 0x7fe9801010d0 2024-09-12T12:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.462+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe980100b00 con 0x7fe9801010d0 2024-09-12T12:28:55.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.465+0000 7fe97e000640 1 -- 172.21.15.38:0/2647648888 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe96c0109d0 con 0x7fe9801010d0 2024-09-12T12:28:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.466+0000 7fe97e000640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe9680a2c00 0x7fe9680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.466+0000 7fe97e000640 1 -- 172.21.15.38:0/2647648888 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9084+0+0 (secure 0 0 0) 0x7fe96c0cef00 con 0x7fe9801010d0 2024-09-12T12:28:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.466+0000 7fe985c00640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe9680a2c00 0x7fe9680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.467+0000 7fe985c00640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe9680a2c00 0x7fe9680a50c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe974000c00 tx=0x7fe974005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:55.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.467+0000 7fe97e000640 1 -- 172.21.15.38:0/2647648888 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe96c009de0 con 0x7fe9801010d0 2024-09-12T12:28:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:55.657+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe98019b810 con 0x7fe9801010d0 2024-09-12T12:28:55.658 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:55 smithi038 ceph-mon[30810]: pgmap v485: 97 pgs: 97 active+clean; 577 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:55.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:55 smithi154 ceph-mon[35578]: pgmap v485: 97 pgs: 97 active+clean; 577 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:56.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:55 smithi071 ceph-mon[34859]: pgmap v485: 97 pgs: 97 active+clean; 577 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:56.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.551+0000 7fe97e000640 1 -- 172.21.15.38:0/2647648888 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7fe96c09b4e0 con 0x7fe9801010d0 2024-09-12T12:28:56.551 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2024-09-12T12:28:56.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.555+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe9680a2c00 msgr2=0x7fe9680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:56.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.555+0000 7fe987000640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe9680a2c00 0x7fe9680a50c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe974000c00 tx=0x7fe974005b50 comp rx=0 tx=0).stop 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.555+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9801010d0 msgr2=0x7fe98019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.555+0000 7fe987000640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9801010d0 0x7fe98019a9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00d950 tx=0x7fe96c00de10 comp rx=0 tx=0).stop 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.556+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 shutdown_connections 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.556+0000 7fe987000640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7fe9680a2c00 0x7fe9680a50c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.556+0000 7fe987000640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe98010e2d0 0x7fe98019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.556+0000 7fe987000640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9801010d0 0x7fe98019a9f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.556+0000 7fe987000640 1 --2- 172.21.15.38:0/2647648888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe980100720 0x7fe98019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.556+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 >> 172.21.15.38:0/2647648888 conn(0x7fe9800fc610 msgr2=0x7fe9800fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:56.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.559+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 shutdown_connections 2024-09-12T12:28:56.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:56.559+0000 7fe987000640 1 -- 172.21.15.38:0/2647648888 wait complete. 2024-09-12T12:28:56.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:56 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2647648888' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:56.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:56 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:56.934 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:56 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2647648888' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:56.934 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:56 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:56 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2647648888' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:57.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:56 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:57.498 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 726420ce-7100-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T12:28:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:57 smithi038 ceph-mon[30810]: pgmap v486: 97 pgs: 97 active+clean; 577 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:57 smithi038 ceph-mon[30810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:28:57.719 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:57 smithi038 ceph-mon[30810]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T12:28:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:57.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:57 smithi154 ceph-mon[35578]: pgmap v486: 97 pgs: 97 active+clean; 577 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:57.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:57 smithi154 ceph-mon[35578]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:28:57.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:57 smithi154 ceph-mon[35578]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T12:28:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:57 smithi071 ceph-mon[34859]: pgmap v486: 97 pgs: 97 active+clean; 577 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:57 smithi071 ceph-mon[34859]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:28:58.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:57 smithi071 ceph-mon[34859]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 -- 172.21.15.38:0/3464769668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008410e260 msgr2=0x7f0084110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 --2- 172.21.15.38:0/3464769668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008410e260 0x7f0084110650 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f007c009ca0 tx=0x7f007c02a950 comp rx=0 tx=0).stop 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 -- 172.21.15.38:0/3464769668 shutdown_connections 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 --2- 172.21.15.38:0/3464769668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008410e260 0x7f0084110650 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 --2- 172.21.15.38:0/3464769668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0084074ee0 0x7f008410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 --2- 172.21.15.38:0/3464769668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00840745c0 0x7f00840749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 -- 172.21.15.38:0/3464769668 >> 172.21.15.38:0/3464769668 conn(0x7f00840fd740 msgr2=0x7f00840ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 -- 172.21.15.38:0/3464769668 shutdown_connections 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.456+0000 7f0088e00640 1 -- 172.21.15.38:0/3464769668 wait complete. 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.457+0000 7f0088e00640 1 Processor -- start 2024-09-12T12:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.457+0000 7f0088e00640 1 -- start start 2024-09-12T12:28:58.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0088e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00840745c0 0x7f008419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:58.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0088e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0084074ee0 0x7f008419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:58.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0088e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f008410e260 0x7f008419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:58.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0088e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0084113f70 con 0x7f0084074ee0 2024-09-12T12:28:58.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0088e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0084113df0 con 0x7f00840745c0 2024-09-12T12:28:58.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0088e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00841140f0 con 0x7f008410e260 2024-09-12T12:28:58.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0082a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0084074ee0 0x7f008419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0082a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0084074ee0 0x7f008419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56100/0 (socket says 172.21.15.38:56100) 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0082a00640 1 -- 172.21.15.38:0/2643623571 learned_addr learned my addr 172.21.15.38:0/2643623571 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0083400640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00840745c0 0x7f008419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.458+0000 7f0083e00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f008410e260 0x7f008419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0082a00640 1 -- 172.21.15.38:0/2643623571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f008410e260 msgr2=0x7f008419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0082a00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f008410e260 0x7f008419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0082a00640 1 -- 172.21.15.38:0/2643623571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00840745c0 msgr2=0x7f008419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0082a00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00840745c0 0x7f008419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0082a00640 1 -- 172.21.15.38:0/2643623571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008419f400 con 0x7f0084074ee0 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0083400640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00840745c0 0x7f008419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0082a00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0084074ee0 0x7f008419a990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f007000e9f0 tx=0x7f007000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:58.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f007be00640 1 -- 172.21.15.38:0/2643623571 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007000cd80 con 0x7f0084074ee0 2024-09-12T12:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f007be00640 1 -- 172.21.15.38:0/2643623571 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0070010910 con 0x7f0084074ee0 2024-09-12T12:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008419f6f0 con 0x7f0084074ee0 2024-09-12T12:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f007be00640 1 -- 172.21.15.38:0/2643623571 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070018990 con 0x7f0084074ee0 2024-09-12T12:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.459+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00841a6fd0 con 0x7f0084074ee0 2024-09-12T12:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.460+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00840749a0 con 0x7f0084074ee0 2024-09-12T12:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.462+0000 7f007be00640 1 -- 172.21.15.38:0/2643623571 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0070010ac0 con 0x7f0084074ee0 2024-09-12T12:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.465+0000 7f007be00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f00680a2c00 0x7f00680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.465+0000 7f007be00640 1 -- 172.21.15.38:0/2643623571 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8496+0+0 (secure 0 0 0) 0x7f00700cf350 con 0x7f0084074ee0 2024-09-12T12:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.465+0000 7f0083400640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f00680a2c00 0x7f00680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:58.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.465+0000 7f0083400640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f00680a2c00 0x7f00680a50c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0074005d00 tx=0x7f007400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:58.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.469+0000 7f007be00640 1 -- 172.21.15.38:0/2643623571 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f007009bb20 con 0x7f0084074ee0 2024-09-12T12:28:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:58.655+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f008402d7c0 con 0x7f0084074ee0 2024-09-12T12:28:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.560+0000 7f007be00640 1 -- 172.21.15.38:0/2643623571 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v97) ==== 178+0+0 (secure 0 0 0) 0x7f007009fe20 con 0x7f0084074ee0 2024-09-12T12:28:59.561 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data_ec' removed 2024-09-12T12:28:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.564+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f00680a2c00 msgr2=0x7f00680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.564+0000 7f0088e00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f00680a2c00 0x7f00680a50c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0074005d00 tx=0x7f007400b410 comp rx=0 tx=0).stop 2024-09-12T12:28:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.564+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0084074ee0 msgr2=0x7f008419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.564+0000 7f0088e00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0084074ee0 0x7f008419a990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f007000e9f0 tx=0x7f007000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:28:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.565+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 shutdown_connections 2024-09-12T12:28:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.565+0000 7f0088e00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:6800/1234723065,v1:172.21.15.38:6801/1234723065] conn(0x7f00680a2c00 0x7f00680a50c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.565+0000 7f0088e00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f008410e260 0x7f008419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.565+0000 7f0088e00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0084074ee0 0x7f008419a990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.565+0000 7f0088e00640 1 --2- 172.21.15.38:0/2643623571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00840745c0 0x7f008419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:59.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.565+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 >> 172.21.15.38:0/2643623571 conn(0x7f00840fd740 msgr2=0x7f00840fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:59.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.566+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 shutdown_connections 2024-09-12T12:28:59.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-12T12:28:59.566+0000 7f0088e00640 1 -- 172.21.15.38:0/2643623571 wait complete. 2024-09-12T12:28:59.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:59 smithi154 ceph-mon[35578]: pgmap v488: 33 pgs: 33 active+clean; 577 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:59.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:28:59 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2643623571' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:28:59.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:59 smithi038 ceph-mon[30810]: pgmap v488: 33 pgs: 33 active+clean; 577 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:28:59.969 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:28:59 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2643623571' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:29:00.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:59 smithi071 ceph-mon[34859]: pgmap v488: 33 pgs: 33 active+clean; 577 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:29:00.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:28:59 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2643623571' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:29:00.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:29:00.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:29:00.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:29:00.684 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T12:29:00.685 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:29:00.720 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:29:00.741 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:29:00.758 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T12:29:00.758 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T12:29:00.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a 2024-09-12T12:29:00.808 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:00 smithi038 ceph-mon[30810]: from='client.? 172.21.15.38:0/2643623571' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:29:00.808 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:00 smithi038 ceph-mon[30810]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T12:29:00.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:00 smithi154 ceph-mon[35578]: from='client.? 172.21.15.38:0/2643623571' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:29:00.917 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:00 smithi154 ceph-mon[35578]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T12:29:01.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:00 smithi071 ceph-mon[34859]: from='client.? 172.21.15.38:0/2643623571' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:29:01.014 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:00 smithi071 ceph-mon[34859]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T12:29:01.187 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:00 smithi038 systemd[1]: Stopping Ceph mon.a for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:01.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a[30806]: 2024-09-12T12:29:01.186+0000 7f08d5000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:01.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a[30806]: 2024-09-12T12:29:01.186+0000 7f08d5000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T12:29:01.469 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:01 smithi038 podman[92687]: 2024-09-12 12:29:01.411947514 +0000 UTC m=+0.348937202 container died 5a06de85b7ac31045059fda72290fd6f85a199d6f44610a80df98a0a99d879f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:01 smithi038 podman[92687]: 2024-09-12 12:29:01.993236557 +0000 UTC m=+0.930226245 container cleanup 5a06de85b7ac31045059fda72290fd6f85a199d6f44610a80df98a0a99d879f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T12:29:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:01 smithi038 bash[92687]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a 2024-09-12T12:29:02.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:02 smithi038 podman[92699]: 2024-09-12 12:29:02.194254615 +0000 UTC m=+0.778324053 container remove 5a06de85b7ac31045059fda72290fd6f85a199d6f44610a80df98a0a99d879f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T12:29:02.497 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T12:29:02.547 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:02 smithi038 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T12:29:02.547 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:02 smithi038 systemd[1]: Stopped Ceph mon.a for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:29:02.547 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 12 12:29:02 smithi038 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.a.service: Consumed 19.320s CPU time. 2024-09-12T12:29:02.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:02.620 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T12:29:02.621 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T12:29:02.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.b 2024-09-12T12:29:02.948 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:02 smithi071 systemd[1]: Stopping Ceph mon.b for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:02 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b[34855]: 2024-09-12T12:29:02.950+0000 7f36ebfa9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:02 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b[34855]: 2024-09-12T12:29:02.950+0000 7f36ebfa9640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T12:29:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:03 smithi071 podman[68144]: 2024-09-12 12:29:03.145333913 +0000 UTC m=+0.325358030 container stop 21bd368039d0e7c9b12b393245c0176c31530a7949f0cf7b4a1bae2530b46c5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T12:29:03.264 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:03 smithi071 podman[68144]: 2024-09-12 12:29:03.174903164 +0000 UTC m=+0.354927290 container died 21bd368039d0e7c9b12b393245c0176c31530a7949f0cf7b4a1bae2530b46c5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:29:03.761 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:03 smithi071 podman[68144]: 2024-09-12 12:29:03.543574714 +0000 UTC m=+0.723598830 container cleanup 21bd368039d0e7c9b12b393245c0176c31530a7949f0cf7b4a1bae2530b46c5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:03.761 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:03 smithi071 bash[68144]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b 2024-09-12T12:29:04.013 INFO:journalctl@ceph.mon.b.smithi071.stdout:Sep 12 12:29:03 smithi071 podman[68160]: 2024-09-12 12:29:03.761962989 +0000 UTC m=+0.609561730 container remove 21bd368039d0e7c9b12b393245c0176c31530a7949f0cf7b4a1bae2530b46c5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:04.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T12:29:04.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:04.063 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T12:29:04.063 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T12:29:04.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.c 2024-09-12T12:29:04.389 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:04 smithi154 systemd[1]: Stopping Ceph mon.c for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:04.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c[35570]: 2024-09-12T12:29:04.389+0000 7f972bc53640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:04.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c[35570]: 2024-09-12T12:29:04.389+0000 7f972bc53640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T12:29:04.916 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:04 smithi154 podman[69165]: 2024-09-12 12:29:04.644620188 +0000 UTC m=+0.376910364 container died a61bbc94c05e94c8dda6f653b972fcb1904c42b5500fb6a92594ed30ae05eb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T12:29:05.316 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:05 smithi154 podman[69165]: 2024-09-12 12:29:05.048129692 +0000 UTC m=+0.780419856 container cleanup a61bbc94c05e94c8dda6f653b972fcb1904c42b5500fb6a92594ed30ae05eb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T12:29:05.316 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 12 12:29:05 smithi154 bash[69165]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mon-c 2024-09-12T12:29:05.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T12:29:05.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:05.531 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T12:29:05.532 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T12:29:05.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.x 2024-09-12T12:29:05.969 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:29:05 smithi038 systemd[1]: Stopping Ceph mgr.x for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:06.417 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:29:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:29:05.983+0000 7f6c7b800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:06.417 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:29:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x[31034]: 2024-09-12T12:29:05.983+0000 7f6c7b800640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-12T12:29:06.417 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:29:06 smithi038 podman[92814]: 2024-09-12 12:29:06.066684249 +0000 UTC m=+0.247642479 container died ee7af3f1505d85eb5ac061c9dee8444bf6f559019dae3780f9275e9100170eea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T12:29:07.207 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:29:06 smithi038 podman[92814]: 2024-09-12 12:29:06.734023352 +0000 UTC m=+0.914981581 container cleanup ee7af3f1505d85eb5ac061c9dee8444bf6f559019dae3780f9275e9100170eea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:29:07.207 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:29:06 smithi038 bash[92814]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x 2024-09-12T12:29:07.207 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 12 12:29:06 smithi038 podman[92826]: 2024-09-12 12:29:06.95139418 +0000 UTC m=+0.868541004 container remove ee7af3f1505d85eb5ac061c9dee8444bf6f559019dae3780f9275e9100170eea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:07.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T12:29:07.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:07.300 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T12:29:07.300 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T12:29:07.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.y 2024-09-12T12:29:07.644 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:29:07 smithi071 systemd[1]: Stopping Ceph mgr.y for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:07.916 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:29:07 smithi071 podman[68269]: 2024-09-12 12:29:07.644557507 +0000 UTC m=+0.135930136 container died 7e7c795f14dc2f045c7c97b186b9e81b5f011e538487a1dc01b7fc5bf7e56eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T12:29:08.264 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:29:08 smithi071 podman[68269]: 2024-09-12 12:29:08.007119543 +0000 UTC m=+0.498492216 container cleanup 7e7c795f14dc2f045c7c97b186b9e81b5f011e538487a1dc01b7fc5bf7e56eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T12:29:08.264 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 12 12:29:08 smithi071 bash[68269]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-y 2024-09-12T12:29:08.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T12:29:08.462 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:08.463 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T12:29:08.463 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T12:29:08.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.z 2024-09-12T12:29:08.773 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:29:08 smithi154 systemd[1]: Stopping Ceph mgr.z for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:09.087 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:29:08 smithi154 podman[69286]: 2024-09-12 12:29:08.774194017 +0000 UTC m=+0.117172899 container died 3fda7892dadd77a2f9795ae1e3f76ea17079c0c770a2bfe50a6b8b77cf8acb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T12:29:09.405 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:29:09 smithi154 podman[69286]: 2024-09-12 12:29:09.170787589 +0000 UTC m=+0.513766471 container cleanup 3fda7892dadd77a2f9795ae1e3f76ea17079c0c770a2bfe50a6b8b77cf8acb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:29:09.405 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 12 12:29:09 smithi154 bash[69286]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mgr-z 2024-09-12T12:29:09.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T12:29:09.582 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:09.582 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T12:29:09.583 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T12:29:09.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.0 2024-09-12T12:29:09.969 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:09 smithi038 systemd[1]: Stopping Ceph osd.0 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:10.469 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0[44794]: 2024-09-12T12:29:10.015+0000 7f08d9000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:10.469 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0[44794]: 2024-09-12T12:29:10.015+0000 7f08d9000640 -1 osd.0 97 *** Got signal Terminated *** 2024-09-12T12:29:10.469 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0[44794]: 2024-09-12T12:29:10.015+0000 7f08d9000640 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:29:15.719 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:15 smithi038 podman[92934]: 2024-09-12 12:29:15.427037963 +0000 UTC m=+5.551103132 container died d112e42ec302b7126b172a28bcc299c91d58e7a3d5fe49e48814f51ea24a178b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:29:15.988 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:15 smithi038 podman[92934]: 2024-09-12 12:29:15.96353073 +0000 UTC m=+6.087595930 container cleanup d112e42ec302b7126b172a28bcc299c91d58e7a3d5fe49e48814f51ea24a178b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T12:29:15.988 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:15 smithi038 bash[92934]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0 2024-09-12T12:29:16.469 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:16 smithi038 podman[92953]: 2024-09-12 12:29:16.215449643 +0000 UTC m=+0.780075010 container remove d112e42ec302b7126b172a28bcc299c91d58e7a3d5fe49e48814f51ea24a178b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T12:29:17.104 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:16 smithi038 podman[93043]: 2024-09-12 12:29:16.701009068 +0000 UTC m=+0.027811785 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:29:17.104 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:16 smithi038 podman[93043]: 2024-09-12 12:29:16.824656199 +0000 UTC m=+0.151458893 container create 922b64faf39317843c0bf3eaa20bee62dd830b7454da40d3bf5ee3f14b76d20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T12:29:17.104 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:17 smithi038 podman[93043]: 2024-09-12 12:29:17.104177659 +0000 UTC m=+0.430980353 container init 922b64faf39317843c0bf3eaa20bee62dd830b7454da40d3bf5ee3f14b76d20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:17.371 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:17 smithi038 podman[93043]: 2024-09-12 12:29:17.111544228 +0000 UTC m=+0.438346928 container start 922b64faf39317843c0bf3eaa20bee62dd830b7454da40d3bf5ee3f14b76d20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:29:17.371 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:17 smithi038 podman[93043]: 2024-09-12 12:29:17.210992849 +0000 UTC m=+0.537795549 container attach 922b64faf39317843c0bf3eaa20bee62dd830b7454da40d3bf5ee3f14b76d20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:29:17.719 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 12 12:29:17 smithi038 podman[93043]: 2024-09-12 12:29:17.372160093 +0000 UTC m=+0.698962797 container died 922b64faf39317843c0bf3eaa20bee62dd830b7454da40d3bf5ee3f14b76d20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T12:29:18.142 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T12:29:18.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:18.219 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T12:29:18.219 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T12:29:18.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.1 2024-09-12T12:29:18.514 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:18 smithi071 systemd[1]: Stopping Ceph osd.1 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:19.014 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1[39345]: 2024-09-12T12:29:18.518+0000 7f46a6c29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:19.014 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1[39345]: 2024-09-12T12:29:18.518+0000 7f46a6c29640 -1 osd.1 97 *** Got signal Terminated *** 2024-09-12T12:29:19.014 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1[39345]: 2024-09-12T12:29:18.518+0000 7f46a6c29640 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:29:24.264 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:24 smithi071 podman[68395]: 2024-09-12 12:29:24.011164045 +0000 UTC m=+5.601672822 container died 6100ed415377da1c372cc0bb8e948f0279e4c448a2102ec8416f04dd9dcc1cfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:24.669 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:24 smithi071 podman[68395]: 2024-09-12 12:29:24.39372622 +0000 UTC m=+5.984234996 container cleanup 6100ed415377da1c372cc0bb8e948f0279e4c448a2102ec8416f04dd9dcc1cfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:29:24.670 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:24 smithi071 bash[68395]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1 2024-09-12T12:29:24.976 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:24 smithi071 podman[68410]: 2024-09-12 12:29:24.670390563 +0000 UTC m=+0.660803317 container remove 6100ed415377da1c372cc0bb8e948f0279e4c448a2102ec8416f04dd9dcc1cfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-12T12:29:25.257 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:24 smithi071 podman[68498]: 2024-09-12 12:29:24.879123845 +0000 UTC m=+0.015536595 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:29:25.257 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:24 smithi071 podman[68498]: 2024-09-12 12:29:24.979805883 +0000 UTC m=+0.116218615 container create 30bca9f073947e6e8f3d8b1512569a126ecf0103d4980fe58a11bd4d136e5260 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:29:25.257 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:25 smithi071 podman[68498]: 2024-09-12 12:29:25.165707191 +0000 UTC m=+0.302119942 container init 30bca9f073947e6e8f3d8b1512569a126ecf0103d4980fe58a11bd4d136e5260 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T12:29:25.257 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:25 smithi071 podman[68498]: 2024-09-12 12:29:25.168826579 +0000 UTC m=+0.305239322 container start 30bca9f073947e6e8f3d8b1512569a126ecf0103d4980fe58a11bd4d136e5260 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T12:29:25.257 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:25 smithi071 podman[68498]: 2024-09-12 12:29:25.257256716 +0000 UTC m=+0.393669455 container attach 30bca9f073947e6e8f3d8b1512569a126ecf0103d4980fe58a11bd4d136e5260 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T12:29:25.514 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 12 12:29:25 smithi071 podman[68498]: 2024-09-12 12:29:25.353487209 +0000 UTC m=+0.489899950 container died 30bca9f073947e6e8f3d8b1512569a126ecf0103d4980fe58a11bd4d136e5260 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T12:29:25.921 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T12:29:25.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:25.959 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T12:29:25.959 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T12:29:25.959 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.2 2024-09-12T12:29:26.365 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:26 smithi154 systemd[1]: Stopping Ceph osd.2 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:26.623 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2[40560]: 2024-09-12T12:29:26.363+0000 7f73c2e98640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:26.623 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2[40560]: 2024-09-12T12:29:26.363+0000 7f73c2e98640 -1 osd.2 97 *** Got signal Terminated *** 2024-09-12T12:29:26.624 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2[40560]: 2024-09-12T12:29:26.363+0000 7f73c2e98640 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:29:31.950 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:31 smithi154 podman[69412]: 2024-09-12 12:29:31.685464777 +0000 UTC m=+5.530634762 container died 0fac5331d5f5df53f601a8edc481c605f4dc7c9df7de27cc44c89a09d7c188cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T12:29:32.326 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:32 smithi154 podman[69412]: 2024-09-12 12:29:32.041521271 +0000 UTC m=+5.886691240 container cleanup 0fac5331d5f5df53f601a8edc481c605f4dc7c9df7de27cc44c89a09d7c188cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T12:29:32.326 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:32 smithi154 bash[69412]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2 2024-09-12T12:29:32.626 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:32 smithi154 podman[69442]: 2024-09-12 12:29:32.326332082 +0000 UTC m=+0.631526354 container remove 0fac5331d5f5df53f601a8edc481c605f4dc7c9df7de27cc44c89a09d7c188cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T12:29:32.887 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:32 smithi154 podman[69527]: 2024-09-12 12:29:32.627137318 +0000 UTC m=+0.103370544 container create db1a5c2efea6d3b639fbc3af374258b01ef6dc580f9b3bb8e4bb6f35c5ec3cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:32.888 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:32 smithi154 podman[69527]: 2024-09-12 12:29:32.539915818 +0000 UTC m=+0.016149056 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:29:33.167 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:32 smithi154 podman[69527]: 2024-09-12 12:29:32.888466161 +0000 UTC m=+0.364699386 container init db1a5c2efea6d3b639fbc3af374258b01ef6dc580f9b3bb8e4bb6f35c5ec3cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T12:29:33.167 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:32 smithi154 podman[69527]: 2024-09-12 12:29:32.891908063 +0000 UTC m=+0.368141289 container start db1a5c2efea6d3b639fbc3af374258b01ef6dc580f9b3bb8e4bb6f35c5ec3cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T12:29:33.167 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:33 smithi154 podman[69527]: 2024-09-12 12:29:33.005360255 +0000 UTC m=+0.481593483 container attach db1a5c2efea6d3b639fbc3af374258b01ef6dc580f9b3bb8e4bb6f35c5ec3cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T12:29:33.167 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 12 12:29:33 smithi154 podman[69527]: 2024-09-12 12:29:33.078874203 +0000 UTC m=+0.555107439 container died db1a5c2efea6d3b639fbc3af374258b01ef6dc580f9b3bb8e4bb6f35c5ec3cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:29:33.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T12:29:33.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:33.764 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T12:29:33.764 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T12:29:33.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.3 2024-09-12T12:29:34.197 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:33 smithi038 systemd[1]: Stopping Ceph osd.3 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:34.469 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:34 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:29:34.196+0000 7f4e66a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:34.469 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:34 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:29:34.196+0000 7f4e66a00640 -1 osd.3 97 *** Got signal Terminated *** 2024-09-12T12:29:34.470 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:34 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:29:34.196+0000 7f4e66a00640 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:29:36.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:36 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:36.701+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:36.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:36 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:36.657+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:37.969 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:37 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:29:37.484+0000 7f4e62400640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:15.013566+0000 front 2024-09-12T12:29:15.013602+0000 (oldest deadline 2024-09-12T12:29:37.313693+0000) 2024-09-12T12:29:37.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:37 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:37.694+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:37.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:37 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:37.679+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:38.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:38.028+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:38.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:38 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:38.673+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:38.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:38 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:38.652+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:38.970 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:38 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3[51259]: 2024-09-12T12:29:38.480+0000 7f4e62400640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:15.013566+0000 front 2024-09-12T12:29:15.013602+0000 (oldest deadline 2024-09-12T12:29:37.313693+0000) 2024-09-12T12:29:39.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:39.028+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:39.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:39 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:39.311+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:39.937 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:39 smithi038 podman[93160]: 2024-09-12 12:29:39.625692581 +0000 UTC m=+5.556542929 container died 539f9572bae0b23b4e6c7d968524d025f5bffda2c519caef2e8d40fa90e615e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:39.938 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:39 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:39.699+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:39.938 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:39 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:39.693+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:40.219 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:40 smithi038 podman[93160]: 2024-09-12 12:29:40.14415067 +0000 UTC m=+6.075001024 container cleanup 539f9572bae0b23b4e6c7d968524d025f5bffda2c519caef2e8d40fa90e615e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T12:29:40.219 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:40 smithi038 bash[93160]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3 2024-09-12T12:29:40.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:40.046+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:40.719 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:40 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:40.664+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:40.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:40 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:40.681+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:40.720 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:40 smithi038 podman[93175]: 2024-09-12 12:29:40.445893041 +0000 UTC m=+0.810463846 container remove 539f9572bae0b23b4e6c7d968524d025f5bffda2c519caef2e8d40fa90e615e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:40.763 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:40 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:40.325+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:41.382 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:41 smithi038 podman[93261]: 2024-09-12 12:29:40.988413115 +0000 UTC m=+0.027605717 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:29:41.383 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:41 smithi038 podman[93261]: 2024-09-12 12:29:41.113362325 +0000 UTC m=+0.152554926 container create 6b9ac2c734ccd5858ee5798f187c75de0c0d22b8ae5489c7228610d07fa59a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:41.383 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:41 smithi038 podman[93261]: 2024-09-12 12:29:41.383188329 +0000 UTC m=+0.422380952 container init 6b9ac2c734ccd5858ee5798f187c75de0c0d22b8ae5489c7228610d07fa59a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:41.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:41.013+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:41.661 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:41 smithi038 podman[93261]: 2024-09-12 12:29:41.390074649 +0000 UTC m=+0.429267250 container start 6b9ac2c734ccd5858ee5798f187c75de0c0d22b8ae5489c7228610d07fa59a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T12:29:41.661 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:41 smithi038 podman[93261]: 2024-09-12 12:29:41.482882886 +0000 UTC m=+0.522075497 container attach 6b9ac2c734ccd5858ee5798f187c75de0c0d22b8ae5489c7228610d07fa59a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:41.763 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:41 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:41.307+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:41.969 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 12 12:29:41 smithi038 podman[93261]: 2024-09-12 12:29:41.662054024 +0000 UTC m=+0.701246632 container died 6b9ac2c734ccd5858ee5798f187c75de0c0d22b8ae5489c7228610d07fa59a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T12:29:41.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:41 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:41.698+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:41.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:41 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:41.666+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:42.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:42.048+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:42.466 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T12:29:42.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:42.543 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T12:29:42.543 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T12:29:42.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.4 2024-09-12T12:29:42.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:42 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:42.671+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:42.764 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:42 smithi071 systemd[1]: Stopping Ceph osd.4 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:42.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:42.351+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:43.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:42 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:42.719+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:43.263 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4[45914]: 2024-09-12T12:29:42.879+0000 7f435314f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:43.264 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4[45914]: 2024-09-12T12:29:42.879+0000 7f435314f640 -1 osd.4 97 *** Got signal Terminated *** 2024-09-12T12:29:43.264 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:42 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4[45914]: 2024-09-12T12:29:42.879+0000 7f435314f640 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:29:43.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:43.078+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:43.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:43 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:43.385+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:43.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:43 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:43.750+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:43.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:43 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:43.648+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:44.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:44.075+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:44.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:44 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:44.380+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:44.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:44 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:44.380+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:44.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:44 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:44.649+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:44.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:44 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:44.796+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:44.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:44 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:44.796+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:45.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:45 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:45.040+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:45.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:45 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:45.238+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:45.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:45 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:45.352+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:45.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:45 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:45.352+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:45.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:45 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:45.616+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:45.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:45 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:45.806+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:45.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:45 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:45.806+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:46.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:46 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:46.033+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:46.417 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:46 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:46.246+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:46.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:46 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:46.205+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:46.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:46 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:46.320+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:46.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:46 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:46.320+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:46.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:46 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:46.650+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:46.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:46 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:46.833+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:46.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:46 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:46.833+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:47.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:47.036+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:47.417 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:47.255+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:47.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:47 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:47.228+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:47.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:47.159+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:47.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:47.368+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:47.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:47 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:47.368+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:47.866 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:47.606+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:48.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:47.866+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:48.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:47.866+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:48.416 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:48 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:48.278+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:48.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:48 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:48.230+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:48.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:48 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:48.073+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:48.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:48 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:48.181+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:48.514 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:48 smithi071 podman[68614]: 2024-09-12 12:29:48.259643632 +0000 UTC m=+5.518781387 container died 046fdf677f017be3ae5554aa63099c09bd08dc98979b0aba55e6d12e08416b85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:29:48.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:48 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:48.397+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:48.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:48 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:48.397+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:48.880 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:48 smithi071 podman[68614]: 2024-09-12 12:29:48.670595127 +0000 UTC m=+5.929732881 container cleanup 046fdf677f017be3ae5554aa63099c09bd08dc98979b0aba55e6d12e08416b85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T12:29:48.880 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:48 smithi071 bash[68614]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4 2024-09-12T12:29:48.897 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:48.637+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:48.898 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:48.637+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:49.139 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:48 smithi071 podman[68630]: 2024-09-12 12:29:48.880203439 +0000 UTC m=+0.620841877 container remove 046fdf677f017be3ae5554aa63099c09bd08dc98979b0aba55e6d12e08416b85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T12:29:49.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:48.897+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:49.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:48 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:48.897+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:49.403 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:49 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:49.138+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:49.403 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:49 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:49.385+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:49.403 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:49 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:49.385+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:49.404 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:49 smithi071 podman[68718]: 2024-09-12 12:29:49.189357248 +0000 UTC m=+0.016320849 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:29:49.404 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:49 smithi071 podman[68718]: 2024-09-12 12:29:49.29779591 +0000 UTC m=+0.124759501 container create 77e89490af3492a3bd945db3581518d84178770d959652cdf1a91054e71dc501 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T12:29:49.416 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:49 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:49.254+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:49.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:49 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:49.278+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:49.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:49 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:49.030+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:49.737 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:49 smithi071 podman[68718]: 2024-09-12 12:29:49.54221502 +0000 UTC m=+0.369178607 container init 77e89490af3492a3bd945db3581518d84178770d959652cdf1a91054e71dc501 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:49.737 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:49 smithi071 podman[68718]: 2024-09-12 12:29:49.545598026 +0000 UTC m=+0.372561625 container start 77e89490af3492a3bd945db3581518d84178770d959652cdf1a91054e71dc501 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T12:29:49.737 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:49 smithi071 podman[68718]: 2024-09-12 12:29:49.617023872 +0000 UTC m=+0.443987481 container attach 77e89490af3492a3bd945db3581518d84178770d959652cdf1a91054e71dc501 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T12:29:49.973 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:49.857+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:49.973 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:49.857+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:49.973 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:49.642+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:49.973 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:49 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:49.642+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:50.014 INFO:journalctl@ceph.osd.4.smithi071.stdout:Sep 12 12:29:49 smithi071 podman[68718]: 2024-09-12 12:29:49.737971583 +0000 UTC m=+0.564935175 container died 77e89490af3492a3bd945db3581518d84178770d959652cdf1a91054e71dc501 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:50.303 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:50 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:50.119+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:50.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T12:29:50.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:50.363 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T12:29:50.363 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T12:29:50.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.5 2024-09-12T12:29:50.391 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:50 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:50.301+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:50.392 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:50 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:50.072+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:50.392 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:50 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:50.290+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:50.666 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:50 smithi154 systemd[1]: Stopping Ceph osd.5 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:50.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:50 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:50.370+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:50.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:50 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:50.370+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:50.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:50 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:50.876+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:50.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:50 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:50.876+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:50.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:50 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:50.640+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:50.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:50 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:50.640+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:51.040 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:50 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:50.687+0000 7f0f3f5b4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:51.040 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:50 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:50.687+0000 7f0f3f5b4640 -1 osd.5 97 *** Got signal Terminated *** 2024-09-12T12:29:51.040 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:50 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:50.687+0000 7f0f3f5b4640 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:29:51.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:51 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:51.040+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:51.417 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:51 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:51.243+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:51.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:51 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:51.281+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:51.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:51 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:51.140+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:51.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:51 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:51.374+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:51.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:51 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:51.374+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:51.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:51.860+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:51.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:51.860+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:51.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:51.641+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:51.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:51 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:51.641+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:52.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:52 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:52.318+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:52.417 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:52 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:52.238+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:52.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:52 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:52.071+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:52.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:52 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:52.153+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:52.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:52 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:52.372+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:52.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:52 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:52.372+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:52.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:52.843+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:52.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:52.843+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:52.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:52.658+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:52.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:52.658+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:52.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:52.658+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:53.395 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:53 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:53.119+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:53.395 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:53 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:53.119+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:29:53.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:53 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:53.279+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:53.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:53 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:53.038+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:53.417 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:53 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:53.275+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:53.418 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:53 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:53.275+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.914080+0000 front 2024-09-12T12:29:30.914149+0000 (oldest deadline 2024-09-12T12:29:52.614295+0000) 2024-09-12T12:29:53.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:53 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:53.394+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:53.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:53 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:53.394+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:53.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:53 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:53.394+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:29:53.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:53.817+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:53.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:53.817+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:53.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:53.639+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:53.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:53.639+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:53.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:53 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:53.639+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:54.283 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:54 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:54.016+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:54.437 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:54 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:54.086+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:54.437 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:54 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:54.086+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:29:54.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:54 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:54.284+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:54.667 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:54 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:54.319+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:54.667 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:54 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:54.319+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.914080+0000 front 2024-09-12T12:29:30.914149+0000 (oldest deadline 2024-09-12T12:29:52.614295+0000) 2024-09-12T12:29:54.706 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:54 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:54.436+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:54.706 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:54 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:54.436+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:54.706 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:54 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:54.436+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:29:54.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:54 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:54.798+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:55.018 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:54 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:54.798+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:55.018 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:54 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:54.798+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:29:55.018 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:54 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:54.623+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:55.018 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:54 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:54.623+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:55.018 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:54 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:54.623+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:55.353 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:55.030+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:55.354 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:55.274+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:55.354 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:55.274+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:29:55.393 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:55 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:55.082+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:55.393 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:55 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:55.082+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:29:55.654 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:55 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:55.391+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:55.654 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:55 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:55.391+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:55.654 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:55 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:55.391+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:29:55.667 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:55.352+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:22.713023+0000 front 2024-09-12T12:29:22.713007+0000 (oldest deadline 2024-09-12T12:29:45.613078+0000) 2024-09-12T12:29:55.667 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5[46998]: 2024-09-12T12:29:55.352+0000 7f0f37bc2640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.914080+0000 front 2024-09-12T12:29:30.914149+0000 (oldest deadline 2024-09-12T12:29:52.614295+0000) 2024-09-12T12:29:55.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:55 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:55.769+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:55.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:55 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:55.769+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:55.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:55 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:55.769+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:29:55.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:55 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:55.598+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:55.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:55 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:55.598+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:55.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:55 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:55.598+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:56.264 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:56 smithi154 podman[69631]: 2024-09-12 12:29:56.199509212 +0000 UTC m=+5.636928082 container died 7d8d38db66260ecca84f672c3eb44314a7e0753b891e255ce38292a274ff1213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:56.265 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:55 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:55.996+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:56.430 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:56 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:56.093+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:56.430 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:56 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:56.093+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:29:56.532 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:56 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:56.264+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:56.532 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:56 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:56.264+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:29:56.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:56 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:56.429+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:56.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:56 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:56.429+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:56.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:56 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:56.429+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:56 smithi154 podman[69631]: 2024-09-12 12:29:56.555656 +0000 UTC m=+5.993074872 container cleanup 7d8d38db66260ecca84f672c3eb44314a7e0753b891e255ce38292a274ff1213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:56 smithi154 bash[69631]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5 2024-09-12T12:29:56.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:56 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:56.746+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:56.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:56 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:56.746+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:56.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:56 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:56.746+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:29:56.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:56 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:56.582+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:56.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:56 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:56.582+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:56.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:56 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:56.582+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:57.166 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:56 smithi154 podman[69646]: 2024-09-12 12:29:56.872450188 +0000 UTC m=+0.674702262 container remove 7d8d38db66260ecca84f672c3eb44314a7e0753b891e255ce38292a274ff1213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:29:57.167 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:56 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:56.957+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:57.167 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:56 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:56.957+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:29:57.416 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:57 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:57.092+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:57.416 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:57 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:57.092+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:29:57.509 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:57 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:57.311+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:57.509 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:57 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:57.311+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:29:57.510 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:57 smithi154 podman[69742]: 2024-09-12 12:29:57.152063697 +0000 UTC m=+0.022587423 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:29:57.510 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:57 smithi154 podman[69742]: 2024-09-12 12:29:57.273474488 +0000 UTC m=+0.143998206 container create bbdb3fcc6fac88f3a950a777d34d1bf57f059c27c3f9bc77db1fee011c917dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T12:29:57.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:57 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:57.416+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:57.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:57 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:57.416+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:57.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:57 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:57.416+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:29:57.917 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:57 smithi154 podman[69742]: 2024-09-12 12:29:57.509361228 +0000 UTC m=+0.379884944 container init bbdb3fcc6fac88f3a950a777d34d1bf57f059c27c3f9bc77db1fee011c917dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:57.917 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:57 smithi154 podman[69742]: 2024-09-12 12:29:57.513967952 +0000 UTC m=+0.384491677 container start bbdb3fcc6fac88f3a950a777d34d1bf57f059c27c3f9bc77db1fee011c917dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T12:29:57.917 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:57 smithi154 podman[69742]: 2024-09-12 12:29:57.618195603 +0000 UTC m=+0.488719333 container attach bbdb3fcc6fac88f3a950a777d34d1bf57f059c27c3f9bc77db1fee011c917dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T12:29:57.917 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 12 12:29:57 smithi154 podman[69742]: 2024-09-12 12:29:57.706113449 +0000 UTC m=+0.576637177 container died bbdb3fcc6fac88f3a950a777d34d1bf57f059c27c3f9bc77db1fee011c917dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T12:29:57.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:57.792+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:57.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:57.792+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:57.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:57.792+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:29:57.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:57.595+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:57.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:57.595+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:57.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:57.595+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:58.283 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:57 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:57.982+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:58.283 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:57 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:57.982+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:29:58.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T12:29:58.437 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:58.437 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T12:29:58.437 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T12:29:58.438 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.6 2024-09-12T12:29:58.451 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:58 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:58.066+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:58.451 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:58 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:58.066+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:29:58.666 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:58 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:58.282+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:58.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:58 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:58.282+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:29:58.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:58 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:58.450+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:58.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:58 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:58.450+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:58.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:58 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:58.450+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:29:58.771 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:58.598+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:58.771 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:58.598+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:58.771 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:58.598+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:58.771 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:58 smithi038 systemd[1]: Stopping Ceph osd.6 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:29:58.771 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:58.770+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:58.771 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:58.770+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:59.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:58.770+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:29:59.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:58.867+0000 7f4028e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:59.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:58.867+0000 7f4028e00640 -1 osd.6 97 *** Got signal Terminated *** 2024-09-12T12:29:59.220 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:58 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:58.867+0000 7f4028e00640 -1 osd.6 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:29:59.267 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:59 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:59.012+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:29:59.267 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:29:59 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:29:59.012+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:29:59.491 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:59 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:59.048+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:29:59.492 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:29:59 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:29:59.048+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:29:59.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:59 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:59.265+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:29:59.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:29:59 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:29:59.266+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:29:59.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:59 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:59.490+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:29:59.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:59 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:59.490+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:29:59.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:29:59 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:29:59.490+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:29:59.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:59.631+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:29:59.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:59.631+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:29:59.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:29:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:29:59.631+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:29:59.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:59.730+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:29:59.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:59.730+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:29:59.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:29:59 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:29:59.730+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:30:00.311 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:00 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:00.040+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:00.311 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:00 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:00.040+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:00.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:00 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:00.096+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:00.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:00 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:00.096+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:00.666 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:00 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:00.311+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:00.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:00 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:00.311+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:00.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:00 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:00.311+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:00.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:00.734+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:30:00.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:00.734+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:30:00.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:00.734+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:30:00.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:00.664+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:00.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:00.664+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:00.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:00 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:00.664+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:01.014 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:00 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:00.513+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:01.014 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:00 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:00.513+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:01.014 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:00 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:00.513+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:01.310 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:01 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:01.046+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:01.311 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:01 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:01.046+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:01.512 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:01 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:01.054+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:01.512 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:01 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:01.054+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:01.666 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:01 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:01.309+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:01.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:01 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:01.309+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:01.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:01 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:01.309+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:01.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:01 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:01.511+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:01.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:01 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:01.511+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:01.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:01 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:01.511+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:01.893 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:01.748+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:30:01.893 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:01.748+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:30:01.893 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:01.748+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:30:01.893 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:01.621+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:01.893 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:01.621+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:01.894 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:01.621+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:02.345 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:02 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:02.039+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:02.345 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:02 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:02.039+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:02.345 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:02 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:02.039+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:02.464 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:02 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:02.052+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:02.464 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:02 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:02.052+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:02.666 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:02 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:02.345+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:02.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:02 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:02.345+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:02.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:02 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:02.345+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:02.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:02 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:02.464+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:02.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:02 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:02.464+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:02.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:02 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:02.464+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:02.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:02.728+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:30:02.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:02.728+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:30:02.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:02.728+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:30:02.970 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:02.728+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.283682+0000 front 2024-09-12T12:29:36.283768+0000 (oldest deadline 2024-09-12T12:30:02.183842+0000) 2024-09-12T12:30:02.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:02.606+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:02.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:02.606+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:02.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:02 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:02.606+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:03.385 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:03 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:03.074+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:03.385 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:03 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:03.074+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:03.385 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:03 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:03.074+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:03.460 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:03 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:03.028+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:03.460 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:03 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:03.028+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:03.460 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:03 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:03.028+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:03.666 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:03 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:03.385+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:03.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:03 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:03.385+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:03.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:03 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:03.385+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:03.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:03.582+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:03.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:03.582+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:03.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:03.582+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:03.763 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:03 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:03.460+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:03.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:03 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:03.460+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:03.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:03 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:03.460+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:04.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:03.749+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:10.175528+0000 front 2024-09-12T12:29:10.175712+0000 (oldest deadline 2024-09-12T12:29:36.075611+0000) 2024-09-12T12:30:04.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:03.749+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:20.080905+0000 front 2024-09-12T12:29:20.080853+0000 (oldest deadline 2024-09-12T12:29:44.780557+0000) 2024-09-12T12:30:04.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:03.749+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:28.781988+0000 front 2024-09-12T12:29:28.782008+0000 (oldest deadline 2024-09-12T12:29:54.082058+0000) 2024-09-12T12:30:04.220 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:03 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6[57746]: 2024-09-12T12:30:03.749+0000 7f401f800640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.283682+0000 front 2024-09-12T12:29:36.283768+0000 (oldest deadline 2024-09-12T12:30:02.183842+0000) 2024-09-12T12:30:04.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:04.069+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:04.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:04.069+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:04.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:04.069+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:04.438 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:04.037+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:04.438 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:04.037+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:04.438 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:04.037+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:04.633 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:04 smithi038 podman[93367]: 2024-09-12 12:30:04.311413459 +0000 UTC m=+5.576766354 container died 8e32b4c47c5d498ec9ce32cf6bbbe804ca90af6bb1f8a8fb86c83347c3f6cb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T12:30:04.633 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:04 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:04.542+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:04.633 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:04 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:04.542+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:04.633 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:04 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:04.542+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:04.633 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:04 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:04.542+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:04.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:04.438+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:04.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:04.438+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:04.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:04.438+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:04.916 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:04.430+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:04.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:04.430+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:04.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:04 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:04.430+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:04.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:04 smithi038 podman[93367]: 2024-09-12 12:30:04.840517844 +0000 UTC m=+6.105870729 container cleanup 8e32b4c47c5d498ec9ce32cf6bbbe804ca90af6bb1f8a8fb86c83347c3f6cb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T12:30:04.969 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:04 smithi038 bash[93367]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6 2024-09-12T12:30:05.396 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:05 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:05.396+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:05.397 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:05 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:05.396+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:05.397 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:05 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:05.396+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:05.397 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:05 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:05.035+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:05.397 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:05 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:05.035+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:05.397 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:05 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:05.035+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:05.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:05 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:05.107+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:05.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:05 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:05.107+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:05.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:05 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:05.107+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:05.469 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:05 smithi038 podman[93397]: 2024-09-12 12:30:05.100333753 +0000 UTC m=+0.776223143 container remove 8e32b4c47c5d498ec9ce32cf6bbbe804ca90af6bb1f8a8fb86c83347c3f6cb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T12:30:05.728 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:05 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:05.396+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:05.822 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:05 smithi038 podman[93483]: 2024-09-12 12:30:05.57587795 +0000 UTC m=+0.027212125 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:30:05.823 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:05 smithi038 podman[93483]: 2024-09-12 12:30:05.684639022 +0000 UTC m=+0.135973196 container create d6f7c8b453acb5474c4aad58cbb989e58e941da8ee332cd381a1e8e3245f7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T12:30:05.823 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:05.531+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:05.823 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:05.531+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:05.823 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:05.531+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:05.823 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:05 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:05.531+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:05.916 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:05 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:05.423+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:05.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:05 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:05.423+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:05.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:05 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:05.423+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:06.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:05 smithi038 podman[93483]: 2024-09-12 12:30:05.971343446 +0000 UTC m=+0.422677631 container init d6f7c8b453acb5474c4aad58cbb989e58e941da8ee332cd381a1e8e3245f7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T12:30:06.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:05 smithi038 podman[93483]: 2024-09-12 12:30:05.978052587 +0000 UTC m=+0.429386770 container start d6f7c8b453acb5474c4aad58cbb989e58e941da8ee332cd381a1e8e3245f7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T12:30:06.219 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:06 smithi038 podman[93483]: 2024-09-12 12:30:06.062684924 +0000 UTC m=+0.514019134 container attach d6f7c8b453acb5474c4aad58cbb989e58e941da8ee332cd381a1e8e3245f7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:30:06.350 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:06 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:06.020+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:06.350 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:06 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:06.020+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:06.351 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:06 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:06.020+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:06.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:06 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:06.157+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:06.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:06 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:06.157+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:06.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:06 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:06.157+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:06.623 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 12 12:30:06 smithi038 podman[93483]: 2024-09-12 12:30:06.244882189 +0000 UTC m=+0.696216364 container died d6f7c8b453acb5474c4aad58cbb989e58e941da8ee332cd381a1e8e3245f7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T12:30:06.624 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:06 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:06.491+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:06.624 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:06 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:06.491+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:06.624 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:06 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:06.491+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:06.624 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:06 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:06.491+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:06.763 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:06 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:06.350+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:06.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:06 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:06.350+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:06.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:06 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:06.350+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:06.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:06 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:06.350+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:06.916 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:06 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:06.423+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:06.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:06 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:06.423+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:06.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:06 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:06.423+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:07.107 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T12:30:07.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:07.184 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T12:30:07.184 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T12:30:07.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.7 2024-09-12T12:30:07.398 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:07.028+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:07.398 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:07.028+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:07.398 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:07.028+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:07.398 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:07 smithi071 systemd[1]: Stopping Ceph osd.7 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:07.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:07 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:07.121+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:07.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:07 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:07.121+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:07.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:07 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:07.121+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:07.764 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:07.496+0000 7fe697ebd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:07.764 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:07.496+0000 7fe697ebd640 -1 osd.7 97 *** Got signal Terminated *** 2024-09-12T12:30:07.764 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:07.496+0000 7fe697ebd640 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:30:07.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:07.397+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:07.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:07.397+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:07.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:07.397+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:07.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:07 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:07.397+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:07.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:07 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:07.452+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:07.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:07 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:07.452+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:07.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:07 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:07.452+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:07.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:07.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:07.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:07.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:07.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:07.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:07.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:07 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:07.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:08.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:08.009+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:08.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:08.009+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:08.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:08.009+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:08.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:08.112+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:08.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:08.112+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:08.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:08.112+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:08.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:08.428+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:08.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:08.428+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:08.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:08.428+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:08.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:08.428+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:08.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:08.426+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:08.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:08.426+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:08.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:08.426+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:08.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:08 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:08.426+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:08.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:08 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:08.472+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:08.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:08 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:08.472+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:08.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:08 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:08.472+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:08.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:08 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:08.472+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:09.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:08.984+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:09.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:08.984+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:09.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:08 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:08.984+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:09.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:09 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:09.076+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:09.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:09 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:09.076+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:09.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:09 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:09.076+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:09.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:09 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:09.411+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:09.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:09 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:09.411+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:09.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:09 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:09.411+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:09.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:09 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:09.411+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:09.916 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:09 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:09.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:09.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:09 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:09.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:09.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:09 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:09.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:09.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:09 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:09.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:09.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:09 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:09.475+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:09.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:09 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:09.475+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:09.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:09 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:09.475+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:09.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:09 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:09.475+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:10.382 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:10 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:10.034+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:10.382 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:10 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:10.034+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:10.382 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:10 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:10.034+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:10.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:10.073+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:10.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:10.073+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:10.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:10.073+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:10.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:10.073+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:10.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:10 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:10.381+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:10.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:10 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:10.381+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:10.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:10 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:10.381+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:10.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:10 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:10.381+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:10.916 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:10.463+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:10.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:10.463+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:10.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:10.463+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:10.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:10 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:10.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:10.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:10.508+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:10.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:10.508+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:10.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:10.508+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:10.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:10.508+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:10.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:10 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:10.508+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:11.357 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:11.068+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:11.358 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:11.068+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:11.358 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:11.068+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:11.358 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:11.068+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.522164+0000 front 2024-09-12T12:29:47.522143+0000 (oldest deadline 2024-09-12T12:30:11.022289+0000) 2024-09-12T12:30:11.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:11.100+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:11.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:11.100+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:11.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:11.100+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:11.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:11.100+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:11.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:11.357+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:11.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:11.357+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:11.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:11.357+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:11.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:11 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:11.357+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:11.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:11.505+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:11.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:11.505+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:11.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:11.505+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:11.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:11 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:11.505+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:11.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:11 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:11.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:11.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:11 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:11.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:11.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:11 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:11.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:11.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:11 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:11.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:11.970 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:11 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:11.490+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:12.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:12.088+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:12.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:12.088+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:12.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:12.088+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:12.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:12.088+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:12.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:12.106+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:18.417702+0000 front 2024-09-12T12:29:18.417725+0000 (oldest deadline 2024-09-12T12:29:44.317873+0000) 2024-09-12T12:30:12.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:12.106+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.219812+0000 front 2024-09-12T12:29:31.219865+0000 (oldest deadline 2024-09-12T12:29:52.919887+0000) 2024-09-12T12:30:12.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:12.106+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.821079+0000 front 2024-09-12T12:29:38.820923+0000 (oldest deadline 2024-09-12T12:30:02.320711+0000) 2024-09-12T12:30:12.514 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7[52863]: 2024-09-12T12:30:12.106+0000 7fe6904cb640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.522164+0000 front 2024-09-12T12:29:47.522143+0000 (oldest deadline 2024-09-12T12:30:11.022289+0000) 2024-09-12T12:30:12.515 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:12.338+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:12.515 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:12.338+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:12.515 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:12.338+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:12.515 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:12.338+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:12.515 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:12.338+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:12.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:12 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:12.457+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:12.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:12 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:12.457+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:12.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:12 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:12.457+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:12.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:12 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:12.457+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:12.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:12 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:12.457+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:12.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:12.470+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:12.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:12.470+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:12.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:12.470+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:12.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:12 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:12.470+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:13.318 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:13 smithi071 podman[68832]: 2024-09-12 12:30:13.025406906 +0000 UTC m=+5.643181299 container died 57c49d82d9baa68f5151d6160dff310228a18dd959f5f77e85a24496e26e6ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T12:30:13.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:13.074+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:13.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:13.074+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:13.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:13.074+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:13.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:13.074+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:13.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:13 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:13.421+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:13.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:13 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:13.421+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:13.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:13 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:13.421+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:13.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:13 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:13.421+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:13.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:13 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:13.421+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:13 smithi071 podman[68832]: 2024-09-12 12:30:13.350284742 +0000 UTC m=+5.968059131 container cleanup 57c49d82d9baa68f5151d6160dff310228a18dd959f5f77e85a24496e26e6ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:13 smithi071 bash[68832]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:13 smithi071 podman[68848]: 2024-09-12 12:30:13.564281828 +0000 UTC m=+0.536462211 container remove 57c49d82d9baa68f5151d6160dff310228a18dd959f5f77e85a24496e26e6ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:13 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:13.317+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:13 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:13.317+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:13 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:13.317+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:13 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:13.317+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:13.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:13 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:13.317+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:13.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:13.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:13.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:13.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:13.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:13.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:13.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:13 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:13.464+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:14.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:13 smithi071 podman[68935]: 2024-09-12 12:30:13.86788702 +0000 UTC m=+0.015866885 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:30:14.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:13 smithi071 podman[68935]: 2024-09-12 12:30:13.990017465 +0000 UTC m=+0.137997320 container create 405cb13e5cfcb9259d8f5c94e8af094afae2768fd8dcd32d91134e522723215c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-12T12:30:14.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:14 smithi071 podman[68935]: 2024-09-12 12:30:14.192183941 +0000 UTC m=+0.340163797 container init 405cb13e5cfcb9259d8f5c94e8af094afae2768fd8dcd32d91134e522723215c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T12:30:14.264 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:14 smithi071 podman[68935]: 2024-09-12 12:30:14.195384787 +0000 UTC m=+0.343364650 container start 405cb13e5cfcb9259d8f5c94e8af094afae2768fd8dcd32d91134e522723215c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T12:30:14.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:14.118+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:14.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:14.118+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:14.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:14.118+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:14.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:14.118+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:14.661 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:14 smithi071 podman[68935]: 2024-09-12 12:30:14.284172833 +0000 UTC m=+0.432152702 container attach 405cb13e5cfcb9259d8f5c94e8af094afae2768fd8dcd32d91134e522723215c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T12:30:14.661 INFO:journalctl@ceph.osd.7.smithi071.stdout:Sep 12 12:30:14 smithi071 podman[68935]: 2024-09-12 12:30:14.37806366 +0000 UTC m=+0.526043526 container died 405cb13e5cfcb9259d8f5c94e8af094afae2768fd8dcd32d91134e522723215c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T12:30:14.661 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:14 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:14.271+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:14.661 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:14 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:14.271+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:14.662 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:14 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:14.271+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:14.662 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:14 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:14.271+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:14.662 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:14 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:14.271+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:14.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:14 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:14.411+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:14.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:14 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:14.411+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:14.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:14 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:14.411+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:14.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:14 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:14.411+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:14.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:14 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:14.411+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:14.916 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:14.460+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:14.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:14.460+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:14.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:14.460+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:14.917 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:14 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:14.460+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:14.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T12:30:15.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:15.002 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T12:30:15.002 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T12:30:15.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.8 2024-09-12T12:30:15.316 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 systemd[1]: Stopping Ceph osd.8 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:15.316 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:15.148+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:15.316 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:15.148+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:15.317 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:15.148+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:15.317 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:15.148+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:15.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:15 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:15.312+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:15.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:15 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:15.312+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:15.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:15 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:15.312+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:15.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:15 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:15.312+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:15.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:15 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:15.312+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:15.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:15.315+0000 7f796b963640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:15.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:15.315+0000 7f796b963640 -1 osd.8 97 *** Got signal Terminated *** 2024-09-12T12:30:15.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:15.315+0000 7f796b963640 -1 osd.8 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:30:15.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:15.438+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:15.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:15.438+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:15.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:15.438+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:15.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:15 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:15.438+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:15.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:15 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:15.408+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:15.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:15 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:15.408+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:15.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:15 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:15.408+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:15.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:15 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:15.408+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:15.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:15 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:15.408+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:16.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:16 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:16.305+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:16.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:16 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:16.305+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:16.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:16 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:16.305+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:16.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:16 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:16.305+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:16.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:16 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:16.305+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:16.412+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:16.412+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:16.412+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:16.412+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:16.181+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:16.181+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:16.181+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:16.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:16 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:16.181+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:16.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:16 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:16.390+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:16.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:16 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:16.390+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:16.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:16 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:16.390+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:16.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:16 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:16.390+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:16.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:16 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:16.390+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:17.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:17.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:17.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:17.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:17.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:17.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:17.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:17.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:17.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:17.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:17.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:17.382+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:17.418 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:17.382+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:17.418 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:17.382+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:17.418 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:17 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:17.382+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:17.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:17 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:17.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:17.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:17 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:17.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:17.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:17 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:17.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:17.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:17 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:17.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:17.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:17 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:17.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:17.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:17 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:17.376+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:17.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:17 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:17.376+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:17.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:17 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:17.376+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:17.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:17 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:17.376+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:17.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:17 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:17.376+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:17.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:17 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:17.376+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:18.381 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:18.094+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:18.381 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:18.094+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:18.381 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:18.094+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:18.382 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:18.094+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:18.382 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:18.094+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:18.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:18.246+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:18.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:18.246+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:18.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:18.246+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:18.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:18.246+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:18.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:18 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:18.246+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:18.666 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:18.381+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:18.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:18.381+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:18.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:18.381+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:18.667 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:18 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:18.381+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:18.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:18 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:18.345+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:18.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:18 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:18.345+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:18.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:18 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:18.345+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:18.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:18 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:18.345+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:18.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:18 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:18.345+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:18.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:18 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:18.345+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:19.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:19.133+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:19.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:19.133+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:19.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:19.133+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:19.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:19.133+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:19.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:19.133+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:19.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:19.373+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:23.024910+0000 front 2024-09-12T12:29:23.024825+0000 (oldest deadline 2024-09-12T12:29:46.524787+0000) 2024-09-12T12:30:19.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:19.373+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:31.026443+0000 front 2024-09-12T12:29:31.026415+0000 (oldest deadline 2024-09-12T12:29:55.126636+0000) 2024-09-12T12:30:19.418 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:19.373+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:36.827893+0000 front 2024-09-12T12:29:36.827651+0000 (oldest deadline 2024-09-12T12:29:59.727660+0000) 2024-09-12T12:30:19.418 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:19 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8[53787]: 2024-09-12T12:30:19.373+0000 7f7967f79640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:44.229442+0000 front 2024-09-12T12:29:44.229295+0000 (oldest deadline 2024-09-12T12:30:08.329194+0000) 2024-09-12T12:30:19.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:19 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:19.257+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:19.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:19 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:19.257+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:19.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:19 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:19.257+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:19.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:19 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:19.257+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:19.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:19 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:19.257+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:19.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:19 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:19.379+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:19.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:19 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:19.379+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:19.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:19 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:19.379+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:19.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:19 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:19.379+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:19.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:19 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:19.379+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:19.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:19 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:19.379+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:20.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:20 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:20.146+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:20.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:20 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:20.146+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:20.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:20 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:20.146+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:20.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:20 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:20.146+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:20.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:20 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:20.146+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:20.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:20 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:20.418+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:20.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:20 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:20.418+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:20.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:20 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:20.418+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:20.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:20 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:20.418+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:20.721 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:20 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:20.418+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:20.721 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:20 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:20.418+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:20.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:20 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:20.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:20.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:20 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:20.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:20.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:20 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:20.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:20.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:20 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:20.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:20.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:20 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:20.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:20.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:20 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:20.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:21.000 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:20 smithi154 podman[69847]: 2024-09-12 12:30:20.697940077 +0000 UTC m=+5.498237044 container died 03ade64f43df6785357b711e753990baae60bafc69c724884314b14a5acac2de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T12:30:21.292 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:21 smithi154 podman[69847]: 2024-09-12 12:30:21.099474576 +0000 UTC m=+5.899771543 container cleanup 03ade64f43df6785357b711e753990baae60bafc69c724884314b14a5acac2de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T12:30:21.292 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:21 smithi154 bash[69847]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8 2024-09-12T12:30:21.292 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:21 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:21.186+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:21.292 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:21 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:21.186+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:21.292 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:21 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:21.186+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:21.292 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:21 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:21.186+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:21.292 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:21 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:21.186+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:21.666 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:21 smithi154 podman[69862]: 2024-09-12 12:30:21.29251896 +0000 UTC m=+0.587058631 container remove 03ade64f43df6785357b711e753990baae60bafc69c724884314b14a5acac2de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T12:30:21.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:21 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:21.377+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:21.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:21 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:21.377+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:21.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:21 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:21.377+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:21.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:21 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:21.377+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:21.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:21 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:21.377+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:21.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:21 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:21.377+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:21.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:21 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:21.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:21.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:21 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:21.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:21.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:21 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:21.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:21.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:21 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:21.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:21.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:21 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:21.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:21.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:21 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:21.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:21.978 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:21 smithi154 podman[69952]: 2024-09-12 12:30:21.615224126 +0000 UTC m=+0.015699639 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:30:21.978 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:21 smithi154 podman[69952]: 2024-09-12 12:30:21.734906185 +0000 UTC m=+0.135381691 container create 98bc9bf33d343780c3aa2c2cc9d5599681a967fb1370338663f06880097a7c79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T12:30:21.978 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:21 smithi154 podman[69952]: 2024-09-12 12:30:21.97912887 +0000 UTC m=+0.379604384 container init 98bc9bf33d343780c3aa2c2cc9d5599681a967fb1370338663f06880097a7c79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:21 smithi154 podman[69952]: 2024-09-12 12:30:21.982543901 +0000 UTC m=+0.383019405 container start 98bc9bf33d343780c3aa2c2cc9d5599681a967fb1370338663f06880097a7c79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:22 smithi154 podman[69952]: 2024-09-12 12:30:22.062541294 +0000 UTC m=+0.463016817 container attach 98bc9bf33d343780c3aa2c2cc9d5599681a967fb1370338663f06880097a7c79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 12 12:30:22 smithi154 podman[69952]: 2024-09-12 12:30:22.172047901 +0000 UTC m=+0.572523420 container died 98bc9bf33d343780c3aa2c2cc9d5599681a967fb1370338663f06880097a7c79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:22 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:22.175+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:22 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:22.175+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:22 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:22.175+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:22 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:22.175+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:22.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:22 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:22.175+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:22.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:22 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:22.247+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:22.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:22 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:22.247+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:22.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:22 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:22.247+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:22.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:22 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:22.247+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:22.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:22 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:22.247+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:22.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:22 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:22.247+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:22.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:22 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:22.391+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:22.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:22 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:22.391+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:22.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:22 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:22.391+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:22.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:22 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:22.391+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:22.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:22 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:22.391+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:22.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:22 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:22.391+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:22.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T12:30:22.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:22.834 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T12:30:22.834 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T12:30:22.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.9 2024-09-12T12:30:23.219 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:22 smithi038 systemd[1]: Stopping Ceph osd.9 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:23.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:23 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:23.152+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:23.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:23 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:23.152+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:23.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:23 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:23.152+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:23.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:23 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:23.152+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:23.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:23 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:23.152+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.255+0000 7fca9ce00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.255+0000 7fca9ce00640 -1 osd.9 97 *** Got signal Terminated *** 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.255+0000 7fca9ce00640 -1 osd.9 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.346+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.346+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.346+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.346+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.346+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:23.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:23 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:23.346+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:23.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:23 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:23.270+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:23.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:23 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:23.270+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:23.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:23 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:23.270+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:23.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:23 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:23.270+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:23.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:23 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:23.270+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:23.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:23 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:23.270+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:24.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:24 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:24.122+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:24.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:24 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:24.122+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:24.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:24 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:24.122+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:24.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:24 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:24.122+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:24.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:24 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:24.122+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:24.665 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:24 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:24.309+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:24.665 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:24 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:24.309+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:24.665 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:24 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:24.309+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:24.665 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:24 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:24.309+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:24.665 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:24 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:24.309+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:24.666 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:24 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:24.309+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:24.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:24.325+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:24.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:24.325+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:24.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:24.325+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:24.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:24.325+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:24.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:24.325+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:24.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:24 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:24.325+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:25.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:25 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:25.091+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:25.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:25 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:25.091+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:25.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:25 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:25.091+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:25.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:25 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:25.091+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:25.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:25 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:25.091+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:25.710 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:25 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:25.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:25.711 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:25 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:25.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:25.711 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:25 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:25.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:25.711 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:25 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:25.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:25.711 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:25 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:25.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:25.711 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:25 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:25.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:25.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:25 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:25.328+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:25.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:25 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:25.328+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:25.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:25 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:25.328+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:25.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:25 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:25.328+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:25.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:25 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:25.328+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:25.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:25 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:25.328+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:26.340 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:26.082+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:26.340 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:26.082+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:26.340 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:26.082+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:26.340 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:26.082+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:26.340 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:26.082+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:26.340 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:26 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:26.082+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:26.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:26 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:26.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:26.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:26 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:26.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:26.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:26 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:26.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:26.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:26 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:26.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:26.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:26 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:26.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:26.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:26 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:26.265+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:26.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:26 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:26.338+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:26.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:26 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:26.338+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:26.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:26 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:26.338+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:26.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:26 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:26.338+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:26.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:26 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:26.338+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:26.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:26 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:26.338+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:27.416 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:27 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:27.093+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:27.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:27 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:27.093+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:27.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:27 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:27.093+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:27.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:27 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:27.093+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:27.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:27 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:27.093+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:27.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:27 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:27.093+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:27.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:27 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:27.235+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:27.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:27 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:27.235+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:27.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:27 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:27.235+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:27.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:27 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:27.235+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:27.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:27 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:27.235+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:27.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:27 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:27.235+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:27.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:27 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:27.235+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:27.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:27.311+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.713922+0000 front 2024-09-12T12:29:11.713997+0000 (oldest deadline 2024-09-12T12:29:35.714546+0000) 2024-09-12T12:30:27.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:27.311+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:17.916304+0000 front 2024-09-12T12:29:17.916394+0000 (oldest deadline 2024-09-12T12:29:47.917354+0000) 2024-09-12T12:30:27.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:27.311+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:27.917987+0000 front 2024-09-12T12:29:27.917960+0000 (oldest deadline 2024-09-12T12:29:52.618265+0000) 2024-09-12T12:30:27.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:27.311+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:39.019804+0000 front 2024-09-12T12:29:39.019830+0000 (oldest deadline 2024-09-12T12:30:03.719841+0000) 2024-09-12T12:30:27.719 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:27.311+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:43.720368+0000 front 2024-09-12T12:29:43.720274+0000 (oldest deadline 2024-09-12T12:30:09.620271+0000) 2024-09-12T12:30:27.720 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:27 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9[64590]: 2024-09-12T12:30:27.311+0000 7fca93800640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.422011+0000 front 2024-09-12T12:29:52.422033+0000 (oldest deadline 2024-09-12T12:30:17.121926+0000) 2024-09-12T12:30:28.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:28.124+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:28.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:28.124+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:28.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:28.124+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:28.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:28.124+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:28.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:28.124+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:28.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:28.124+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:28.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:28.282+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:28.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:28.282+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:28.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:28.282+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:28.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:28.282+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:28.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:28.282+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:28.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:28.282+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:28.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:28 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:28.282+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:29.070 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:28 smithi038 podman[93584]: 2024-09-12 12:30:28.742192352 +0000 UTC m=+5.612881505 container died 971b6fa42a4f379e7f5dc0324c8164d9a3b080a3baca05d40f570e55d150e165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T12:30:29.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:29 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:29.095+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:29.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:29 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:29.095+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:29.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:29 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:29.095+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:29.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:29 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:29.095+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:29.418 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:29 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:29.095+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:29.418 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:29 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:29.095+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:29.469 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:29 smithi038 podman[93584]: 2024-09-12 12:30:29.2952276 +0000 UTC m=+6.165916735 container cleanup 971b6fa42a4f379e7f5dc0324c8164d9a3b080a3baca05d40f570e55d150e165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T12:30:29.469 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:29 smithi038 bash[93584]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9 2024-09-12T12:30:29.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:29.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:29.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:29.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:29.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:29.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:29.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:29.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:29.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:29.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:29.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:29.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:29.514 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:29 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:29.261+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:29.969 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:29 smithi038 podman[93600]: 2024-09-12 12:30:29.537439081 +0000 UTC m=+0.779731324 container remove 971b6fa42a4f379e7f5dc0324c8164d9a3b080a3baca05d40f570e55d150e165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T12:30:30.340 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:30 smithi038 podman[93685]: 2024-09-12 12:30:29.985826655 +0000 UTC m=+0.027653707 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:30:30.340 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:30 smithi038 podman[93685]: 2024-09-12 12:30:30.105008275 +0000 UTC m=+0.146835309 container create 608b3e33060e13394c60e01c2e9c423a75f54586202ca44c17546a385827204a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T12:30:30.340 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:30 smithi038 podman[93685]: 2024-09-12 12:30:30.340747996 +0000 UTC m=+0.382575054 container init 608b3e33060e13394c60e01c2e9c423a75f54586202ca44c17546a385827204a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:30:30.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:30 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:30.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:30.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:30 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:30.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:30.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:30 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:30.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:30.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:30 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:30.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:30.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:30 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:30.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:30.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:30 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:30.132+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:30.610 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:30 smithi038 podman[93685]: 2024-09-12 12:30:30.348269519 +0000 UTC m=+0.390096554 container start 608b3e33060e13394c60e01c2e9c423a75f54586202ca44c17546a385827204a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T12:30:30.610 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:30 smithi038 podman[93685]: 2024-09-12 12:30:30.43227551 +0000 UTC m=+0.474102550 container attach 608b3e33060e13394c60e01c2e9c423a75f54586202ca44c17546a385827204a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:30:30.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:30.290+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:30.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:30.290+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:30.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:30.290+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:30.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:30.290+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:30.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:30.290+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:30.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:30.290+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:30.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:30 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:30.290+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:30.943 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 12 12:30:30 smithi038 podman[93685]: 2024-09-12 12:30:30.610970103 +0000 UTC m=+0.652797157 container died 608b3e33060e13394c60e01c2e9c423a75f54586202ca44c17546a385827204a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T12:30:31.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T12:30:31.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:31 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:31.135+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:31.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:31 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:31.135+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:31.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:31 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:31.135+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:31.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:31 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:31.135+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:31.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:31 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:31.135+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:31.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:31 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:31.135+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:31.482 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:31.483 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T12:30:31.483 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T12:30:31.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.10 2024-09-12T12:30:31.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:31.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:31.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:31.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:31.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:31.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:31.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.301+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:31.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 systemd[1]: Stopping Ceph osd.10 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:32.264 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.788+0000 7f25e93ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:32.264 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.788+0000 7f25e93ab640 -1 osd.10 97 *** Got signal Terminated *** 2024-09-12T12:30:32.264 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:31 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:31.788+0000 7f25e93ab640 -1 osd.10 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:30:32.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:32.155+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:32.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:32.155+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:32.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:32.155+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:32.417 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:32.155+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:32.418 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:32.155+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:32.418 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:32.155+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:32.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:32 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:32.304+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:32.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:32 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:32.304+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:32.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:32 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:32.304+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:32.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:32 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:32.304+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:32.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:32 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:32.304+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:32.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:32 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:32.304+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:32.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:32 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:32.304+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:33.666 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:33 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:33.197+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:33.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:33 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:33.197+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:33.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:33 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:33.197+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:33.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:33 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:33.197+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:33.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:33 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:33.197+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:33.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:33 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:33.197+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:33.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:33 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:33.273+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:33.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:33 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:33.273+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:33.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:33 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:33.273+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:33.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:33 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:33.273+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:33.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:33 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:33.273+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:33.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:33 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:33.273+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:33.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:33 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:33.273+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:34.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:34 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:34.219+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:34.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:34 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:34.219+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:34.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:34 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:34.219+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:34.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:34 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:34.219+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:34.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:34 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:34.219+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:34.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:34 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:34.219+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:34.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:34 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:34.219+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:34.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:34 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:34.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:34.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:34 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:34.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:34.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:34 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:34.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:34.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:34 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:34.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:34.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:34 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:34.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:34.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:34 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:34.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:34.765 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:34 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:34.266+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:35.666 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:35.208+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:35.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:35.208+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:35.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:35.208+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:35.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:35.208+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:35.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:35.208+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:35.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:35.208+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:35.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:35 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:35.208+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:35.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:35 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:35.310+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:35.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:35 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:35.310+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:35.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:35 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:35.310+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:35.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:35 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:35.310+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:35.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:35 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:35.310+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:35.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:35 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:35.310+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:35.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:35 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:35.310+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:36.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:36 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:36.223+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:36.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:36 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:36.223+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:36.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:36 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:36.223+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:36.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:36 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:36.223+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:36.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:36 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:36.223+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:36.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:36 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:36.223+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:36.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:36 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:36.223+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:36.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:36 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:36.267+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:14.317375+0000 front 2024-09-12T12:29:14.317401+0000 (oldest deadline 2024-09-12T12:29:39.017227+0000) 2024-09-12T12:30:36.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:36 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:36.267+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6804 osd.1 since back 2024-09-12T12:29:19.017591+0000 front 2024-09-12T12:29:19.017617+0000 (oldest deadline 2024-09-12T12:29:44.317755+0000) 2024-09-12T12:30:36.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:36 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:36.267+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:29.618764+0000 front 2024-09-12T12:29:29.618816+0000 (oldest deadline 2024-09-12T12:29:53.118744+0000) 2024-09-12T12:30:36.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:36 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:36.267+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:38.920333+0000 front 2024-09-12T12:29:38.920380+0000 (oldest deadline 2024-09-12T12:30:04.820128+0000) 2024-09-12T12:30:36.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:36 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:36.267+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:47.021202+0000 front 2024-09-12T12:29:47.021229+0000 (oldest deadline 2024-09-12T12:30:11.621946+0000) 2024-09-12T12:30:36.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:36 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:36.267+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:54.522793+0000 front 2024-09-12T12:29:54.522752+0000 (oldest deadline 2024-09-12T12:30:19.822692+0000) 2024-09-12T12:30:36.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:36 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10[59895]: 2024-09-12T12:30:36.267+0000 7f25e59c1640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:02.123468+0000 front 2024-09-12T12:30:02.123535+0000 (oldest deadline 2024-09-12T12:30:26.823395+0000) 2024-09-12T12:30:37.538 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:37 smithi071 podman[69049]: 2024-09-12 12:30:37.274804469 +0000 UTC m=+5.597592572 container died ff97ec30e8b65222cb06f1b4fa10f8f28ca5e7a11f76c0882781e02768b5d8fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T12:30:37.666 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:37.225+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:37.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:37.225+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:37.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:37.225+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:37.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:37.225+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:37.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:37.225+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:37.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:37.225+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:37.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:37 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:37.225+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:37.888 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:37 smithi071 podman[69049]: 2024-09-12 12:30:37.629080446 +0000 UTC m=+5.951868559 container cleanup ff97ec30e8b65222cb06f1b4fa10f8f28ca5e7a11f76c0882781e02768b5d8fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T12:30:37.888 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:37 smithi071 bash[69049]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10 2024-09-12T12:30:38.222 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:37 smithi071 podman[69065]: 2024-09-12 12:30:37.888631522 +0000 UTC m=+0.606786026 container remove ff97ec30e8b65222cb06f1b4fa10f8f28ca5e7a11f76c0882781e02768b5d8fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T12:30:38.491 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:38 smithi071 podman[69154]: 2024-09-12 12:30:38.222945499 +0000 UTC m=+0.090129628 container create 1afc538476152bd23f533f194a4da273aabd81fc691c299979419a1f28939ba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T12:30:38.491 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:38 smithi071 podman[69154]: 2024-09-12 12:30:38.148382889 +0000 UTC m=+0.015567025 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:30:38.491 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:38 smithi071 podman[69154]: 2024-09-12 12:30:38.433857672 +0000 UTC m=+0.301041808 container init 1afc538476152bd23f533f194a4da273aabd81fc691c299979419a1f28939ba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:30:38.491 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:38 smithi071 podman[69154]: 2024-09-12 12:30:38.437322489 +0000 UTC m=+0.304506629 container start 1afc538476152bd23f533f194a4da273aabd81fc691c299979419a1f28939ba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T12:30:38.491 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:38 smithi071 podman[69154]: 2024-09-12 12:30:38.491674562 +0000 UTC m=+0.358858707 container attach 1afc538476152bd23f533f194a4da273aabd81fc691c299979419a1f28939ba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T12:30:38.666 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:38.187+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:38.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:38.187+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:38.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:38.187+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:38.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:38.187+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:38.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:38.187+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:38.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:38.187+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:38.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:38 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:38.187+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:38.764 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:38 smithi071 podman[69154]: 2024-09-12 12:30:38.62404523 +0000 UTC m=+0.491229368 container died 1afc538476152bd23f533f194a4da273aabd81fc691c299979419a1f28939ba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:30:39.157 INFO:journalctl@ceph.osd.10.smithi071.stdout:Sep 12 12:30:39 smithi071 podman[69178]: 2024-09-12 12:30:39.136387439 +0000 UTC m=+0.506870714 container remove 1afc538476152bd23f533f194a4da273aabd81fc691c299979419a1f28939ba4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:30:39.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T12:30:39.199 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:39.199 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T12:30:39.199 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T12:30:39.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.11 2024-09-12T12:30:39.535 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.235+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:39.535 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.235+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:39.535 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.235+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:39.535 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.235+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:39.535 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.235+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:39.535 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.235+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:39.535 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.235+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:39.536 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 systemd[1]: Stopping Ceph osd.11 for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:39.536 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.533+0000 7fc8e3c67640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:39.536 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.533+0000 7fc8e3c67640 -1 osd.11 97 *** Got signal Terminated *** 2024-09-12T12:30:39.536 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:39 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:39.533+0000 7fc8e3c67640 -1 osd.11 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:30:40.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:40.238+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:40.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:40.238+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:40.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:40.238+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:40.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:40.238+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:40.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:40.238+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:40.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:40.238+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:40.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:40 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:40.238+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:41.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:41.206+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:41.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:41.206+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:41.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:41.206+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:41.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:41.206+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:41.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:41.206+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:41.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:41.206+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:41.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:41 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:41.206+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:42.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:42 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:42.236+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6820 osd.8 since back 2024-09-12T12:30:19.407702+0000 front 2024-09-12T12:30:19.407717+0000 (oldest deadline 2024-09-12T12:30:41.707773+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:43.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:43 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:43.229+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6820 osd.8 since back 2024-09-12T12:30:19.407702+0000 front 2024-09-12T12:30:19.407717+0000 (oldest deadline 2024-09-12T12:30:41.707773+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-12T12:29:11.897542+0000 front 2024-09-12T12:29:11.897586+0000 (oldest deadline 2024-09-12T12:29:37.797542+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-12T12:29:30.600120+0000 front 2024-09-12T12:29:30.600180+0000 (oldest deadline 2024-09-12T12:29:56.500317+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-12T12:29:37.601577+0000 front 2024-09-12T12:29:37.601486+0000 (oldest deadline 2024-09-12T12:30:01.101205+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6812 osd.4 since back 2024-09-12T12:29:46.203255+0000 front 2024-09-12T12:29:46.203235+0000 (oldest deadline 2024-09-12T12:30:09.103198+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-12T12:29:52.003864+0000 front 2024-09-12T12:29:52.003886+0000 (oldest deadline 2024-09-12T12:30:16.704043+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-12T12:30:01.905302+0000 front 2024-09-12T12:30:01.905284+0000 (oldest deadline 2024-09-12T12:30:26.005252+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.71:6820 osd.7 since back 2024-09-12T12:30:11.806738+0000 front 2024-09-12T12:30:11.806686+0000 (oldest deadline 2024-09-12T12:30:33.506585+0000) 2024-09-12T12:30:44.667 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11[60666]: 2024-09-12T12:30:44.227+0000 7fc8dc275640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6820 osd.8 since back 2024-09-12T12:30:19.407702+0000 front 2024-09-12T12:30:19.407717+0000 (oldest deadline 2024-09-12T12:30:41.707773+0000) 2024-09-12T12:30:45.210 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:44 smithi154 podman[70067]: 2024-09-12 12:30:44.943484108 +0000 UTC m=+5.546165139 container died 2cab9bfbcd74dfcac9d0db9064e820f5742fdfe83837302b6381acfb5b073256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T12:30:45.552 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:45 smithi154 podman[70067]: 2024-09-12 12:30:45.309531775 +0000 UTC m=+5.912212798 container cleanup 2cab9bfbcd74dfcac9d0db9064e820f5742fdfe83837302b6381acfb5b073256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T12:30:45.552 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:45 smithi154 bash[70067]: ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11 2024-09-12T12:30:45.875 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:45 smithi154 podman[70081]: 2024-09-12 12:30:45.552552239 +0000 UTC m=+0.604317789 container remove 2cab9bfbcd74dfcac9d0db9064e820f5742fdfe83837302b6381acfb5b073256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T12:30:46.166 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:45 smithi154 podman[70171]: 2024-09-12 12:30:45.778354757 +0000 UTC m=+0.015760709 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:30:46.167 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:45 smithi154 podman[70171]: 2024-09-12 12:30:45.894975178 +0000 UTC m=+0.132381168 container create e14f81364ff22dfb465e58748dbe300fe426224fd97a43d2cf28b9b140d0e916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T12:30:46.167 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:46 smithi154 podman[70171]: 2024-09-12 12:30:46.122289806 +0000 UTC m=+0.359695750 container init e14f81364ff22dfb465e58748dbe300fe426224fd97a43d2cf28b9b140d0e916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T12:30:46.167 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:46 smithi154 podman[70171]: 2024-09-12 12:30:46.125657432 +0000 UTC m=+0.363063376 container start e14f81364ff22dfb465e58748dbe300fe426224fd97a43d2cf28b9b140d0e916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T12:30:46.599 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:46 smithi154 podman[70171]: 2024-09-12 12:30:46.240041904 +0000 UTC m=+0.477447868 container attach e14f81364ff22dfb465e58748dbe300fe426224fd97a43d2cf28b9b140d0e916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T12:30:46.599 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 12 12:30:46 smithi154 podman[70171]: 2024-09-12 12:30:46.310155178 +0000 UTC m=+0.547561125 container died e14f81364ff22dfb465e58748dbe300fe426224fd97a43d2cf28b9b140d0e916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:30:46.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T12:30:46.927 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:46.927 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T12:30:46.927 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T12:30:46.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.a 2024-09-12T12:30:47.333 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:30:47 smithi038 systemd[1]: Stopping Ceph mds.a for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:47.719 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:30:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a[71409]: 2024-09-12T12:30:47.332+0000 7f7607e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:47.719 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:30:47 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a[71409]: 2024-09-12T12:30:47.332+0000 7f7607e00640 -1 mds.a *** got signal Terminated *** 2024-09-12T12:30:51.640 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:30:51 smithi038 podman[93800]: 2024-09-12 12:30:51.346248819 +0000 UTC m=+4.126039642 container died 6f950a63d34152bdc168d9e6a65f94ba58afde4c3dfd7198271db843a6afa017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:30:51.969 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:30:51 smithi038 podman[93800]: 2024-09-12 12:30:51.804658584 +0000 UTC m=+4.584449410 container cleanup 6f950a63d34152bdc168d9e6a65f94ba58afde4c3dfd7198271db843a6afa017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T12:30:51.969 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:30:51 smithi038 bash[93800]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a 2024-09-12T12:30:52.282 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 12 12:30:52 smithi038 podman[93811]: 2024-09-12 12:30:52.025906637 +0000 UTC m=+0.667288782 container remove 6f950a63d34152bdc168d9e6a65f94ba58afde4c3dfd7198271db843a6afa017 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T12:30:52.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T12:30:52.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:52.377 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T12:30:52.377 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T12:30:52.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.d 2024-09-12T12:30:52.719 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:52 smithi038 systemd[1]: Stopping Ceph mds.d for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:53.219 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d[70269]: 2024-09-12T12:30:52.778+0000 7f5769000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:53.219 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:52 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d[70269]: 2024-09-12T12:30:52.778+0000 7f5769000640 -1 mds.d *** got signal Terminated *** 2024-09-12T12:30:56.143 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:55 smithi038 podman[93921]: 2024-09-12 12:30:55.877862737 +0000 UTC m=+3.223578131 container died 970ee6ccd4e6d54b8ae309582c63567a6174c1ba2f301d0d58efc26003e99841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T12:30:56.469 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:56 smithi038 podman[93921]: 2024-09-12 12:30:56.350909889 +0000 UTC m=+3.696625280 container cleanup 970ee6ccd4e6d54b8ae309582c63567a6174c1ba2f301d0d58efc26003e99841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T12:30:56.470 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:56 smithi038 bash[93921]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d 2024-09-12T12:30:57.012 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T12:30:57.061 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:56 smithi038 podman[93947]: 2024-09-12 12:30:56.768922883 +0000 UTC m=+0.879993961 container remove 970ee6ccd4e6d54b8ae309582c63567a6174c1ba2f301d0d58efc26003e99841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T12:30:57.061 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:57 smithi038 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-12T12:30:57.061 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:57 smithi038 systemd[1]: Stopped Ceph mds.d for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:30:57.061 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 12 12:30:57 smithi038 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.d.service: Consumed 1.426s CPU time. 2024-09-12T12:30:57.084 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:30:57.085 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T12:30:57.085 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T12:30:57.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.g 2024-09-12T12:30:57.469 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:30:57 smithi038 systemd[1]: Stopping Ceph mds.g for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:30:57.969 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:30:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g[71041]: 2024-09-12T12:30:57.474+0000 7fd991c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:30:57.969 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:30:57 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g[71041]: 2024-09-12T12:30:57.474+0000 7fd991c00640 -1 mds.g *** got signal Terminated *** 2024-09-12T12:30:59.872 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:30:59 smithi038 podman[94053]: 2024-09-12 12:30:59.604956843 +0000 UTC m=+2.245021900 container died f73c55f9588cebcb20f058b2853cc874178fa368fd9199432e0a86dff81aeff2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:31:00.123 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:31:00 smithi038 podman[94053]: 2024-09-12 12:31:00.104693162 +0000 UTC m=+2.744758259 container cleanup f73c55f9588cebcb20f058b2853cc874178fa368fd9199432e0a86dff81aeff2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:31:00.124 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:31:00 smithi038 bash[94053]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g 2024-09-12T12:31:00.469 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 12 12:31:00 smithi038 podman[94065]: 2024-09-12 12:31:00.347973275 +0000 UTC m=+0.734170642 container remove f73c55f9588cebcb20f058b2853cc874178fa368fd9199432e0a86dff81aeff2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T12:31:00.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T12:31:00.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:00.604 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T12:31:00.604 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T12:31:00.604 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.j 2024-09-12T12:31:00.969 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:31:00 smithi038 systemd[1]: Stopping Ceph mds.j for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:01.469 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:31:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j[69850]: 2024-09-12T12:31:01.044+0000 7f026f600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:01.469 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:31:01 smithi038 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j[69850]: 2024-09-12T12:31:01.045+0000 7f026f600640 -1 mds.j *** got signal Terminated *** 2024-09-12T12:31:03.719 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:31:03 smithi038 podman[94169]: 2024-09-12 12:31:03.468242879 +0000 UTC m=+2.592941201 container died 138e3e55a3fe0d2f8a4f9175ee6a8034a9d1d484c09c419badd569c58824152d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-12T12:31:04.018 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:31:03 smithi038 podman[94169]: 2024-09-12 12:31:03.848189142 +0000 UTC m=+2.972887470 container cleanup 138e3e55a3fe0d2f8a4f9175ee6a8034a9d1d484c09c419badd569c58824152d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T12:31:04.018 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:31:03 smithi038 bash[94169]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j 2024-09-12T12:31:04.280 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 12 12:31:04 smithi038 podman[94180]: 2024-09-12 12:31:04.018276427 +0000 UTC m=+0.541562177 container remove 138e3e55a3fe0d2f8a4f9175ee6a8034a9d1d484c09c419badd569c58824152d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T12:31:04.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T12:31:04.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:04.357 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T12:31:04.358 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T12:31:04.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.b 2024-09-12T12:31:04.643 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:31:04 smithi071 systemd[1]: Stopping Ceph mds.b for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:05.014 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:31:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: 2024-09-12T12:31:04.642+0000 7fa45f3ef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:05.014 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:31:04 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b[65253]: 2024-09-12T12:31:04.642+0000 7fa45f3ef640 -1 mds.b *** got signal Terminated *** 2024-09-12T12:31:08.014 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:31:07 smithi071 podman[69257]: 2024-09-12 12:31:07.583437939 +0000 UTC m=+3.035154349 container died dee4565796963ec9a0508b0cc1835619cdcd81f2fdcfde6500494138ec36591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T12:31:08.514 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:31:08 smithi071 podman[69257]: 2024-09-12 12:31:08.234284103 +0000 UTC m=+3.686000514 container cleanup dee4565796963ec9a0508b0cc1835619cdcd81f2fdcfde6500494138ec36591c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T12:31:08.514 INFO:journalctl@ceph.mds.b.smithi071.stdout:Sep 12 12:31:08 smithi071 bash[69257]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-b 2024-09-12T12:31:08.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T12:31:08.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:08.700 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T12:31:08.700 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T12:31:08.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.e 2024-09-12T12:31:09.264 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:31:08 smithi071 systemd[1]: Stopping Ceph mds.e for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:09.264 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:31:09 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e[64649]: 2024-09-12T12:31:09.004+0000 7f588eba1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:09.264 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:31:09 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e[64649]: 2024-09-12T12:31:09.004+0000 7f588eba1640 -1 mds.e *** got signal Terminated *** 2024-09-12T12:31:11.946 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:31:11 smithi071 podman[69389]: 2024-09-12 12:31:11.584488992 +0000 UTC m=+2.670676158 container died d0c09cffebc90bcb106e75b8025a48ec8b3039d58f116742b554771642be7289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T12:31:12.264 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:31:12 smithi071 podman[69389]: 2024-09-12 12:31:12.037488467 +0000 UTC m=+3.123675620 container cleanup d0c09cffebc90bcb106e75b8025a48ec8b3039d58f116742b554771642be7289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T12:31:12.264 INFO:journalctl@ceph.mds.e.smithi071.stdout:Sep 12 12:31:12 smithi071 bash[69389]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-e 2024-09-12T12:31:12.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T12:31:12.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:12.503 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T12:31:12.504 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T12:31:12.504 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.h 2024-09-12T12:31:13.014 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:31:12 smithi071 systemd[1]: Stopping Ceph mds.h for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:13.014 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:31:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h[64949]: 2024-09-12T12:31:12.799+0000 7f1d2b41e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:13.014 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:31:12 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h[64949]: 2024-09-12T12:31:12.799+0000 7f1d2b41e640 -1 mds.h *** got signal Terminated *** 2024-09-12T12:31:15.908 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:31:15 smithi071 podman[69511]: 2024-09-12 12:31:15.566043828 +0000 UTC m=+2.849563344 container died 9eea637ebef152d4662497f24c307d736d7881f5f23f1e122716cc6a47112905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T12:31:16.264 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:31:15 smithi071 podman[69511]: 2024-09-12 12:31:15.990747099 +0000 UTC m=+3.274266604 container cleanup 9eea637ebef152d4662497f24c307d736d7881f5f23f1e122716cc6a47112905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:31:16.264 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:31:15 smithi071 bash[69511]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h 2024-09-12T12:31:16.264 INFO:journalctl@ceph.mds.h.smithi071.stdout:Sep 12 12:31:16 smithi071 podman[69524]: 2024-09-12 12:31:16.150153869 +0000 UTC m=+0.585038425 container remove 9eea637ebef152d4662497f24c307d736d7881f5f23f1e122716cc6a47112905 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:31:16.363 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T12:31:16.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:16.396 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T12:31:16.396 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T12:31:16.396 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.k 2024-09-12T12:31:16.702 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:16 smithi071 systemd[1]: Stopping Ceph mds.k for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:17.014 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:16 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k[64337]: 2024-09-12T12:31:16.702+0000 7f56f0d17640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:17.014 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:16 smithi071 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k[64337]: 2024-09-12T12:31:16.702+0000 7f56f0d17640 -1 mds.k *** got signal Terminated *** 2024-09-12T12:31:19.910 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:19 smithi071 podman[69634]: 2024-09-12 12:31:19.569565982 +0000 UTC m=+2.956918420 container died 4e02d3284e69a60d45888d56806e195101a5e44c0deff9055876ea6f7019cbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:31:20.160 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:19 smithi071 podman[69634]: 2024-09-12 12:31:19.993811649 +0000 UTC m=+3.381164087 container cleanup 4e02d3284e69a60d45888d56806e195101a5e44c0deff9055876ea6f7019cbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T12:31:20.161 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:19 smithi071 bash[69634]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k 2024-09-12T12:31:20.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T12:31:20.411 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:20 smithi071 podman[69649]: 2024-09-12 12:31:20.161250343 +0000 UTC m=+0.594618791 container remove 4e02d3284e69a60d45888d56806e195101a5e44c0deff9055876ea6f7019cbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T12:31:20.411 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:20 smithi071 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-12T12:31:20.411 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:20 smithi071 systemd[1]: Stopped Ceph mds.k for 726420ce-7100-11ef-bcea-c7b262605968. 2024-09-12T12:31:20.411 INFO:journalctl@ceph.mds.k.smithi071.stdout:Sep 12 12:31:20 smithi071 systemd[1]: ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.k.service: Consumed 1.393s CPU time. 2024-09-12T12:31:20.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:20.421 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T12:31:20.421 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T12:31:20.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.c 2024-09-12T12:31:20.776 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:31:20 smithi154 systemd[1]: Stopping Ceph mds.c for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:21.166 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:31:20 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c[66029]: 2024-09-12T12:31:20.866+0000 7f10f9629640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:21.167 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:31:20 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c[66029]: 2024-09-12T12:31:20.866+0000 7f10f9629640 -1 mds.c *** got signal Terminated *** 2024-09-12T12:31:23.900 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:31:23 smithi154 podman[70274]: 2024-09-12 12:31:23.565981471 +0000 UTC m=+2.945937663 container died b87446bf47763e3f556526eae1396da3d7e46b0fbc2e33692a22cac6d2d35d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:31:24.167 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:31:24 smithi154 podman[70274]: 2024-09-12 12:31:24.000221014 +0000 UTC m=+3.380177211 container cleanup b87446bf47763e3f556526eae1396da3d7e46b0fbc2e33692a22cac6d2d35d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-12T12:31:24.167 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 12 12:31:24 smithi154 bash[70274]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-c 2024-09-12T12:31:24.431 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T12:31:24.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:24.469 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T12:31:24.469 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T12:31:24.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.f 2024-09-12T12:31:24.803 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:31:24 smithi154 systemd[1]: Stopping Ceph mds.f for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:25.166 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:31:24 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f[65726]: 2024-09-12T12:31:24.803+0000 7f25e32bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:25.167 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:31:24 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f[65726]: 2024-09-12T12:31:24.803+0000 7f25e32bd640 -1 mds.f *** got signal Terminated *** 2024-09-12T12:31:27.837 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:31:27 smithi154 podman[70406]: 2024-09-12 12:31:27.573945324 +0000 UTC m=+2.876467732 container died 3d8d71f6c61013edafc700e555ab1810cfa99a47d59f6050e45bf276ea0b2ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:31:28.121 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:31:27 smithi154 podman[70406]: 2024-09-12 12:31:27.90375418 +0000 UTC m=+3.206276587 container cleanup 3d8d71f6c61013edafc700e555ab1810cfa99a47d59f6050e45bf276ea0b2ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:31:28.121 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 12 12:31:27 smithi154 bash[70406]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-f 2024-09-12T12:31:28.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T12:31:28.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:28.378 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T12:31:28.378 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T12:31:28.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.i 2024-09-12T12:31:28.666 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:31:28 smithi154 systemd[1]: Stopping Ceph mds.i for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:29.166 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:31:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i[66332]: 2024-09-12T12:31:28.761+0000 7efc66085640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:29.167 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:31:28 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i[66332]: 2024-09-12T12:31:28.761+0000 7efc66085640 -1 mds.i *** got signal Terminated *** 2024-09-12T12:31:31.867 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:31:31 smithi154 podman[70528]: 2024-09-12 12:31:31.57613993 +0000 UTC m=+2.981555756 container died f0976629c838d944874d49933d3e3a24382161993500260242d6fd1e5049c5ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T12:31:32.166 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:31:31 smithi154 podman[70528]: 2024-09-12 12:31:31.957643309 +0000 UTC m=+3.363059135 container cleanup f0976629c838d944874d49933d3e3a24382161993500260242d6fd1e5049c5ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T12:31:32.179 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 12 12:31:31 smithi154 bash[70528]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-i 2024-09-12T12:31:32.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T12:31:32.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:32.417 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T12:31:32.417 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T12:31:32.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.l 2024-09-12T12:31:32.736 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:31:32 smithi154 systemd[1]: Stopping Ceph mds.l for 726420ce-7100-11ef-bcea-c7b262605968... 2024-09-12T12:31:33.166 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:31:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l[65421]: 2024-09-12T12:31:32.736+0000 7f3e262b4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:31:33.167 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:31:32 smithi154 ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l[65421]: 2024-09-12T12:31:32.736+0000 7f3e262b4640 -1 mds.l *** got signal Terminated *** 2024-09-12T12:31:35.844 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:31:35 smithi154 podman[70650]: 2024-09-12 12:31:35.560291607 +0000 UTC m=+2.916472578 container died 441e1918bc5bb413ac9b1d6b1bd96de6a4deedd5ff664dafa20f17c3ffc386df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T12:31:35.844 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:31:35 smithi154 podman[70650]: 2024-09-12 12:31:35.844625837 +0000 UTC m=+3.200806813 container cleanup 441e1918bc5bb413ac9b1d6b1bd96de6a4deedd5ff664dafa20f17c3ffc386df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T12:31:36.166 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:31:35 smithi154 bash[70650]: ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l 2024-09-12T12:31:36.167 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 12 12:31:36 smithi154 podman[70662]: 2024-09-12 12:31:36.07083466 +0000 UTC m=+0.505045018 container remove 441e1918bc5bb413ac9b1d6b1bd96de6a4deedd5ff664dafa20f17c3ffc386df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-726420ce-7100-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:31:36.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-726420ce-7100-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T12:31:36.237 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:31:36.237 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T12:31:36.237 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 726420ce-7100-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:31:36.517 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:31:40.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 726420ce-7100-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:31:40.919 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:31:43.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 726420ce-7100-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:31:43.660 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:31:46.173 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:31:46.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:31:46.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:31:46.297 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T12:31:46.299 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi038/crash 2024-09-12T12:31:46.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:31:46.372 INFO:teuthology.orchestra.run.smithi038.stderr:tar: /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:31:46.373 INFO:teuthology.orchestra.run.smithi038.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:31:46.376 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi071/crash 2024-09-12T12:31:46.377 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:31:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:31:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:31:46.414 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi154/crash 2024-09-12T12:31:46.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:31:46.447 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/726420ce-7100-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:31:46.447 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:31:46.448 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T12:31:46.448 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T12:31:46.530 INFO:tasks.cephadm:Compressing logs... 2024-09-12T12:31:46.531 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:31:46.535 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:31:46.537 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:31:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:31:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-09-12T12:31:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:31:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T12:31:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T12:31:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:31:46.566 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T12:31:46.566 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-09-12T12:31:46.566 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T12:31:46.566 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T12:31:46.566 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:31:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T12:31:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T12:31:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T12:31:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:31:46.567 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.11.log/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.c.log: 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr: 82.2% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log: 86.5% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:31:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T12:31:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T12:31:46.570 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:31:46.570 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T12:31:46.570 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:31:46.571 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:31:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:31:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.y.log: 92.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T12:31:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T12:31:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log: 91.0% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:31:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T12:31:46.580 INFO:teuthology.orchestra.run.smithi071.stderr: 86.5% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:31:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T12:31:46.584 INFO:teuthology.orchestra.run.smithi038.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-12T12:31:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:: No such file or directory 2024-09-12T12:31:46.585 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T12:31:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T12:31:46.586 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.5% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T12:31:46.587 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:31:46.587 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.9.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-12T12:31:46.588 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:31:46.589 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T12:31:46.590 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:31:46.591 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T12:31:46.592 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log: 90.2% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:31:46.593 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T12:31:46.593 INFO:teuthology.orchestra.run.smithi038.stderr: 82.4% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:31:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T12:31:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:31:46.595 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T12:31:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T12:31:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:31:46.597 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.6.log: /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T12:31:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 93.9% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T12:31:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T12:31:46.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.c.log: 94.0% 92.1% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T12:31:46.605 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T12:31:46.606 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:31:46.606 INFO:teuthology.orchestra.run.smithi038.stderr: 91.0% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:31:46.606 INFO:teuthology.orchestra.run.smithi038.stderr: 86.5% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:31:46.606 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T12:31:46.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:31:46.609 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T12:31:46.609 INFO:teuthology.orchestra.run.smithi038.stderr: 94.6% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T12:31:46.611 INFO:teuthology.orchestra.run.smithi071.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:31:46.617 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:31:46.622 INFO:teuthology.orchestra.run.smithi038.stderr: 94.7% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T12:31:46.626 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T12:31:46.631 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T12:31:46.633 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/cephadm.log: 93.9% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T12:31:46.633 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T12:31:46.634 INFO:teuthology.orchestra.run.smithi038.stderr: 93.9% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T12:31:46.638 INFO:teuthology.orchestra.run.smithi038.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:31:46.664 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T12:31:46.773 INFO:teuthology.orchestra.run.smithi038.stderr: 89.8% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T12:31:46.799 INFO:teuthology.orchestra.run.smithi154.stderr: 91.6% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T12:31:46.847 INFO:teuthology.orchestra.run.smithi071.stderr: 92.7% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T12:31:46.896 INFO:teuthology.orchestra.run.smithi071.stderr: 91.7% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T12:31:47.101 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T12:31:47.200 INFO:teuthology.orchestra.run.smithi071.stderr: 92.4% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T12:31:47.204 INFO:teuthology.orchestra.run.smithi038.stderr: 90.6% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T12:31:47.297 INFO:teuthology.orchestra.run.smithi038.stderr: 92.5% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T12:31:47.341 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T12:31:47.466 INFO:teuthology.orchestra.run.smithi038.stderr: 92.5% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T12:31:47.509 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T12:31:47.633 INFO:teuthology.orchestra.run.smithi071.stderr: 93.5% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T12:31:47.752 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T12:31:47.760 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T12:31:47.762 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-12T12:31:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m1.210s 2024-09-12T12:31:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m4.304s 2024-09-12T12:31:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.154s 2024-09-12T12:31:47.786 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T12:31:47.788 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-12T12:31:47.788 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m1.236s 2024-09-12T12:31:47.788 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m4.136s 2024-09-12T12:31:47.788 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.180s 2024-09-12T12:31:47.838 INFO:teuthology.orchestra.run.smithi038.stderr: 93.2% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T12:31:47.864 INFO:teuthology.orchestra.run.smithi038.stderr: 93.3% -- replaced with /var/log/ceph/726420ce-7100-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T12:31:47.867 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-12T12:31:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m1.303s 2024-09-12T12:31:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:user 0m4.591s 2024-09-12T12:31:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m0.459s 2024-09-12T12:31:47.868 INFO:tasks.cephadm:Archiving logs... 2024-09-12T12:31:47.868 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi038/log 2024-09-12T12:31:47.869 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:31:48.585 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi071/log 2024-09-12T12:31:48.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:31:49.252 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi154/log 2024-09-12T12:31:49.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:31:49.918 INFO:tasks.cephadm:Removing cluster... 2024-09-12T12:31:49.918 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 726420ce-7100-11ef-bcea-c7b262605968 --force 2024-09-12T12:31:50.203 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:31:50.647 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 726420ce-7100-11ef-bcea-c7b262605968 --force 2024-09-12T12:31:50.848 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:31:51.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 726420ce-7100-11ef-bcea-c7b262605968 --force 2024-09-12T12:31:51.319 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 726420ce-7100-11ef-bcea-c7b262605968 2024-09-12T12:31:51.592 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T12:31:51.592 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:31:51.632 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:31:51.649 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:31:51.665 INFO:tasks.cephadm:Teardown complete 2024-09-12T12:31:51.665 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T12:31:51.676 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T12:31:51.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:31:51.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:31:51.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:31:51.831 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T12:31:51.841 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T12:31:51.841 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:31:51.845 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:31:51.848 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:31:51.861 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:31:51.862 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:31:51.866 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:31:51.866 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-12T12:31:51.866 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 -1307us[-1274us] +/- 47ms 2024-09-12T12:31:51.866 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 +1104us[+1136us] +/- 58ms 2024-09-12T12:31:51.866 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +657us[ +689us] +/- 59ms 2024-09-12T12:31:51.867 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:31:51.867 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:31:51.867 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-12T12:31:51.867 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 -1327us[-1292us] +/- 47ms 2024-09-12T12:31:51.867 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +1070us[+1070us] +/- 58ms 2024-09-12T12:31:51.868 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +631us[ +666us] +/- 59ms 2024-09-12T12:31:51.868 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:31:51.876 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:31:51.883 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:31:51.883 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-12T12:31:51.883 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -1336us[-1319us] +/- 47ms 2024-09-12T12:31:51.883 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +1088us[+1088us] +/- 58ms 2024-09-12T12:31:51.883 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +618us[ +636us] +/- 59ms 2024-09-12T12:31:51.883 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:31:51.884 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T12:31:51.894 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T12:31:51.894 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T12:31:51.910 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:31:52.055 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:31:52.124 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:31:52.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:31:52.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:31:52.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:31:52.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:31:52.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:31:52.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:31:52.308 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T12:31:52.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T12:31:52.363 INFO:teuthology.task.internal:Duration was 1486.403881 seconds 2024-09-12T12:31:52.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T12:31:52.373 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T12:31:52.373 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:31:52.377 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:31:52.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:31:52.417 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:31:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:31:52.461 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:31:52.803 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T12:31:52.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-09-12T12:31:52.804 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:31:52.853 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-12T12:31:52.854 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:31:52.876 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T12:31:52.876 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:31:52.901 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T12:31:52.901 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:31:52.905 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:31:52.918 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:31:52.968 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T12:31:52.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:31:52.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:31:52.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:31:53.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T12:31:53.755 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T12:31:53.755 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:31:53.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:31:53.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:31:53.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T12:31:53.891 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:31:53.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:31:53.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:31:53.920 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-12T12:31:53.929 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-12T12:31:53.961 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-09-12T12:31:54.008 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:31:54.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:31:54.041 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:31:54.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:31:54.057 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:31:54.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:31:54.071 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T12:31:54.083 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T12:31:54.084 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi038 2024-09-12T12:31:54.084 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:31:54.163 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi071 2024-09-12T12:31:54.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:31:54.200 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901711/remote/smithi154 2024-09-12T12:31:54.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:31:54.236 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T12:31:54.237 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:31:54.241 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:31:54.244 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:31:54.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T12:31:54.298 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T12:31:54.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T12:31:54.339 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T12:31:54.339 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:31:54.343 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:31:54.346 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:31:54.359 INFO:teuthology.orchestra.run.smithi071.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:31 /home/ubuntu/cephtest 2024-09-12T12:31:54.360 INFO:teuthology.orchestra.run.smithi154.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:31 /home/ubuntu/cephtest 2024-09-12T12:31:54.374 INFO:teuthology.orchestra.run.smithi038.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:31 /home/ubuntu/cephtest 2024-09-12T12:31:54.376 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T12:31:54.416 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T12:31:54.526 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} duration: 1486.4038808345795 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T12:31:54.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T12:31:54.613 INFO:teuthology.run:pass